Location: Lisbon, Parque das Nações
Experience: 3 to 5 years in similar roles
Job Description: We are seeking a skilled Data Engineer to join our team and participate in the migration and data management of an ERP system. The ideal candidate will have a strong background in data engineering and be proficient in various technologies and tools.
Responsibilities: Collaborate with cross-functional teams to understand data requirements and ensure data integrity during ERP migration.Design, develop, and maintain data pipelines using Data Bricks.Implement ETL (Extract, Transform, Load) processes to ingest data from various sources.Ensure data quality, integrity, and reliability through testing and validation.Implement and manage data warehousing solutions.Utilize Azure for cloud-based data storage and processing.Support the management and optimization of Databricks unity catalogs and delta tables.Monitor and maintain query performance and security.Develop APIs and other interfaces for data access and manipulation.Perform data analysis and ensure data quality and consistency.Create and maintain documentation related to data processes and workflows.Provide support for data-related issues and troubleshoot as necessary.Develop and maintain dashboards and reports using Tableau and/or PowerBI for data visualization and reporting.Generate reports and visualizations to communicate data insights and pipeline performance. Requirements: Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.3 to 5 years of experience in data engineering or similar roles.Proficiency in Data Bricks is essential.Experience working with Azure solutions.Knowledge of SQL, Python, Data Warehousing, Snowflake, PowerCenter.Basic understanding of cloud platforms and services (e.g., AWS, Azure, Google Cloud).Strong problem-solving skills and attention to detail.Excellent communication and teamwork abilities.Solid level of English.Knowledge of Tableau and/or PowerBI is a plus. Preferred Qualifications: Experience with ERP systems and data migration projects.Familiarity with data governance and best practices.Ability to work in a fast-paced environment and manage multiple priorities.Experience with Databricks or its related technologies (e.g., Apache Spark, Delta tables, Unity Catalogs) is desirable.Ability to analyze complex data sets and identify patterns or anomalies.