Job Title: Data Engineer - Azure Ecosystem
A visionary data engineer with expertise in designing, developing, and maintaining secure and efficient data pipelines using Azure technologies.
* We are seeking a highly skilled data engineer to join our team in Lisbon or Porto.
Main Responsibilities:
* Data Pipeline Development: Design, develop, and maintain secure and efficient data pipelines using Azure Data Factory, Azure Synapse, Microsoft Fabric, Databricks, and Azure SQL.
* Data Processing Workflows: Build and optimize data processing workflows using Py Spark and SQL.
* SQL Process Implementation: Implement and optimize SQL processes including stored procedures and functions to meet analytical and data processing requirements.
* Collaboration: Collaborate effectively with data scientists and other data engineers to ensure data quality and integrity throughout the pipeline.
* BI Data Modeling Solutions: Implement BI data modeling solutions that support data-driven decision-making.
* ETL/ELT Performance: Monitor and improve the performance of ETL/ELT processes to ensure scalability and reliability.
Requirements:
* Microsoft Data Platform Tools: Knowledge of additional Microsoft data platform tools such as SQL Server, SSIS, SSAS, SSRS.
* Adjacent Azure Technologies: Familiarity with adjacent Azure technologies like Azure Logic Apps, Functions, Key Vault, Log Analytics.
* Technical Requirements Analysis: Ability to analyze project technical requirements and contribute to solution design.
* Data Modeling and Visualization: Experience in activities beyond pure engineering, such as data modeling and visualization.
* Power BI: Knowledge of Power BI, especially semantic modeling and DAX, is a strong plus.
* Cloud Data Technologies: Exposure to other cloud data technologies such as Snowflake, DBT, Airflow, or multi-cloud environments.
* Dev Ops Practices: Experience with Dev Ops practices and CI/CD pipelines for data workflows.
* Language Skills: Fluency in English (written and spoken).