Match Profiler is an Information Systems consultant who has been working in the national and international market since ****.
We have multidisciplinary skills and IT know-how that allow us to contribute, optimize and progress with our clients.
We are currently recruiting, for integration in our internal team/client, professionals with the following profile:Data Engineer - Azure Data Factory & Databricks - Hybrid (2 days week on-site/Lisbon)The Project:International project in the financial sectorData platform on Azure, with ADF and Databricks as the coreStrong focus on data engineering, governance, and qualityCritical production platform with high reliability and stability requirementsWhat do you need to have:Responsabilities: Develop and maintain data pipelines in Azure Databricks (PySpark / Spark SQL)Implement and optimise Delta Lake tables (ETL/ELT, medallion architecture)Collaborate on the design of analytical datasetsIntegrate Databricks workloads with Azure Data Factory (orchestration)Apply best practices for performance, data quality, and reliabilityContribute to the evolution of the platform for analytics and AI scenariosHard skills:At least 4 years of experience as a Data EngineerHands-on experience with Azure Databricks and Apache SparkStrong knowledge of Python (PySpark) and SQLExperience with Delta LakeExperience with Azure services:Azure Data Lake Storage (ADLS Gen2)Azure Data FactoryFluent English (spoken and written)Nice-to-have:Experience with CI/CD for data platforms (Azure DevOps, Git)Knowledge of data governance (e.g., Unity Catalog, Purview)Awareness of security, quality, and regulated environmentsExperience in international projects or distributed teamsSoft skillsGood communicationTeam spiritProactivityTime managementWhat we can offer:Personalized support from your teamYour manager will take into consideration your motivations and suggestionsVictories will be celebrated togetherYour HR and Support Teams will always be available to helpConstant feedback on your workA network of hundreds of partnerships with companies from numerous sectors that offer you exclusive discounts (health, well-being, travel, gastronomy, culture, leisure, training, etc)And, of course, many gatherings and social events