Job Overview:
Aubay Portugal is a multinational company that specializes in the management, implementation, development, and maintenance of information systems.
The successful candidate will be responsible for building and optimizing scalable data pipelines using Python, PySpark, and SQL to process large datasets.
Key Responsibilities:
* Design and maintain data models and warehouses that enable business intelligence and reporting.
* Ensure data governance, quality, and performance optimization.
* Collaborate with analysts, data scientists, and stakeholders to deliver impactful solutions.
Requirements:
* 4+ years of experience in data engineering.
* Strong expertise in Python, PySpark, and SQL (including performance tuning and Spark internals).
* Hands-on experience with Azure ecosystem: Databricks, Data Factory, Datalake Storage, DevOps.
* Solid knowledge of dimensional data modelling and data warehousing principles.
* Background in software engineering best practices (OOP, TDD, CI/CD, version control with Git).
* Familiarity with Docker and Kubernetes for containerized applications.
* Experience with deployment and monitoring of pipelines in production environments.
Benefits:
* Health Insurance.
* Feedback&Coffee – the system that includes Aubay's Performance Management Cycle.
* Training Academy designed to think of you and your needs.
* Events and Teambuildings.
Our Culture:
* Transparency.
* Team spirit.