Overview
">
Aubay Portugal is a multinational company that has been operating in Portugal since 2007. We have offices in Lisbon and Oporto and we are specialized consultants in Management, Implementation, Development and Maintenance of Information Systems.
Your role as a Data Engineer
">
* You will be responsible for maintaining the DataHub in production environment.
* Troubleshooting incidents and evolving both technical and functional environments.
* Maintaining data flows to ensure service continuity and data integrity.
* Data modeling and development of robust scalable pipelines applying complex business rules.
* Automating pipelines and data ingestion using orchestrators like Airflow as a Service.
* Designing and implementing pipelines with Spark (Scala) and COS/S3 storage.
* Migrating from Hadoop infrastructure to cloud (Kubernetes, COS, Spark, Airflow as a Service).
* Developing unit tests and performing validation.
* Creating technical and operational documentation.
Requirements
">
* Bachelor's degree in Computer Science, Engineering or related field;
* 3+ years of experience as a Data Engineer or similar role;
* Technical expertise in Spark with Scala (mandatory);
* Technical expertise in Airflow (mandatory);
* Technical expertise in S3/COS storage (mandatory);
* Knowledge of CI/CD tools, Structured databases and HDFS, SDLC and Agile methodologies;
* Ability to clearly communicate complex ideas with both technical and business audiences;
* English fluency minimum C1.
What we offer
">
* Health Insurance;
* Feedback&Coffee – the system that includes Aubay's Performance Management Cycle, with regular moments of feedback and the Career Progression Model;
* A Training Academy designed to think of you and your needs. You can count on technical and behavioral training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring;
* Events and Teambuildings.
About us
">
* We are committed to transparency, team spirit, regular feedback and continuous learning.
* We value our employees' growth and well-being.
* We believe in fostering a culture of innovation and collaboration.