Job Description
We are looking for a skilled Data Engineer to join our team. The successful candidate will be responsible for designing and developing robust, scalable pipelines, applying complex business rules.
The ideal candidate will have experience with Spark (Scala) and COS/S3 storage, as well as expertise in Airflow and S3/COS storage. They will also have knowledge of CI/CD tools, Structured databases and HDFS, SDLC and Agile methodologies.
Key Responsibilities:
* Design and develop data pipelines using Spark (Scala)
* Develop unit tests and perform validation
* Automate pipelines and data ingestion using orchestrators like Airflow
* Migrate from Hadoop infrastructure to cloud
* Create technical and operational documentation
Requirements:
* Bachelor's degree in Computer Science, Engineering, or a related field
* 3+ years of experience as a Data Engineer or similar
* Technical expertise in Spark with Scala (mandatory)
* Technical expertise in Airflow (mandatory)
* Technical expertise in S3/COS storage (mandatory)
* Knowledge of CI/CD tools, Structured databases and HDFS, SDLC and Agile methodologies
* Ability to clearly communicate complex ideas with both technical and business audiences
* English fluency minimum C1
What We Offer:
* Health Insurance
* Feedback&Coffee - the system that includes Aubay's Performance Management Cycle
* A Training Academy designed to think of you and your needs
* Events and Teambuildings
About Us
We are a multinational company operating in various sectors including banking, insurance, telecommunications, services, energy and transports. Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning.
Our Culture:
* Reference prizes and birthday presents
* No dress code
* We know your name and all address each other informally
* You will grow in good company