Job Description:
As a Data Tech Lead, you will play a key role in driving the design, development, and maintenance of scalable data pipelines to support business needs. You will collaborate with multidisciplinary teams to gather requirements and deliver efficient, reliable solutions.
Key responsibilities include leading the design, development, and maintenance of data pipelines, ensuring performance, security, and data integrity, and optimizing data workflows for large-scale datasets with complex business rules.
Additionally, you will automate data ingestion and pipelines using Apache Airflow, implement secure and scalable data pipelines leveraging Scala, Spark, and Cloud Object Storage (COS), and configure CI/CD pipelines (GitLab, Jenkins) to automate deployment and testing.
You will also document technical specifications and processes for effective knowledge sharing within the team and support issue resolution and provide technical guidance to colleagues.
Required Skills and Qualifications:
* Minimum 6 years of experience as a Data Engineer;
* Strong hands-on experience with Spark and Scala;
* Knowledge of streaming processes (Kafka, event streams);
* Proficiency with Apache Airflow for orchestration;
* Experience with Cloud Object Storage (COS), S3, and Parquet formats;
* Solid experience with SQL and NoSQL databases;
* Familiarity with CI/CD tools (GitLab, Jenkins) and Hadoop environments;
* Knowledge of Kubernetes, Elasticsearch, Kibana, and strong Shell scripting;
* Experience working with Agile methodologies and the Software Development Lifecycle (SDLC);
* English (B2/C1) mandatory, French (B1/B2) preferred.
Benefits:
* Health Insurance;
* Feedback&Coffee – the system that includes Aubay's Performance Management Cycle, with regular moments of feedback and the Career Progression Model;
* Working model: hybrid;
* A Training Academy designed to think of you and your needs. You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring;
* Events and Teambuildings.
Others:
* Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning;
* Reference prizes and birthday present;
* We don't have a dress code;
* We know your name and all address each other informally;
* You will grow in good company.