Data Engineer Position
A leading technology firm in Portugal is seeking an experienced Data Engineer to join their team.
Main Responsibilities
1. Develop and maintain complex data pipelines using scalable architectures.
2. Enhance data flows by applying business rules and optimizing performance.
3. Automate ingestion and orchestration processes with industry-standard tools.
4. Design solutions with Apache Spark, distributed storage systems, and efficient data formats.
5. Establish robust CI/CD pipelines, unit testing, and validation procedures.
6. Create technical documentation for stakeholders.
7. Provide expert support and guidance to junior team members.