A data engineer is a crucial role in the development and maintenance of modern information systems. We are seeking an experienced professional to join our team and take on the challenge of designing, developing, and maintaining scalable and robust data pipelines.
Job Responsibilities
* We need someone who can optimize data flows to enrich and transform large volumes of information using complex business rules. This involves automating ingestion and orchestration processes with Apache Airflow, implementing solutions with Spark (Scala), COS/S3 storage, and Parquet format, setting up CI/CD pipelines, unit testing, and validation processes, and preparing technical and operational documentation.
* The ideal candidate will have strong knowledge of Spark with Scala, Apache Airflow, Kafka/Event Streaming, and S3/COS. They should also have solid experience with SQL and NoSQL databases, familiarity with CI/CD tools (GitLab, Jenkins), and fluency in English (at least B2 level).
Requirements
* Minimum 4 years of professional experience as a Data Engineer;
* Bachelor's degree in Computer Science or equivalent;
* Familiarity with continuous integration and delivery methodologies;
* Strong problem-solving skills and attention to detail;
* Excellent communication and teamwork skills;
* Residency in Portugal (citizenship, residence permit/work visa) — mandatory.
What We Offer
* Professional growth and development opportunities;
* A collaborative and dynamic work environment;
* A competitive salary and benefits package;
* The chance to work on challenging projects and make a meaningful impact;
* Regular feedback and performance evaluations.
About Us
We are a leading provider of technology solutions, dedicated to helping our clients achieve their goals through innovative and effective solutions. Our team is passionate about delivering exceptional results and providing outstanding service to our clients.