Big Data Engineer
">
We are seeking a highly skilled Big Data Engineer to join our team. As a Senior Spark/Pyspark engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Python.
">
The ideal candidate will have experience with reworking and modernizing our python and pyspark ETL library and Delta tables. You will also work closely with the data engineering team to build out a robust Data Quality framework using the Great Expectation spark library.
">
This is an excellent opportunity for someone who wants to work on challenging projects, collaborate with talented professionals, and contribute to the development of innovative data solutions.
">
You will be working in a hybrid environment, split between our office in Braga, Coimbra or Lisbon, and remote work from home. We offer a competitive salary and benefits package, including health insurance, a personalized training plan, and constant feedback to help you grow professionally.
">
In addition to your technical skills, you should have strong communication and collaboration skills, as well as fluency in English (C1). If you're passionate about big data, data engineering, and innovation, we encourage you to apply for this exciting opportunity.
">
About the Role:
">
">
* Design, develop, and maintain large-scale data processing systems using Apache Spark and Python.
">
* Rework and modernize our python and pyspark ETL library and Delta tables.
">
* Build out a robust Data Quality framework using the Great Expectation spark library.
">
* Work closely with the data engineering team to design and implement data pipelines.
">
">
What We Offer:
">
">
* A competitive salary and benefits package, including health insurance and a personalized training plan.
">
* A dynamic and innovative work environment, with opportunities for growth and professional development.
">
* A collaborative team culture, with regular team events and social activities.
">
* Flexible working arrangements, with a balance of office and remote work.
">
">
Requirements:
">
">
* Bachelor's degree in Computer Science, Engineering, or related field.
">
* 5+ years of experience in big data engineering, with expertise in Apache Spark and Python.
">
* Strong knowledge of data modeling, data warehousing, and data governance.
">
* Experience with cloud-based platforms, such as AWS or Azure.
">
* Fluency in English (C1).
">
"]},