We are looking for a Senior Data Engineer with at least 2 years of recent PySpark experience to join a project with a customer in the financial services industry.
PySpark
As aSenior Data Engineer, be responsible for building high-quality, scalable data pipelines, defining robust data architectures, and driving quality and performance across the entire stack. More specifically, you will:
* Design, implement, and optimise robust data pipelines usingPySpark and Apache Spark.
* Set up and guide architectural decisions using modern data platforms like Databricks .
* Apply best practices across batch and streaming data processing to support data-driven initiatives
* Drive collaboration with cross-functional stakeholders in a large enterprise setting—ideally you have experience within banking, insurance, or financial services
* Collaborate within a cross-functional, international team in a fast-paced enterprise environment
* Possibly mentor and guide junior engineers
Position Requirements
We highly value individual experience and are not only interested in ticking boxes, nevertheless, there are some essential skills required to get the job done:
* Bachelor's degree in Computer Science or a relevant field.
* 5+ years of experience in Data Engineering, with strong expertise inPySpark, Spark, and distributed computing
* Strong command of SQL, including optimisation, window functions, and complex transformations
* Experience with Databricks and or other low-code enterprise data platforms.
* Deep familiarity with data architectures (data lakehouse, warehouse, streaming systems)
* Strong scripting skills in Python for data transformation and automation
* Solid understanding of data quality, schema evolution, and monitoring best practices.
* Experience with version control systems (Git).
* English Proficiency, both spoken and written
* Resident and eligible to work in Portugal
Nice skills to have will be
* Familiarity with Azure Cloud (certification preferred)
* Experience as a backend or full-stack developer (e.g. Python / Node.js / Java / C# / C++)
* Understanding of Lambda/Kappa architectures and their application to real-time analytics
* Solid grasp of CI/CD
* Experience with containerization (Docker, Kubernetes)
* Proven experience leading or mentoring teams in corporate environments
What’s in it for you?
* Competitive salary (negotiable based on experience) as we value top talent.
* Cutting-edge hardware: A high-performance laptop with ample memory and processing power, along with any peripherals you need.
* A dynamic and collaborative work environment where your leadership will shape the team’s future.
* Opportunities for professional development and ongoing training to keep you at the forefront of technology.
* A comprehensive health insurance package and attractive benefits.
* Quarterly team get-togethers for collaboration, innovation, and fun!
* A welcoming and inclusive workplace where we embrace diversity and creativity.
Work Setup
* You will have the option of working in either of our offices (Évora or Lisbon), or from the comfort of your home. Many of us work remotely.
* The main point is that you’ll be in touch with a great team who really enjoy working together.
Apply using the form below
First name *
Last name
Email *
Phone number
Message *
Resume
Two Impulse needs the contact information provided to get back to you. You may unsubscribe from our communications at any time. For more information, please review our Privacy Policy .
SUBSCRIBE NEWSLETTER
Get awesome monthly updates about what’s going on in the Two Impulse world. This means company and team news, essential product information, blog articles and valuable insights, and much more.
First name
Email *
I agree to receive the newsletter from Two Impulse.
I agree to receive the newsletter from Two Impulse.
*
By clicking subscribe, you consent us to store and process the information above to provide you the content requested. You may unsubscribe from our communications at any time. For more information, please review our Privacy Policy .
#J-18808-Ljbffr