Senior Data Engineer (Spark / Databricks)
Portugal (Hybrid)
wBrain
International Enterprise Project
About wBrain
At wBrain, we support organizations across Europe in delivering complex technology and data transformation initiatives. Our teams combine strong technical expertise with strategic consulting capabilities to help organizations unlock the full potential of their data.
We are currently looking for a Senior Data Engineer to join an international enterprise project, contributing to the design, development, and optimisation of modern data platforms.
Role Mission
As a Senior Data Engineer, you will be responsible for designing scalable data architectures, building high-quality data pipelines, and ensuring reliability and performance across the entire data stack.
You will collaborate with cross-functional teams in an international environment to support large-scale data-driven initiatives.
Key Responsibilities
Data Engineering & Pipeline Development
* Design, implement, and optimise robust data pipelines using PySpark and Apache Spark
* Build scalable and high-performance data processing solutions
* Apply best practices for batch and streaming data processing
Data Architecture
* Contribute to architectural decisions using modern platforms such as Databricks
* Design and implement data lakehouse and data warehouse architectures
* Ensure scalability, reliability, and performance of the data platform
Data Quality & Governance
* Implement strong data quality, monitoring, and schema evolution practices
* Support enterprise data governance and observability standards
* Ensure reliable data delivery across the organization
Collaboration & Stakeholder Engagement
* Work closely with cross-functional teams including data scientists, analysts, and business stakeholders
* Collaborate in an international enterprise environment
* Mentor and guide junior engineers when required
Required Experience
* Bachelor's degree in Computer Science or a related field
* 5+ years of experience in Data Engineering
* Strong expertise in:
* PySpark
* Apache Spark
* Distributed data processing
* Strong command of SQL, including:
* Query optimisation
* Window functions
* Complex transformations
* Experience with Databricks or similar enterprise data platforms
* Strong Python scripting skills for data transformation and automation
* Solid understanding of:
* Data lakehouse and warehouse architectures
* Data quality and monitoring practices
* Experience with Git or other version control systems
* Professional English proficiency
* Resident and eligible to work in Portugal
Nice to Have
* Experience with Azure Cloud (certification is a plus)
* Experience as a backend or full-stack developer (Python / Node.js / Java / C# / C++)
* Understanding of Lambda or Kappa architectures
* Experience with CI/CD pipelines
* Experience with Docker and Kubernetes
* Experience mentoring engineers or leading small teams
* Experience working in Agile environments
What We Offer
* Opportunity to work on large-scale enterprise data platforms
* International and collaborative working environment
* Participation in cutting-edge data and analytics initiatives
* Flexible hybrid working model
Applications
Interested candidates should send their updated CV to:
Subject: Senior Data Engineer – Portugal