Senior Data Engineer (Spark / Databricks)Portugal (Hybrid)w BrainInternational Enterprise ProjectAbout w BrainAt w Brain, we support organizations across Europe in delivering complex technology and data transformation initiatives. Our teams combine strong technical expertise with strategic consulting capabilities to help organizations unlock the full potential of their data.We are currently looking for aSenior Data Engineerto join an international enterprise project, contributing to the design, development, and optimisation of modern data platforms.Role MissionAs aSenior Data Engineer, you will be responsible for designing scalable data architectures, building high-quality data pipelines, and ensuring reliability and performance across the entire data stack.You will collaborate with cross-functional teams in an international environment to support large-scale data-driven initiatives.Key ResponsibilitiesData Engineering & Pipeline DevelopmentDesign, implement, and optimise robust data pipelines usingPy Spark and Apache SparkBuild scalable and high-performance data processing solutionsApply best practices forbatch and streaming data processingData ArchitectureContribute to architectural decisions using modern platforms such asDatabricksDesign and implementdata lakehouse and data warehouse architecturesEnsure scalability, reliability, and performance of the data platformData Quality & GovernanceImplement strongdata quality, monitoring, and schema evolution practicesSupport enterprise data governance and observability standardsEnsure reliable data delivery across the organizationCollaboration & Stakeholder EngagementWork closely with cross-functional teams includingdata scientists, analysts, and business stakeholdersCollaborate in an international enterprise environmentMentor and guide junior engineers when requiredRequired ExperienceBachelor's degree in Computer Science or a related field5+ years of experience in Data EngineeringStrong expertise in:Py SparkApache SparkDistributed data processingStrong command ofSQL, including:Query optimisationWindow functionsComplex transformationsExperience withDatabricksor similar enterprise data platformsStrongPython scripting skillsfor data transformation and automationSolid understanding of:Data lakehouse and warehouse architecturesData quality and monitoring practicesExperience withGit or other version control systemsProfessional English proficiencyResident and eligible to work in PortugalNice to HaveExperience withAzure Cloud(certification is a plus)Experience as abackend or full-stack developer(Python / Node.js / Java / C# / C++)Understanding ofLambda or Kappa architecturesExperience withCI/CD pipelinesExperience withDocker and KubernetesExperience mentoring engineers or leading small teamsExperience working inAgile environmentsWhat We OfferOpportunity to work onlarge-scale enterprise data platformsInternational and collaborative working environmentParticipation incutting-edge data and analytics initiativesFlexible hybrid working modelApplicationsInterested candidates should send their updated CV to:Subject: