.
*Do take note that this is an on-site role based in Kuala Lumpur, Malaysia.
*Candidates can be from anywhere in Europe, ideally, or any part of the world, as long as they are willing to relocate to KL, Malaysia.
Are you passionate about using data to drive innovative solutions in a fast-paced environment?
We're looking for a Senior Data Engineer to join a cutting-edge technology company based in Kuala Lumpur!As a Senior Data Engineer, your mission will be to support data scientists, analysts, and software engineers by providing maintainable infrastructure and tooling for end-to-end solutions.
You'll work with terabytes to petabyte-scale data, supporting multiple products and data stakeholders across global offices.Key ResponsibilitiesDesign, implement, operate, and improve the analytics platformDesign data solutions using various big data technologies and low latency architecturesCollaborate with data scientists, business analysts, product managers, software engineers and other data engineers to develop, implement and validate deployed data solutions.Maintain the data warehouse with timely and quality dataBuild and maintain data pipelines from internal databases and SaaS applicationsUnderstand and implement data engineering best practicesImprove, manage, and teach standards for code maintainability and performance in code submitted and reviewedMentor and guide junior engineers on the jobQualificationsExpert at writing and optimising SQL queriesProficiency in Python, Java or similar languagesFamiliarity with data warehousing conceptsExperience in Airflow or other workflow orchestratorsFamiliarity with basic principles of distributed computingExperience with big data technologies like Spark, Delta Lake or othersProven ability to innovate and leading delivery of a complex solutionExcellent verbal and written communication - proven ability to communicate with technical teams and summarise complex analyses in business termsAbility to work with shifting deadlines in a fast-paced environmentDesirable QualificationsAuthoritative in ETL optimisation, designing, coding, and tuning big data processes using SparkKnowledge of big data architecture concepts like Lambda or KappaExperience with streaming workflows to process datasets at low latenciesExperience in managing data - ensuring data quality, tracking lineages, improving data discovery and consumptionSound knowledge of distributed systems - able to optimise partitioning, distribution and MPP of high-level data structuresExperience in working with large databases, efficiently moving billions of rows, and complex data modellingFamiliarity with AWS is a big plusExperience in planning day to day tasks, knowing how and what to prioritise and overseeing their executionCompetitive salary and benefitsWe'll cover visas, tickets, and 1- 2 months of accommodation to help you settle in