Role
Act as the team's technical expert in Azure Data Factory, Databricks, Python, PySpark and Spark SQL; Responsible for the daily collection and integration of raw data for corporate data assets; Collaborating with the team to define data flows and data standards; Supervising all data consumption and integration processes from source to destination (including Data Warehouse, Data Lake, etc.); Optimise and improve the performance of all data consumption and integration processes.
Profile
University degree in Computer Science or similar; Professional experience in building data pipelines with Azure Data Factory (ADF); Experience as a Data Engineer in large-scale implementation projects with Data Lakes or Cloud Data Platform; Proficiency in SQL, T-SQL, Python or R; Solid knowledge of developing solutions based on pipelines with Azure Functions; Expertise in managing pipelines for a heterogeneous data architecture/ecosystem; Familiarity with configuring and supervising batch and API-based data pipelines; Microsoft certifications will be valued; Fluency in English; Strong communication skills; Analytical skills, attention to detail and focus on problem-solving; A sense of responsibility, autonomy and proactivity.
Work with us
With more than 30 years of experience, Rumos has a team of professionals specialized in IT; At Rumos, consultants integrate highly challenging projects, based on the latest technology and in the most diverse sectors of activity; Rumos consultants have access to a certified training plan, which offers a constant update of technical skills; Rumos, as an employer, has job opportunities based on equity, integrity and diversity. Based on these values, we work so that no person is discriminated against on the basis of age, degree of disability, gender, marital status, pregnancy and maternity, race, beliefs or sexual orientation. We believe in everyone's abilities, because we have in our DNA team spirit and mutual help, empathy and respect.
#J-18808-Ljbffr