Senior Data Engineer
Our company seeks a highly skilled Senior Data Engineer to join our solution engineering team. As a key member of the team, you will play a critical role in designing, building, and maintaining data pipelines and solutions to support our clients' diverse needs.
Key Responsibilities:
* Lead and manage a team of data engineers, overseeing project delivery, task prioritization, and performance to ensure high-quality outputs.
* Plan and balance team workload and capacity, aligning resources with project timelines and organizational goals.
* Design, implement, and maintain data integration pipelines using Python and Spark (e.g., PySpark).
* Build data solutions to process data at scale, handling mainly batch processes (experience with real-time pipelines as a plus).
* Research and implement modern industry best practices, ensuring adherence to high standards.
* Optimize data systems and processes to improve performance and scalability.
Requirements:
* 4+ years of experience in data engineering or a similar role.
* Strong hands-on experience with Python, Spark, and MS Azure stack.
* Extensive Databricks knowledge (including Unity Catalog management, performance optimization, and governance).
* Proven experience in managing client-facing projects and handling escalations.
* Experience in consumer data/working with external data agencies is a plus.
* Deep understanding of ETL processes.
* Experience developing using AI/ML.
Why Join Us?
* Fresh, Agile, Entrepreneur environment with direct exposure to corporate initiatives.
* Full onboarding training and plan.
* Flexible work environment within a cohesive and collaborative team.
* Competitive package commensurate with experience.
* Exposure to global clients and cross-functional teams.
Redslim offers a people-first culture that encourages everyone to drive change on behalf of our customers.