Job Role Overview
Data Engineers are responsible for designing, building, and maintaining complex data pipelines using cutting-edge Azure technologies. They will develop and optimize scalable solutions in Azure Databricks with PySpark, manage large-scale data ingestion, transformation, and storage within Azure Data Lake Storage (ADLS), orchestrate workflows using Azure Data Factory (ADF), and collaborate closely with data architects, analysts, and business stakeholders to ensure high-quality data models.
Moreover, Data Engineers must ensure optimal performance, security, and reliability of all data systems, contribute to knowledge sharing through documentation, best practices, and continuous improvement initiatives, and participate in community involvement projects that promote professional growth.
The role offers personalized talent management, comprehensive benefits packages, investment in ongoing training and career development, and a safe and inclusive work environment that fosters collaboration and innovation.