Job Opportunity: Data Engineer
TS DATA is seeking an experienced data engineer to design and manage robust data solutions using Databricks, SQL, and Azure Synapse.
Key Responsibilities:
* Data Pipeline Development: Implement data pipelines using Databricks, PySpark, and dbt for efficient data transformation and storage.
* Pipeline Optimization: Develop and optimize pipelines using Databricks and PySpark to improve data processing speed and accuracy.
* Database Management: Store, manage, and transform large datasets using SQL and Azure Synapse for actionable insights.
* Dashboard Creation: Create Power BI dashboards for business stakeholders to provide data-driven recommendations.
* CICD Implementation: Implement continuous integration and delivery with Azure DevOps YAML pipelines and troubleshoot issues for a smooth deployment process.
Requirements:
* Education and Experience: Bachelor's or Master's degree in a relevant field, plus proven hands-on experience in designing and managing robust data solutions.
* Skills and Qualifications: More than 5 years of experience in designing and managing robust data solutions, with expertise in Databricks, SQL, Azure DevOps (YAML), dbt, PySpark, Azure Synapse, and Power BI.
* Language Proficiency: Fluency in English (minimum B2 level) for effective communication and collaboration.
* Soft Skills: Strong communication, collaboration, and problem-solving abilities to work effectively in a team environment.