Job Title: Data Engineer - Cloud Services Architect
The ideal candidate will have experience designing and implementing production-grade data pipelines using SQL, Apache Spark, and cloud-based services. Strong problem-solving skills and the ability to troubleshoot data orchestration and streaming tools are essential for this role.
Key Responsibilities:
* Design, implement, and maintain scalable data engineering solutions in Python or Scala with proper testing and CI/CD practices.
* Ensure data governance, security, compliance, and quality across cloud environments.
Required Skills and Qualifications:
Mandatory Requirements:
* Experience with data pipelines in a production environment.
* Strong hands-on knowledge of SQL and distributed data processing (e.g., Apache Spark).
* Proficiency in troubleshooting dbt, Apache Kafka, Apache Ignite, NiFi, and AirFlow.
* Programming language proficiency (e.g., Python or Scala) for data engineering tasks.
* Cloud data service expertise (AWS).
* Grafana tool familiarity.
* Data governance, security, and compliance knowledge in a cloud environment.
* CICD and testing framework implementation experience for data workflows.
* Excellent communication and collaboration skills.
* English fluency (written and spoken).
Complementary Requirements:
* Familiarity with Dremio data lake warehouse architectures.
* Terraform provisioning data services experience.
* Power BI on-premises gateway knowledge.
* Data catalogue and governance tool experience (Collibra, Alation).
* Machine learning pipeline and feature engineering experience.
What We Offer:
* Opportunity to work with cutting-edge technologies.
* Dynamic and collaborative work environment.
* Professional growth and development opportunities.