Job Title: Cloud Infrastructure Engineer
We are seeking a highly skilled Cloud Infrastructure Engineer to join our team. The ideal candidate will have expertise in designing and maintaining cloud-based infrastructure using IaC tools such as Terraform, ARM, or Bicep.
The successful candidate will be responsible for automating deployments and CI/CD pipelines for reliable, repeatable data pipeline releases, developing automated testing for data quality, pipeline validation, and infrastructure checks.
Additionally, the DevOps Engineer will implement monitoring and alerting with Azure Monitor, Log Analytics, and Databricks tools, optimize cloud costs, cluster performance, and large-scale Spark workloads.
Maintaining strong security practices including IAM, encryption, network security, and secret management is also crucial.
The DevOps Engineer will collaborate across IT, security, and business teams while contributing to runbooks and knowledge sharing.