Business intelligence developer

Key Responsibilities

We are seeking a skilled Data Engineer to join our team for a remote project based in Portugal. As a key member of the team, you will be responsible for designing, developing and maintaining large-scale data processing systems.

Job Description:

* Design, develop and maintain large-scale data processing systems using PySpark and Spark SQL
* Experience with Databricks using Unit Catalog is required
* Familiarity with Delta Live Tables (DLT) for automated ETL and workflow orchestration in Databricks is essential
-----------------------------------

To be successful in this role, you should have:



* +4 years of experience as a Data Engineer.
* Proficiency with PySpark and Spark SQL.
* Familiarity with Azure Data Lake Storage
* Orchestration tools such as Apache Airflow or similar
* Knowledge of Terraform including good practices of GitOps
,

Se candidatar

Criar um alerta

Alerta activado

Salva

Salvar