Job Title :: Sr. Data Engineer
Job Type :: Contract
Job location ::. 2 days a week, Madrid and Lisbon (Either one) & Local work hours should be fine. Okay to be onsite 2 months and then remote.
Job description::
Contract Duration 6-12 months+
Hybrid, 2 days in office.
* From a technological perspective, the roles are mostly similar. The primary distinction lies in the depth of expertise and the number of years of experience required
* Spanish is a must. 2 days a week, Madrid and Lisbon (Either one) & Local work hours should be fine. Okay to be onsite 2 months and then remote.
Qualification Area
Data Engineer (Mid-Level 06 to 12 years)
Senior Data Engineer (Senior M level12 to 16)
Cloud Environments
Familiarity with major cloud platforms (AWS, GCP, Azure)
Experience developing data systems on major cloud platforms (AWS, GCP, Azure)
Data Architecture
Experience with modern data architectures (data lakes, lakehouses, hubs)
Hands-on experience building modern data architectures (data lakes, lakehouses, hubs)
Data Ingestion
Proficiency in ingestion tools (Kafka, AWS Glue) and formats (Iceberg, Parquet)
Demonstrated proficiency in ingestion tools (Kafka, AWS Glue) and formats (Iceberg, Parquet)
Data Streaming
Knowledge of streaming architectures and tools (Kafka, Flink)
Experience developing pipelines with streaming architectures and tools (Kafka, Flink)
Data Modeling
Strong background in SQL-based frameworks and orchestration tools (dbt, Glue, Airflow). Experience with SCD and schema evolution
Expertise in SQL-based frameworks and orchestration tools (dbt, Glue, Airflow). Deep experience with SCD and schema evolution
Data Transformation (Spark)
Familiarity with Spark for transformation, streaming, tuning, debugging with Spark UI
Strong background with Spark for transformation, streaming, tuning, debugging with Spark UI
Programming
Proficient in Python, Java, Scala (or similar). Expert-level SQL
Advanced programming skills in Python, Java, Scala (or similar). Expert-level SQL
DevOps
Demonstrated experience in DevOps practices (code management, CI/CD, deployment)
Demonstrated experience in DevOps practices (code management, CI/CD, deployment)
Data Governance
Understanding of governance principles (quality, privacy, security)
Strong background in governance principles (quality, privacy, security)