Data Engineering Expertise: Real-Time Data Processing and Scalable Solutions
We are seeking a highly skilled Data Engineer to join our team. As a key member, you will design and implement scalable data solutions using AWS services such as Glue, Redshift, S3, Kafka, DynamoDB, Lambda, and EMR.
Key Responsibilities:
* Architect and Design: Develop efficient data pipelines using AWS services for real-time data processing.
* Integration: Integrate data from various sources into our data lake, ensuring seamless data flow and processing.
* Data Lake Management: Design and manage a large-scale data lake using AWS services like S3, Glue, and Lake Formation.
* Data Transformation: Apply transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
* Snowflake Integration: Implement data pipelines to load data into Snowflake, utilizing Iceberg tables for performance and flexibility.
* Performance Optimization: Optimize data processing pipelines for performance, scalability, and cost-efficiency.
* Security and Compliance: Ensure all solutions adhere to security best practices and compliance requirements.
Requirements:
* Experience: 8+ years of experience in data engineering or cloud solutioning, with a focus on AWS services.
* Technical Skills: Proficiency in AWS services such as API, Glue, Redshift, S3, Kafka, and Lake Formation. Experience with real-time data processing and streaming architectures.
* Big Data Querying Tools: Strong knowledge of big data querying tools (e.g., Hive, PySpark).
* Programming: Strong programming skills in languages such as Python, Java, or Scala for building and maintaining scalable systems.
* Problem-Solving: Excellent problem-solving skills and ability to troubleshoot complex issues.
* Communication: Strong communication skills, with ability to work effectively with both technical and non-technical stakeholders.
* Certifications: AWS certifications are a plus.
What We Offer:
A hybrid working model, flexible schedule, budget for home office support, and the opportunity to do volunteer work. Health insurance, access to our medical center, sports groups, online learning platforms, and discounts with partners.
Join our team and be part of creating a diverse environment where everyone feels valued and respected. Siemens is an equal opportunity employer.We strongly encourage applications from a diverse talent pool.