Senior Data Engineer
AgileEngine is a technology company that creates award-winning software for top-tier clients, including Fortune 500 enterprises and leading product brands. We rank among the leaders in areas like application development and AI/ML, and our culture has earned us multiple awards.
Why Work with Us?
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you.
About the Role
We are seeking a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You'll work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company.
Key Responsibilities:
* Design, build, and maintain large-scale data pipelines and data processing systems in AWS;
* Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies;
* Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions;
* Implement best practices for data governance, security, and compliance;
* Monitor, troubleshoot, and improve the performance of data systems and pipelines;
* Mentor junior engineers and contribute to building a culture of technical excellence;
* Evaluate and recommend new tools, frameworks, and approaches for data engineering.
Requirements
* Bachelor's or Master's degree in Computer Science, Engineering, or related field;
* 5+ years of experience in data engineering, software engineering, or related roles;
* Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.);
* Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming);
* Strong SQL skills and experience with relational and NoSQL databases;
* Proficiency in Python, Java, or Scala for data processing and automation;
* Experience with workflow orchestration tools (Airflow, Step Functions, etc.);
* Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts;
* Excellent problem-solving skills and ability to work in fast-paced environments;
* Upper-Intermediate English level.
Benefits and Perks
As a Senior Data Engineer, you can expect:
* Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps;
* Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation;
* A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands;
* Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
Job Requirements
* Bachelor's or Master's degree in Computer Science, Engineering, or related field;
* 5+ years of experience in data engineering, software engineering, or related roles;
* Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.);
* Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming);
* Strong SQL skills and experience with relational and NoSQL databases;
* Proficiency in Python, Java, or Scala for data processing and automation;
* Experience with workflow orchestration tools (Airflow, Step Functions, etc.);
* Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts;
* Excellent problem-solving skills and ability to work in fast-paced environments;
* Upper-Intermediate English level.