Data Engineering Role
We are seeking a Data Engineer to join our solution engineering team.
This role combines opportunities for remote and on-site work, exposing you to global clients and cutting-edge data technologies.
About the Position
We are looking for a curious Data Engineer who uses various tools and frameworks to solve data-related problems.
Key Responsibilities
1. Configure and Customise Tools
Configure and customise Redslim tools to meet specific client requirements, developing reusable components and ensuring seamless integration with existing systems.
2. Design and Implement Integration Code
Design, implement, and maintain data integration code based on Python and PySpark, actively engaging in feedback loop with core product team and contributing to maintenance and evolution of Redslim tools.
3. Develop Automated Workflows
Develop and implement automated workflows using Artificial Intelligence and conventional software logic.
4. Optimise and Manage Job Tasks
Optimise and manage job tasks, Unity Catalog tables and other Databricks services.
5. Develop and Execute Unit Tests
Develop and execute unit and integration tests to ensure data quality and pipeline reliability.
6. Research and Implement Best Practices
Research, suggest, and implement best practices and usage of any relevant technology / tool in line with modern industry standards.
7. Data Governance and Security
Oversee data governance and security, including implementing data access controls, ensuring data privacy, and adhering to company policies.