Data Engineer Role
We are seeking a skilled data engineer to join our team of innovators. This role offers a unique blend of remote and on-site work, providing opportunities to engage with global clients and cutting-edge data technologies.
About the Position
We are looking for a motivated data engineer who is adept at leveraging various tools and frameworks to solve complex data-related challenges. The ideal candidate would have 2 years of experience in a similar role, with a strong problem-solving mindset, hands-on attitude, and ability to execute daily tasks efficiently to support diverse clients and projects.
Key Responsibilities
* Configure and customise data processing tools to meet specific client requirements, developing reusable components and ensuring seamless integration with existing systems.
* Design, implement, and maintain data integration code based on Python and PySpark, actively engaging in feedback loops with the core product team and contributing to maintenance and evolution of data tools.
* Develop and implement automated workflows using Artificial Intelligence and conventional software logic.
* Optimise and manage job tasks, Unity Catalog tables and other Databricks services.
* Develop and execute unit and integration tests to ensure data quality and pipeline reliability.
* Research, suggest, and implement best practices and usage of relevant technology/tools in line with modern industry standards.
* Oversee data governance and security, including implementing data access controls, ensuring data privacy, and adhering to company policies.
Benefits of the Role
* Opportunities for professional growth and development.
* Collaborative and dynamic work environment.
* Competitive compensation package.
* Comprehensive benefits program.
This is an excellent opportunity for a skilled data engineer to take their career to the next level and contribute to the success of our organisation. If you're passionate about data, thrive in solving complex challenges, and have experience managing workloads, we want to hear from you.