Data engineer (intermediate)

Overview
Data Engineer (Intermediate) – Pinelands, Cape TownHybrid Position
We are looking for a motivated and technically skilled Data Engineer who is eager to learn and grow. This role involves working with modern data platforms and development practices to design, build, and maintain scalable data solutions.
Key Requirements Technical Expertise (3 - 5 years experience) Previous experience as a data engineer.
Proven experience with big data tools, particularly Databricks.
Strong background in cluster computing using Apache Spark.
Experience developing and maintaining CI/CD pipelines.
Proficiency in Python with mandatory Py Spark experience.
Beneficial Experience Prior work as a backend developer, showcasing strong software engineering fundamentals.
Familiarity with Azure cloud infrastructure and services/
Core Skills Strong communication and collaboration abilities.
Attention to detail with a focus on data quality. <...