Data Engineer

A client based in SA is seeking an
Intermediate Data Engineer
as follows

Responsibilities:

• To design and build data pipelines using Hadoop / Apache on Cloudera
• Design Data Models / do Data Mapping in Hadoop
• Build ELT / ETL pipelines using Hive / Nifi into their Data Lake (Hadoop)
• Mentor Jnr Data Engineers with their work
• Assist Data Scientists, Analysts and DevOps Eng's (as needed)

Skills Required
:

• At least 4 - 5 yrs exp. in Data Engineering
• From a BI Developer or Data Analyst background
• Exp. in ETL / ELT using Hadoop HDFS + Impala, Apache Nifi + Hive
• Exp. using Cloudera (or similar Azure / AWS platform pipelines)
• Understand Data Quality, Data Governance, Data Security and DevOps (CI/CD pipelines)
• Ideally with Telecoms exp. (billing / calls, PGW, MSC, CDR's) or any high volume data environment
• A Comp. Science / Eng. degree and relevant cert...