Data Pipeline Engineer – Spark/PySpark & SQL

Business Function

Consumer Banking Group enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group CBG, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Key Accountabilities

• Develop, enhance, and support data extraction, transformation, and validation processes using Sparkola, PySpark, and SQL.
• Build and manage batch and ad‑hoc data pipelines through Sparkola Job Server, ensuring stability, performance, and timely delivery.
• Use Cloudera Machine Learning (CML) environments for development, testing, and execution of Spark workloads as per DBS standards.
• Ensure datasets are accurate, traceable, and fit for consumption by downstream analytics and reporting platforms such as QlikSense a...