Job Description
I am looking for an experienced Data Engineer to support a Treasury Data Warehouse modernization project focused on migrating legacy MS SQL/T-SQL pipelines to Databricks. You will work on ingestion pipelines, Spark/PySpark transformations, workflow orchestration, and ETL migration while helping deliver a functional MVP/PoC for reporting and data processing. Strong Databricks, Python, Spark, and SQL experience are essential.
🚀 Project
- implementation of a Treasury Data Warehouse modernization project
- development and migration of data pipelines from MS SQL/T-SQL DWH to Databricks
- implementation of ingestion pipelines and data transformations
- development of orchestration workflows
- migration and rewrite of legacy ETL logic into Spark/Databricks framework
- delivery of a functional MVP/PoC for data processing and reporting
- optimization and transformation of data workflows
- collabo...
Apply for this Job
Submit your application for the Data Engineer position at Confidential.
Apply Now Save for Later