II
Posted:
March 01, 2026
Location:
Kuala Lumpur, Kuala Lumpur, Malaysia
Job Description
Role: Data Engineer with Databricks specialization.
Data Pipeline Development
Design, build, test, and maintain high‑performance ingestion and transformation pipelines using Azure Databricks.
Implement modular, reusable business logic and transformations using DBT or Coalesce (or similar transformation frameworks).
Develop and optimize ELT/ETL workflows including CDC-based incremental data loads, data wrangling, cleansing, and enrichment.
Ensure pipelines are scalable, maintainable, resilient, and cost‑efficient across cloud environments.
Quality, Testing & Documentation
Conduct unit, integration, and regression testing to validate transformation logic and data accuracy.
Implement and maintain data quality frameworks, ensuring data completeness, consistency, and reliability.
Produce clear, comprehensive technical design and build documentation.
Collaboration & Governance
Work closely with BI, data governance, and platform teams to ensure consistent data...
Data Pipeline Development
Design, build, test, and maintain high‑performance ingestion and transformation pipelines using Azure Databricks.
Implement modular, reusable business logic and transformations using DBT or Coalesce (or similar transformation frameworks).
Develop and optimize ELT/ETL workflows including CDC-based incremental data loads, data wrangling, cleansing, and enrichment.
Ensure pipelines are scalable, maintainable, resilient, and cost‑efficient across cloud environments.
Quality, Testing & Documentation
Conduct unit, integration, and regression testing to validate transformation logic and data accuracy.
Implement and maintain data quality frameworks, ensuring data completeness, consistency, and reliability.
Produce clear, comprehensive technical design and build documentation.
Collaboration & Governance
Work closely with BI, data governance, and platform teams to ensure consistent data...
Apply for this Job
Submit your application for the Data Engineer position at IITMatrix.
Apply Now Save for LaterJob Overview
Job Type:
Full-time
Location:
Kuala Lumpur, Malaysia
Posted:
March 01, 2026
Deadline:
April 10, 2026