Databricks Unified Data Analytics Platform Engineer

Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Cognitive Engineer

Responsibilities

• Design and build complex pipelines using Delta Lake, Auto Loader, Delta Live Tables (DLT), and deployment using Asset Bundles.
• Proven experience as a Data Architect and Data Engineer leading enterprise-scale Lakehouse initiatives.
• Expert-level understanding of modern Data & Analytics Architecture patterns including Data Mesh, Data Products, and Lakehouse Architecture.
• Excellent programming and debugging skills in Python.
• Strong experience with PySpark for building scalable and modular ETL/ELT pipelines.
• Architect data ingestion and transformation using DLT Expectations, modular Databricks Functions, and reusable pipeline compone...