Principal Databricks Data Engineer

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

Key Requirements

• Experience in enterprise Data Warehouse and Data Lake platforms
• Hands‑on experience with Databricks and Spark at scale
• Strong experience in modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse
• Redesign ingestion, transformation, and consumption patterns from HDFS‑based architecture to cloud object storage and Delta Lake
• Refactor legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines
• Ensure data reconciliation, audit i...