Lead Data Engineer

KPI Partners is looking for a highly skilled Lead Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in managing and optimizing data pipelines, with strong expertise in Databricks, Airflow, AWS, and Pyspark.

Job Title: Lead Data Engineer ((Databricks, Airflow, AWS, Pyspark)

Location: Hybrid – Hyderabad/Bangalore/Pune

Experience: 8+ years

Employment Type: Full-time

Key Responsibilities:

• Lead the design, development, and maintenance of scalable data pipelines that power data analytics and reporting solutions.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions that meet business needs.
• Implement best practices for data engineering, including data quality, data governance, and performance optimization.
• ...