Senior Data Platform Engineer

Job Summary:
We are seeking an experienced Senior Data Platform Engineer  with over 15 years of expertise  in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure) , Spark Clusters , and CI/CD pipelines using Azure DevOps , with a strong background in modern data platform tools including Apache Ranger, Kafka, Airflow, Trino, Iceberg , and Datahub .
Key Responsibilities:

• Administer and maintain on-prem Kubernetes environments  using in-house Kubernetes packages , as well as Azure Kubernetes Service (AKS)  clusters.
• Provision, configure, monitor, and manage Apache Spark clusters  for large-scale data processing.
• Implement and support CI/CD pipelines  using Azure DevOps (ADO)  for data platform components and i...