Senior Software Engineer

Required Experience

• 5+ years of software engineering experience with a focus on data infrastructure, platform engineering, and distributed systems
• Strong proficiency in at least one programming language - Python/Go/Scala
• Deep understanding of Apache Spark architecture and experience running Spark workloads in production
• Solid experience with AWS services, particularly EMR, EKS, S3 etc.
• Experience with Data Platform infrastructure on Kubernetes and container orchestration
• Strong understanding of data engineering concepts, workflows, and best practices
• Proven ability to debug complex issues in distributed systems
• Knowledge of data quality frameworks and tooling (Great Expectations, Deequ, Monte Carlo, etc.)
• Experience with data lineage tools and metadata management (Apache Atlas, DataHub, OpenLineage, etc.)
• Understanding of data governance principles and compliance requirements...