Lead Data Engineer in Python and Pyspark

Join a dynamic team as a Lead Data Engineer specializing in Python and Pyspark. Your extensive knowledge in data analysis and backend solutions will be key to driving successful projects.
We seek candidates with over 8 years of experience, proficient in Python and Spark. You will focus on developing Pyspark applications while ensuring optimal performance and security of solutions. Your role includes the development of APIs and troubleshooting software issues to maintain high-quality service delivery.
Key Responsibilities:
• Lead development of software solutions using Python
• Implement Pyspark programs for data processing
• Write Python scripts to extract data from HBase
• Integrate backend services and APIs effectively
• Optimize applications for both security and performance
Requirements:
• Minimum 8 years of experience in data engineering
• Strong skills in Python and Spark required
• Expertise in Pyspark and DataFrame operations
• Familiarity wi...