Databricks Developer

Databricks Developer

Tasks:

• Develop and maintain reusable framework components for Databricks-based data pipelines using Python/PySpark and SQL
• Implement and optimize CI/CD processes using GitHub and GitHub Actions for Databricks workflows and artifacts
• Design and build standardized ETL/ELT structures, including logging, error handling, and performance optimization
• Integrate additional technologies such as Azure, Unity Catalog, or streaming components to enhance platform capabilities

Requirements:

• Senior Databricks experience
• GitHub
• CI/CD pipelines (GitHub Actions)
• Spark
• Python / PySpark
• Strong SQL skills
• Microsoft Azure
• Data Vault modeling
• Streaming
• Unity Catalog
• Splunk

Digisourced is supporting a client on a contract Databricks Developer requirement for delivery on an interna...