Software Developer

Job Description

We're seeking an experienced Senior Data Engineer for a 6-month contract engagement with a leading public sector organization. This role requires deep expertise in Microsoft Azure, Data Engineering, Azure Data Factory (ADF), Databricks, Python, and SQL. You'll play a key role in designing and modernizing data pipelines and lakehouse structures within a collaborative Agile environment.Key Responsibilities:

Collaborate with product teams to analyze system requirements and design cloud-based data solutions

Design and build data lakes and lakehouse structures using Azure-native tools

Migrate legacy pipelines from Synapse Analytics and ADF to modernized Databricks solutions using Delta Lake

Develop automated and scalable data pipelines

Work closely with IT teams to resolve issues and enhance analytics product usage

Contribute to the development of reusable frameworks and data engineering standards

...