Azure Data Engineer

Direct message the job poster from Stealth iT Consulting

Delivery Consultant | Contracts | Public Sector | Digital & Cloud | Technology | GDS | Government Roles | Security Clearance

Job Title: Data Engineer

Location: Remote with onsite visits to Swansea (2 days per week). Travel will be expensed

Clearance: Active SC

Responsibilities

• Build and maintain robust, scalable data pipelines in Databricks in alignment with data modelling and architecture principles as directed by the client's head of data
• Ensure data quality, consistency, and lineage across all data sources and destinations
• Implement and manage orchestration, scheduling, and monitoring of data pipelines
• Collaborate with members of the client's data team to ensure solutions are aligned to target architecture and best practices
• Maintain technical documentation for data pipelines, jobs, and integrations
• Support and dev...