Manager-Data Modelling and Engineering_491

Overall Objectives:

• Create and build data ingestion pipelines using Azure Synapse Pipelines, Azure Functions and Synapse Notebooks as well as developing script in Python or PySpark for automation.
• Extract data from diverse sources including APIs, databases, flat files and other cloud or on-premises systems.
• Maintain and optimize Synapse Dedicated SQL Pools for data storage and analytical queries.
• Manage code using Git for source control and CI/CD, ensuring consistent and governed deployment of pipelines and artifacts across environments.
• Automate failure handling, alerts and retries to minimize operational overhead and provide technical troubleshooting, issue resolution and continuous support for data delivery pipelines.
• Collaborate with different stakeholders...