Azure Data Engineer

Azure Data Engineer

Working location: Sentul, KL

Duties

• ETL / ELT pipeline design.
• Data Lake / Lakehouse Design.
• Querying data using PySpark and T-SQL.
• Performance optimization.
• Preparation of product specifications and supporting documentation.
• Data security (adherence to GDPR).

Technical requirements

• 3+ years of experience in a similar role.
• Strong proficiency with SQL language and its variation among popular
• RDBMS types.
• Python (for Spark data manipulation).
• Hands-on experience with Synapse Data engineering is essential.
• Hands-on experience with Fabric Data Engineering is preferred.
• Data Factory Pipelines design (ETL/ELT processes).
• Experience with on-prem SQL (2016 and above) including SSIS.
• Some knowledge of C# (for Azure Function Apps).
• Microsoft development stack (Visual Studio, Azure Dev Ops).
...