Data Engineer (Sao Paulo, BR)

Job Summary

The Architect role involves designing and implementing scalable data solutions using advanced technologies like MS Data Fabric Power BI, Spark, OneLake SQL, PySpark and has hands‑on Experience in Power BI. The candidate will work in a hybrid model collaborating with cross-functional teams to deliver high-quality data architectures that drive business insights and innovation.

Key Responsibilities: Data Engineer

1. Pipeline Development: Design, develop, and maintain robust, scalable ETL/ELT data pipelines using Azure Data Factory (ADF) and Azure Databricks.
2. Data Transformation: Utilize PySpark and SparkSQL to perform complex data transformations, cleaning, and aggregation.
3. Azure Data Lake Management: Work with Azure Data Lake Storage (ADLS) Gen2 and Azure Blob Storage for efficient data handling.
4. Data Modeling: Create and optimize data models (conceptual/logical/physical) for lakehouse architecture (medallion:...