Data Engineer-BigQuery

Data Engineer – BigQuery

Required Skills: Python, PySpark, BigQuery SQL, Airflow, GCP, Big Data
Years of experience: 5+ Years
Locations: Indore, Gurugram

We are seeking skilled Data Engineers with experience in modern data engineering practices and data modelling. You will leverage your knowledge and experience in programming languages and data engineering tools to create data processing and modelling applications
Key Responsibilities:
+ The scope of the project is to migrate the dashboards/ reports from Hadoop to GCP, which will require the Hive and Pig jobs to be migrated to BigQuery / Spark.

+ Ensuring data consistency and accuracy through data validation and cleansing techniques

+ Working together with cross-functional teams to identify and address data-related issues

+ BigQuery, Airflow and GCP experience is required.

+ Security & Governance: Role-based access control (RBAC), Data lineage tools

+ Knowledge ...