Big Data Engineer – Snowflake, AWS, Spark, Scala

Overview

Skills - Snowflake/Hadoop/Scala/Spark/Hive/AWS

Responsibilities

• Work within an Agile cross functional team to design, develop and maintain data ingestion flows and evolve the platform to orchestrate them.
• Design and implement data pipelines, framework and ETL processes.
• Ensure data quality, security, and performance. Develop and optimize SQL queries, stored procedures, and views.
• Integrate Snowflake with other data sources and BI tools.
• Monitor and troubleshoot data jobs and platform issues.
• Develop and maintain comprehensive documentation for data pipelines, transformations, and data models.

What you need to succeed

• 5+ years of Experience with Big Data technologies used for ETL Hadoop
• 5+ Spark, Hive
• Well versed with Snowflake Platform.
• Strong SQL skills and knowledge of data modeling.
• Programming Experience with Scala or Java an API ...