Data Engineer

Required Skills: Previous experience as a data engineer or in a similar role. The candidate need to be highly skilled in Python, Pyspark/spark, SQL, Airflow, Databricks and Azure Cloud (VMs, K8S, Datalake Storage). Technical expertise with data models, data mining, and segmentation techniques.

Knowledge of programming language Python and also Azure Data Bricks and Airflow Hands-on experience with SQL database design and writing SQL queries Great numerical and analytical skills Should be able to work on Data pipelines and Backend/DB. Analyze and organize raw data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and programs Collaborate ...