Data Engineer

Required Skills:

• Previous experience as a data engineer or in a similar role.
  
• The candidate need to be highly skilled in Python, Pyspark/spark, SQL, Airflow, Databricks and Azure Cloud (VMs, K8S, Datalake Storage).
  
• Technical expertise with data models, data mining, and segmentation techniques.
  
• Knowledge of programming language Python and also Azure Data Bricks and Airflow
  
• Hands-on experience with SQL database design and writing SQL queries
  
• Great numerical and analytical skills
  
• Should be able to work on Data pipelines and Backend/DB.
  
• Analyze and organize raw data systems and pipelines
  
• Evaluate business needs and objectives
  
• Interpret trends and patterns
  
• Conduct complex data analysis and report on results
  
• Prepare data for prescriptive and predictive modeling
  
• Build algorithms and prototypes
  
• Combine raw information from different sources
  
• Explore ways to enhance data quality and reliability
  
• Identify opportunities for data acquisition
  
• Develop analytical tools and programs
  
• Collaborate with data scientists and architects on several projects