Data Engineer

Data Engineer

Skills and Qualifications:

• 3 years of experience in a Data Engineering role with a focus on Python and Apache Spark (PySpark and Databricks).
  
• Handson experience developing and deploying solutions in Azure cloud environments using ADLS ADF and Databricks.
  
• Proficiency in Apache Spark performance tuning and debugging techniques.
  
• Experience with CI/CD pipelines and Azure DevOps (preferred).
  
• Familiarity with YAML and shell scripting (optional but beneficial).
  
• Strong understanding of unit testing and integration testing concepts (optional).
  
• Ability to thrive in an agile environment and collaborate effectively with crossfunctional teams.
  
• Excellent analytical and problemsolving skills with a keen attention to detail.
  
• Strong verbal and written communication skills with the ability to explain complex technical concepts to nontechnical stakeholders.
  
• Proactive attitude towards learning new technologies and solving challenges.
  

Benefits