Lead Azure Data Engineer
Lead Azure Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Title: Lead Data Engineer
Interview: One/Done
Job Duration: 6 Months
Job Location: Minneapolis MN
Job Description:
We are looking for a skilled Senior/Lead Data Engineer with expertise in Python Apache Spark and Azure Data Engineering services to design and manage scalable ETL pipelines supporting AI/ML initiatives. The ideal candidate will have strong experience with Azure Synapse Data Factory SQL and Data Warehousing along with CI/CD deployment and crossfunctional collaboration.
Key Responsibilities:
- Build and optimize ETL pipelines using Python Spark and Azure Synapse.
- Manage Azure Data Factory workflows SQL Pools and Spark Pools.
- Develop Data Warehousing solutions to support AI/ML requirements.
- Implement CI/CD pipelines and automate infrastructure provisioning.
- Collaborate with crossfunctional teams to deliver data solutions.
- Develop and deploy APIs leveraging Kubernetes for containerized applications.
- Support Agile development processes and mentor junior team members.
Required Skills:
- Advanced knowledge of Python Spark Azure Synapse and Data Factory.
- Proficiency in SQL CI/CD tools and Azure Cloud services.
- Experience with APIs Kubernetes and ADLS Gen2.
- Strong problemsolving and communication skills.
- Agile experience with the ability to lead and mentor teams.
Preferred Qualifications:
- Azure certifications in data engineering or cloud architecture.
- Experience deploying AI/ML models and ensuring data governance compliance.
Employment Type
Full Time
