Fulltime Cloud Data Engineer- Minneapolis MN
Fulltime Cloud Data Engineer- Minneapolis MN
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Role: Cloud Data Engineer Python Apache Spark Azure
Location: Minneapolis MN (3 days in office/Week)
Type: Fulltime role with Benefits
Position:
We are looking for a skilled Lead Developer to design and manage ETL pipelines data engineering solutions and support AI/ML initiatives on Azure Cloud. This role requires expertise in Python Apache Spark and Azure services along with experience in CI/CD Data Warehousing and API development. The candidate will collaborate with crossfunctional teams to deliver scalable secure and optimized data solutions
Key Responsibilities
- ETL Development: Design scalable pipelines using Python Apache Spark and Azure Synapse.
- Azure Cloud Solutions: Develop and optimize Azure Data Factory SQL Pools Spark Pools and ADLS Gen2.
- CI/CD & Automation: Implement CI/CD pipelines using Azure DevOps and IaC tools like ARM/Terraform.
- API & Kubernetes: Build RESTful APIs and containerized applications with Kubernetes.
- CrossTeam Collaboration: Partner with data scientists analysts and DevOps teams to deliver endtoend solutions.
- Agile Leadership: Lead Agile ceremonies and mentor team members.
Mandatory Skills
- Core Skills:
- Python Apache Spark and Azure Synapse Analytics
- Azure Data Factory SQL Pools Spark Pools
- Data Warehousing principles and Azure Data Lake Storage (ADLS Gen2)
- CI/CD tools (Azure DevOps) InfrastructureasCode (ARM/Terraform)
- Additional Technical Skills:
- Java (API integration and microservices)
- Kubernetes for containerization
- API development and integration
- Agile Experience:
- Scrum/Kanban methodologies
- Leadership and mentoring in an Agile setup
Employment Type
Full Time
