Job Title: DevOps Engineer with Apache Airflow Azure
Location: Weehawken NJ
Contract Duration: 6 months with potential extensions
Pay Rate: $50/hour to $70/hour depending upon experience
Job Description:
We are seeking a highly experienced DevOps Engineer with a minimum of 10 years of overall experience in technology and 5 years of relevant experience to join our dynamic and growing team. The successful candidate will have a strong background in supporting Data Platform Databricks and handson experience with CI/CD Pipelines.
Responsibilities:
1. Build and manage the CI/CD infrastructure using Apache Airflow and Azure.
2. Work closely with the development and operations teams to design and implement endtoend solutions.
3. Support Data Platform Databricks and collaborate with data scientists and data engineers to ensure alignment and deliver on required capabilities.
4. Implement automation effective monitoring and infrastructureascode practices.
5. Participate in system design consulting platform management and capacity planning.
6. Maintain robust efficient and secure data pipelines.
Requirements:
1. Minimum 10 years of overall experience in technology with at least 5 years of relevant DevOps experience.
2. Proficiency in Apache Airflow and Azure is a must.
3. Proven experience in CI/CD pipelines and practices.
4. Strong background in supporting and managing Data Platform Databricks.
5. Expertise in implementing and maintaining data pipelines.
6. Excellent problemsolving skills attention to detail and strong organizational skills.
7. Strong communication skills both written and verbal with the ability to present complex technical information in a clear and concise manner to a variety of audiences.
Note: The position is initially for a period of 6 months and may be extended based on the performance and the requirements of the project.