Job Type: FullTime
Work Arrangement: Hybrid
- Onboarding: 1 month in the office
- After Onboarding: 50% office visits per month
Urgency: Super Urgent - Location: Gurgaon
Job Description:
We are looking for a highly skilled Middle DevMLData Engineer to join our dynamic team. This role is ideal for someone with strong expertise in working with big data and handson experience in managing and deploying machine learning models in realtime environments. If you are passionate about building robust data pipelines have strong experience with ML lifecycles and enjoy working in fastpaced environments this role is for you!
Key Responsibilities:
- Design implement and manage realtime data streaming pipelines using Spark and Spark Streaming.
- Build and maintain CI/CD pipelines for deploying ML models in live frameworks.
- Collaborate with data scientists and software engineers to ensure smooth deployment of ML models.
- Work with Kubernetes and Docker to manage containerized ML applications.
- Ensure high availability and scalability of data infrastructure.
- Be available for 24/7 oncall support to troubleshoot and resolve critical issues.
- Handle and process large volumes of data ensuring efficient data workflows.
- Implement and optimize the full ML lifecycle from data ingestion to model monitoring.
MustHave Skills:
- Proficiency with Spark and Spark Streaming.
- Indepth knowledge of the ML lifecycle and experience deploying models in production environments.
- Experience with CI/CD pipelines for machine learning.
- Handson experience with Kubernetes and Docker for container orchestration and deployment.
- Strong experience with Python and working with realtime streaming pipelines.
- Expertise in working with big data and processing largescale datasets.
NicetoHave Skills:
- Experience with Scala.
- Experience with managing large distributed systems and infrastructure.
OnCall Requirement:
- Must be available for 24/7 oncall support to manage and resolve production issues as they arise.
Qualifications:
- Proven handson experience in big data environments.
- 3 years of relevant experience in machine learning data engineering and realtime data processing.
- Ability to work in highpressure environments with tight deadlines.
Compensation: Competitive based on experience.
Location India Gurgaon first preference;
Office visit yes during the onboarding 1 month in the office later 50% per month
Urgency super urgent
Must stack Spark spark streaming ML lifecycle CI/CD ML models in life frameworks Kubernetes docker phyton streaming pipeline realtime experience
Nice to have stack scala
on call 24/7
Need to have hands on experience with a big amount of data
Max rate 20$
Remote Work :
No