Title: Senior ML Operations(MLoPS) Engineers
Location: San Francisco Bay Area
Length: 2 years
Job Description:
We are seeking three knowledgeable Senior ML Operations Engineers with advanced Python and Flask Large Language Models Open API engineering Containerization and Swagger expertise for a multiyear engagement to work with a foremost Healthcare IT Solutions Group in their Innovations Project Team.
Prerequisites for the selection of the Consultants encompass:
- Advanced Python programming for backend development for Machine Learning Operations.
- Expertise with OpenAPI specs.
- Conversant with LLMs specifically Llama 2 or Mistral.
- Familiarity with Prompt Engineering.
- Required to productionize Large Language Model (LLM) based solutions.
- Capable of taking an opensource Large Language Model (LLM) and fine tuning it to reflect custom data and retrieve data from a Vector database.
- Will be required to design a RESTful API that interfaces with a Large Language Model (LLM) and can be used for user consumption.
- Write Helm charts and the web front end.
- Must be skilled in modularizing machine learning code.
- Will transform Data Scientists models into scalable maintainable systems.
- Integrate the APIs with MongoDB (Reddis Vector databases embedding models).
- Should have expertise in deploying and managing containerized applications using Kubernetes.
- Ability to take an opensource hugging face model and productionalize it so that user can use it on custom data.
- Plan the builds with Swagger CodeGen Editor and Inspector.
- Experience with Jupyter notebooks Flask FastAPI and on premises Docker and Kubernetes.
- Angular and Node are also utilized in this environment.
- Document plan and steps for development.