LLM Deployment and Orchestration Specialist
LLM Deployment and Orchestration Specialist
Posted on :
20-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Title : LLM Ops engineer
Experience : 10 Years
Location: Hyderabad
Skills
- Infrastructure as Code (IaC) Experience with IaC tools such as Terraform or Ansible for automating infrastructure provisioning.
- Containerization and Orchestration Proficiency in containerization technologies (e.g. Docker) and orchestration tools (e.g. Kubernetes) for managing LLM deployments.
- Cloud Platforms Familiarity with cloud platforms such as AWS (Bedrock) Azure or GCP and experience in deploying and managing applications in a cloud environment.
- Monitoring and Logging Tools Knowledge of monitoring tools (e.g. Prometheus Grafana) and logging systems (e.g. ELK stack) for realtime performance monitoring and analysis.
- Security Measures Understanding of security guardrails using tools like LLM Guard and familiarity of how to mask/redact / obfuscate sensitive data protect the input and output of toxic and harmful content to/from LLMs and understand the performance implications of the same.
- Scripting and Automation Proficient in scripting languages such as Python Shell or similar and experience in automating deployment and maintenance processes.
containerization,cloud,kubernetes,automation,scripting languages,infrastructure,security,security measures,grafana,aws,gcp,scripting and automation,ansible,orchestration,shell scripting,terraform,infrastructure as code (iac),azure,monitoring and logging tools,cloud platforms
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
