LLM Ops Engineer
LLM Ops Engineer
Posted on :
21-09-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Minimum Experience: 5 Years
Job Details
Infrastructure as Code (laC) Experience with laC tools such as Terraform or Ansible for automating infrastructure provisioning. Containerization and Orchestration Proficiency in containerization technologies (e.g. Docker) and orchestration tools (e.g. Kubernetes) for managing LLM deployments.
Cloud Platforms
Familiarity with cloud platforms such as AWS (Bedrock) Azure or GCP and experience in deploying and managing applications in a cloud environment.
Monitoring and Logging Tools
Knowledge of monitoring tools (e.g. Prometheus Grafana) and logging systems (e.g. ELK stack) for realtime performance monitoring and analysis.
Security Measures
Understanding of security guardrails using tools like LLM Guard and familiarity with how to mask/redact/obfuscate sensitive data protect the input and output of toxic and harmful content to/from LLMS and understand the performance implications of the same.
Scripting and Automation
Proficient in scripting languages such as Python Shell or similar and experience in automating deployment and maintenance processes.
terraform,ansible,container orchestration,cloud applications,aws,azure,gcp,monitoring performance,python,orchestration
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
