Skills
- Infrastructure as Code (IaC) Experience with IaC tools such as Terraform or Ansible for automating infrastructure provisioning.
- Containerization and Orchestration Proficiency in containerization technologies (e.g. Docker) and orchestration tools (e.g. Kubernetes) for managing LLM deployments.
- Cloud Platforms Familiarity with cloud platforms such as AWS (Bedrock) Azure or GCP and experience in deploying and managing applications in a cloud environment.
- Monitoring and Logging Tools Knowledge of monitoring tools (e.g. Prometheus Grafana) and logging systems (e.g. ELK stack) for realtime performance monitoring and analysis.
- Security Measures Understanding of security guardrails using tools like LLM Guard and familiarity of how to mask/redact / obfuscate sensitive data protect the input and output of toxic and harmful content to/from LLMs and understand the performance implications of the same.
- Scripting and Automation Proficient in scripting languages such as Python Shell or similar and experience in automating deployment and maintenance processes.
gcp,cloud platforms,ansible,shell,grafana,azure,scripting and automation,prometheus,aws,elk stack,infrastructure as code (iac),containerization,monitoring and logging tools,terraform,kubernetes,orchestration,python,llm guard,security measures,shell scripting,docker