Senior Backend Software Engineer Python and LLM
Senior Backend Software Engineer Python and LLM
Posted on :
04-02-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
This is a remote position.
We are seeking a Senior Backend Software Engineer (Python and LLM) to join our team. O ur tasks will include designing and implementing Pythonbased services that leverage Large Language Models to enhance our core healthcare platform. Working closely with our distributed engineering and product teams.
Responsibilities:
- Architect and build scalable microservices that power our LLMenabled features.
- Collaborate with other Software ML and Infrastructure engineers to optimize LLM integration and deployment.
- Design and implement LLM orchestration services including prompt management model switching and response streaming.
- Build robust evaluation pipelines to measure and improve LLM output quality and consistency.
- Develop scalable APIs for LLMpowered features including context injection and retrieval augmentation.
- Implement efficient caching and optimization strategies for LLM inference.
- Create monitoring systems for tracking token usage latency and other LLMspecific metrics.
- Work on prompt engineering and chainofthought implementations.
- Ensure compliance with healthcare regulations while working with LLM outputs.
- Participate in technical design discussions and code reviews.
- Monitor and maintain services in production including LLM Observability using tools like LangFuse.
Requirements
- Strong proficiency in Python and experience building productiongrade backend services.
- Understanding of prompt engineering principles and LLM evaluation metrics.
- Experience with vector databases (like Pinecone Weaviate or similar) for semantic search.
- Familiarity with streaming architectures for realtime LLM responses.
- Experience implementing rate limiting and failover strategies for API services.
- Strong grasp of software engineering best practices including testing documentation and version control.
- Excellent problemsolving skills and attention to detail.
- Strong written and verbal communication skills.
Youd Be a Great Fit If You Have:
- Experience finetuning or implementing RAG (Retrieval Augmented Generation) systems.
- Experience with LLM frameworks such as LangGraph LangChain LlamaIndex or similar orchestration tools.
- Familiarity with different LLM providers (OpenAI Anthropic etc.) and their APIs.
- Familiarity with the use of Open LLMs either selfhosted or on through a third party provider e.g. Amazon Bedrock.
- Knowledge of LLM output validation and safety measures.
- Experience with embeddings and semantic search implementations.
- Background in prompt engineering or LLM evaluation metrics.
- DevOps experience particularly with containerised service deployment GPUenabled compute environments and scaling.
- Knowledge of healthcare data privacy regulations and security best practices.
- Experience working in distributed teams across multiple time zones.
Benefits
- Work Location: Remote
- 5 days working
Strong proficiency in Python and experience building production-grade backend services. Understanding of prompt engineering principles and LLM evaluation metrics. Experience with vector databases (like Pinecone, Weaviate, or similar) for semantic search. Familiarity with streaming architectures for real-time LLM responses. Experience implementing rate limiting and failover strategies for API services. Strong grasp of software engineering best practices, including testing, documentation, and version control. Excellent problem-solving skills and attention to detail. Strong written and verbal communication skills. You'd Be a Great Fit If You Have: Experience fine-tuning or implementing RAG (Retrieval Augmented Generation) systems. Experience with LLM frameworks such as LangGraph, LangChain, LlamaIndex, or similar orchestration tools. Familiarity with different LLM providers (OpenAI, Anthropic, etc.) and their APIs. Familiarity with the use of Open LLMs, either self-hosted or on through a third party provider, e.g. Amazon Bedrock. Knowledge of LLM output validation and safety measures. Experience with embeddings and semantic search implementations. Background in prompt engineering or LLM evaluation metrics. DevOps experience, particularly with containerised service deployment, GPU-enabled compute environments and scaling. Knowledge of healthcare data privacy regulations and security best practices. Experience working in distributed teams across multiple time zones.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
