Sr API developer
Sr API developer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
Job Description
Senior API developer LLM Applications
Chicago IL (Hybrid Onsite)
Requirements:
Design and Development of APIs:
Create robust scalable APIs to interface with large language models (LLMs).
Develop endpoints for sending and receiving data from the LLM ensuring that requests (e.g. text prompts) and responses are efficiently processed and communicated between the front end and back end.
2. Request and Response Handling:
Implement systems that properly structure user inputs (e.g. transforming data into LLMreadable formats) and format the model outputs to meet application needs.
Design logic to handle various types of responses including error handling fallback mechanisms and retries.
3. Middleware and Pre/PostProcessing:
Develop middleware to preprocess inputs before sending them to the LLM (e.g. tokenization language translation or contextual enhancements).
Postprocess responses to improve output readability filter inappropriate content or integrate additional functionality such as summarization or answer extraction.
4. Performance Optimization:
Focus on reducing latency in API calls to provide fast responses especially for realtime applications.
Implement strategies such as request batching caching and efficient data flow management to minimize delays and maximize throughput.
5. Security and Authentication:
Set up secure API access with authentication mechanisms such as API keys OAuth or tokenbased access.
Implement rate limiting request logging and auditing to prevent abuse and monitor usage.
6. API Versioning and Maintenance:
Manage versioning to ensure backward compatibility when updates or changes to the LLM or API occur.
Document and implement updates without disrupting existing users ensuring smooth transitions for new versions.
7. Cost and Usage Optimization:
Implement systems that minimize unnecessary API calls to control costs associated with using LLMs.
Build mechanisms to track usage set cost thresholds and develop strategies like response caching to reduce API call frequency.
9. Collaboration with Other Teams:
Work closely with machine learning engineers to ensure the LLMs API integration is seamless.
Collaborate with frontend developers to ensure that the LLMs responses fit the applications user interface and experience.
Employment Type
Full Time
