GEN AI Software Engineer

Job Title: GEN AI Software Engineer

Contract Period: 9/15/2024 8/31/2025

Work location: Ridgefield Park NJ

Were seeking a skilled engineer to lead the development of cuttingedge RAG applications using stateoftheart LLM technologies. The ideal candidate will have a strong background in AI and NLP with handson experience in building and optimizing LLMbased systems. This role requires expertise in integrating LLM solutions via APIs with both thirdparty tools and inhouse applications. Experience with AWS Bedrock is highly valued and familiarity with microservices architecture in cloud environments is a significant plus.

Primary Responsibilities:

• Design and implement RAG (RetrievalAugmented Generation) systems
• Integrate and optimize Large Language Models (LLMs) via APIs
• Develop efficient information retrieval and extraction systems
• Build and manage databases and vector stores
• Apply Natural Language Processing (NLP) techniques
• Monitor performance and continuously improve systems
• Integrate LLM solutions with other thirdparty tools and inhouse applications
• Design and implement APIs for seamless integration of LLM capabilities

Requirements:

• Bachelors degree or higher in Computer Science Artificial Intelligence or related field (Masters preferred)
• Proficiency in Python programming
• Deep understanding of LLMs RAG systems and API integration
• Experience with NLP and machine learning
• Strong skills in database and API development
• Knowledge of distributed systems and cloud computing
• Expertise in integrating AI models with various software solutions

Preferred Qualifications:

• Contributions to opensource LLM projects
• Experience building AI systems in largescale production environments
• Experience with vector databases (e.g. Pinecone Faiss)
• Proficiency with relevant libraries such as Transformers Hugging Face
• Experience with AWS Bedrock for AI/ML model deployment and management
• Experience with microservices architecture (MSA) in cloud environments
• Familiarity with LLM API providers (e.g. OpenAI Anthropic Cohere)

Suggested Tech Stack:

• Language: Python
• Frameworks: PyTorch or TensorFlow FastAPI or Flask for API development
• Databases: PostgreSQL MySQL MongoDB
• Vector Stores: Pinecone Faiss
• Cloud Platforms: AWS (including Bedrock) Google Cloud or Azure
• Integration Tools: Apache Kafka RabbitMQ