Research Scientist - Multi-modal LLMs
Research Scientist - Multi-modal LLMs
Posted on :
10-02-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Title: Research Scientist Multimodal LLMs
Job Location: London UK
Job Location Type: Hybrid
Job Contract Type: Fulltime
Job Seniority Level: Entry level
About Us
At Encord we're building the AI infrastructure of the future. One of the biggest challenges AI companies face today is data quality. The success of any AI application relies heavily on the quality of its training data yet for most teams this crucial step is both the most costly and timeconsuming. We’re here to change that.As former computer scientists physicists and quants we’ve experienced firsthand how a lack of tools to prepare quality training data impedes progress in building AI. We believe AI is at a stage similar to the early days of computing or the internet—where the potential is clear but the surrounding tools and processes are still catching up. That's why we started Encord.
We are a talented and ambitious team of 60 working at the cutting edge of computer vision and deep learning. Backed by $30M in Series B funding from top investors like CRV and Y Combinator we’re one of the fastestgrowing companies in our space. Our platform is consistently rated the best by our customers and we have big plans ahead. We’re looking for a Research Scientist to help our customers get the right data faster easier and cheaper.
The Role
As a Research Scientist focusing on multimodal LLMs you'll be allowing all the data metadata and embeddings that live in our system to be explored used and analyzed in ways no one thought possible. Although starting narrow with “smaller” multimodal problems like e.g. improving similarity searches via metadata we have high ambitions for this role. You'll progressively work on harder problems that will improve user experience surface the right (personalized) analytics to every customer and put our users in the driver's seat of a data development platform that can do things much beyond today’s standards. Tasks can be i) finetuning models to understand how our platform is used by customers ii) employing LLM reasoning to assist customers in their data analysis tasks and iii) Building tools for customers to interface naturally with our platform. All to put the power in the hands of anyone using Encord.
Role
You'll follow the latest research and accelerate stateoftheart technologies to enrich customers’ data journeys. This role offers a great growth opportunity with the potential to lead a bigger team of scientists over time in our efforts to build the ultimate data development platformWhat you will be doing:
At Encord you’ll have the unique opportunity to be part of a fastgrowing startup with a clear mission and vision. You’ll work on realworld AI use cases across a variety of industry verticals and get handson experience with cuttingedge computer vision and deep learning technologies. This is a role where you'll grow quickly take ownership of projects and help shape the future of our company.
At Encord we're building the AI infrastructure of the future. One of the biggest challenges AI companies face today is data quality. The success of any AI application relies heavily on the quality of its training data yet for most teams this crucial step is both the most costly and timeconsuming. We’re here to change that.As former computer scientists physicists and quants we’ve experienced firsthand how a lack of tools to prepare quality training data impedes progress in building AI. We believe AI is at a stage similar to the early days of computing or the internet—where the potential is clear but the surrounding tools and processes are still catching up. That's why we started Encord.
We are a talented and ambitious team of 60 working at the cutting edge of computer vision and deep learning. Backed by $30M in Series B funding from top investors like CRV and Y Combinator we’re one of the fastestgrowing companies in our space. Our platform is consistently rated the best by our customers and we have big plans ahead. We’re looking for a Research Scientist to help our customers get the right data faster easier and cheaper.
The Role
As a Research Scientist focusing on multimodal LLMs you'll be allowing all the data metadata and embeddings that live in our system to be explored used and analyzed in ways no one thought possible. Although starting narrow with “smaller” multimodal problems like e.g. improving similarity searches via metadata we have high ambitions for this role. You'll progressively work on harder problems that will improve user experience surface the right (personalized) analytics to every customer and put our users in the driver's seat of a data development platform that can do things much beyond today’s standards. Tasks can be i) finetuning models to understand how our platform is used by customers ii) employing LLM reasoning to assist customers in their data analysis tasks and iii) Building tools for customers to interface naturally with our platform. All to put the power in the hands of anyone using Encord.
Role
You'll follow the latest research and accelerate stateoftheart technologies to enrich customers’ data journeys. This role offers a great growth opportunity with the potential to lead a bigger team of scientists over time in our efforts to build the ultimate data development platformWhat you will be doing:
- Building finetuning and experimenting with multimodal LLMs to surface potential actions and analytical conclusions in a datadriven manner.
- Developing scalable and novel ways to personalize LLMs based on information from our data development platform.
- Build sophisticated RAG systems on other types of data than the usual text documents.
- Follow the latest machine learning research to identify and apply new methods that improve our processes or the user experience.
- Ensure our customers have the world’s most powerful AIpowered data development platform.
- A PhD or similarly strong academic background in machine learning with 2 years of handson experience in with LLM finetuning RAG systems and prompt engineering.
- Proficiency with frameworks like PyTorch Tensorflow JAX Pandas and OpenCV.
- A solid understanding of transformer models and their common variants loss functions and pitfalls.
- A quick learner with a structured organized approach to problemsolving.
- Excellent communication skills with an ability to uncover use cases and solve problems efficiently.
- Ambitious and selfmotivated with a proven track record of top performance in academic or professional settings.
- Experience working with data in the order of millions.
- Familiarity with using (and adapting) models like LLaMa and LLaVa.
- Experience with imagetotext embedding models like CLIP and SigLIP.
- Familiarity with cloudbased model training and inference.
At Encord you’ll have the unique opportunity to be part of a fastgrowing startup with a clear mission and vision. You’ll work on realworld AI use cases across a variety of industry verticals and get handson experience with cuttingedge computer vision and deep learning technologies. This is a role where you'll grow quickly take ownership of projects and help shape the future of our company.
/jobs/view/fbac2664781ab3fca0f218ba
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
