Deep Learning Engineer

GitHub Gcopilot is amazing for code. We are bringing this to lawyers. So in essence we're training large language models like GPT-neox to do autocompletion in Word. There is a ton of data available for training, and we have enough funding for a large number of A100 GPUs.

This work began as a research project at ETH in Z rich. We have advisors from AI research, law and legal tech.

Why Lawyers?

Lawyers write a lot of text. Much of that is copy-pasting or piecing together arguments from past cases. They spend a lot of time researching and reformulating details, that somebody else has already figured out.

Github copilot was a huge breakthrough for programmers, we want to achieve the same for lawyers.

Tasks

• Training and evaluation of large language models
• Transferring methods from AI research,
• Improve training and inference efficiency
• Data engineering.

We'll start with 20B open-source GPT neox, but will go back and forth between much smaller models for validation. You'll be part of the 4 person team building pipelines for training and inference. We are going to have technical mentors with experience in large-scale models to help out.

Requirements

Apply if

• Strong coding background
• Strong know-how in training and optimizing deep learning models

A plus but not necessary

• Strong AI research background

Benefits

• Early team members can get up 50k worth of equity (VSOPs).
• Part of a small team that works closely together
• chance to stay up to date with AI research
• perks like: a badass office in Berlin Mitte, free fruit, great coffee

This task is huge. You have to be ambitious to want to take it on. But you won't be alone.

We care about the people in our small team being ambitious and fun to hang out with.

To get a glimpse of our worldview, here are some speculations about things that we think will happen in the next 2 years:

• The first real Google search competitor, with which most queries are replaced by generated answers.
• Autocomplete features will come to GUIs. E.g. a chrome extension that highlights where you should click next, and prefills input fields.

Near human-level AI is on the way. We want to position ourselves to have lots of users and data before that happens.