Staff MLResearch Engineer, Reinforcement Learning – Apple Cloud AI
Seattle, WA - USA
Job Summary
The Apple Cloud AI Platform team works with Apples researchers and ML engineers to improve and ship models at Apples bar for quality and this role you will bring deep hands-on experience in large-scale reinforcement learning to Apples most important post-training efforts. You will develop RL recipes for reasoning tool use and agentic behavior. You will apply techniques such as RLHF RLVR (reinforcement learning with verifiable rewards) preference optimization (DPO) and policy-gradient methods (PPO GRPO). You will diagnose reward hacking policy collapse and unstable optimization and choose the algorithm reward design and parallelism settings that let policies improve reliably at scale on GPUs and TPUs. As a Staff ML/Research Engineer you will set the technical direction for how Apple applies RL to its models and lead efforts that span multiple teams.
Work with researchers and ML engineers to develop cutting-edge RL methods and turn their needs into platform features and performance improvements that every team can RL algorithms and recipes such as PPO GRPO and DPO variants that improve reasoning instruction following and agentic reward modeling and evaluation approaches including learned reward models verifiable rewards and LLM-as-judge pipelines and defend them against reward into RL behavior at scale such as reward collapse KL divergence drift entropy loss off-policy mismatch and drops in throughput and track each problem down to its root cause in the data the reward the algorithm the code or the and own scalable efficient RL frameworks and services on GPUs and TPUs built on PyTorch or JAX and on higher-level reinforcement learning infrastructure for post-training including high-throughput rollout and inference services asynchronous actor-learner pipelines reward pipelines and secure sandboxes where models can run code and use RL to long-horizon multi-turn multimodal and mixture-of-experts settings and solve the stability and efficiency problems each one the RL platform with Apples data and governance stack so that every run meets privacy and security technical direction across teams mentor engineers and raise the engineering bar.
8 years of experience in large-scale machine learning including reinforcement learning from research to production.n5 years of experience building and operating large-scale RL or post-training systems in with RL and alignment techniques such as RLHF RLVR PPO GRPO and DPO as well as supervised fine-tuning as a starting point for -on experience with at least one higher-level RL or post-training framework such as VeRL OpenRLHF TRL NeMo-RL AXLearn or expertise in PyTorch or JAX including distributed computing programming skills in Python or collaboration and written and verbal communication skills with a track record of leading technical work across MS or PhD degree in Computer Science Computer Engineering or equivalent practical experience.
Experience in the below is preferred:nExperience designing reward functions reward models and verifiers for reasoning coding and tool-use with agentic RL including multi-turn environments tool use and sandboxed code with high-throughput inference engines for rollouts such as vLLM or SGLang and with weight synchronization between learner and scaling RL with data tensor pipeline or expert parallelism across hundreds to thousands of GPUs or understanding of GPU and TPU architecture including memory hierarchy matrix units and high-bandwidth memory and how they shape RL with collective communication libraries such as NCCL and with high-speed interconnects such as NVLink InfiniBand and TPU profiling and optimizing RL workloads with tools such as Nsight Systems PyTorch Profiler or source contributions to RL or post-training frameworks or publications at top ML venues such as NeurIPS ICML or
Required Experience:
Staff IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more