Sr Engineering Program Manager, Apple Intelligence Evaluations
Cupertino, CA - USA
Job Summary
Were looking for a Sr Engineering Program Manager with a proven track record of leading highly cross-functional Software and ML this role youll own the evaluation plans for Apples foundation models or the AI features built on them partnering with world-class teams across Research Engineering Privacy and Data Science. Youll thrive in a fast-moving environment and your work will ensure that products reaching over 1 billion customers meet the quality bar Apple users expect and love. If youre excited by a new technology space and by delivering phenomenal products with a great team we want to hear from you.
Own the evaluation plan for foundation models or AI features including scope metrics timelines and launch-readiness criterianPartner with product research data science and engineering teams to define evaluation requirements methodologies and toolingnDrive multiple complex workstreams at once with clear dependencies and critical path. Manage risks resolve conflicts and keep stakeholders aligned nManage annotation and data collection operations to deliver high-quality evaluation data on schedulenPartner with engineering privacy and legal teams to ensure our data strategy is not only world-class but also aligns with Apples core valuesnSynthesize technical complexity into clear actionable communications for executive leadership
Bachelors or Masters degree in EE CS CE or equivalentn5 years of experience managing large-scale ML-powered and software programs across large organizationsnProven program management analytical and cross-functional leadership skills with experience driving data-driven decision-making and process improvements nExcellent written and verbal communication skills including presentation negotiation and the ability to communicate abstract ideas clearlynStrong problem-solving skills with attention to details
Direct program management experience with Generative AI or Large Language Models (LLMs) is highly desirednFamiliarity with LLM evaluation practicesnExperience analyzing product data to assess quality and identify opportunities. nExperience shipping AI features in a consumer product nComfortable in a fast-paced ambiguous environment with curiosity and the ability to quickly learn new technical conceptsnSolid understanding of how ML systems are built evaluated and released
Required Experience:
Senior IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more