Engineering Program Manager, Siri Evaluation
Cupertino, CA - USA
Job Summary
You will drive evaluation programs end to end from requirements and system architecture through timelines milestones and risk management. Partnering with Engineering Quality Engineering Design and Product teams you will define the evaluation roadmap align evaluation needs across Siri features and scale pipelines to keep pace with model and product will make sure evaluation results are reproducible trustworthy and actionable so teams can assess model quality and release readiness with confidence. You will identify gaps in coverage throughput and turnaround time and lead the work to close communication is essential. You will provide timely objective updates on program status risks critical issues and mitigations plan changes and requests for action. You will also bring teams together so the right discussions happen and the right decisions get made.
5 years of program or project management experience in software development machine learning or a related in Computer Science Engineering or a related understanding of system architecture and design trade-offs with thorough knowledge of testing build and release processes for complex driving and delivering critical project features that involve integration with multiple different with ML development workflows including model evaluation quality metrics and data track record of leading and shipping multiple complex cross-functional projects at the same to navigate ambiguity identify the most critical/urgent work set priorities and defend written and verbal communication including concise status reports and issue and facilitative in meetings demonstrating the ability to reshape messaging for each audience including at the executive working cross-functionally with people at all levels of seniority u0026 leadership.
Experience working with voice assistant with evaluation of large language models (LLMs) or agentic AI systems such as benchmarks human grading or automated scaling evaluation or testing infrastructure including distributed pipelines compute planning or tooling adoption.
Required Experience:
IC
About Company
Ask Siri to name the most successful company in the world and it might respond: Apple. And it's not just out of familial pride. Apple consistently ranks highly in profit, revenue, market capitalization, and consumer cachet. In 2018, the company became the first reach a trillion dollar ... View more