Software Engineer, Evaluation Platform (Full Stack, UI)

Siri Agentic Evaluation Platform. Evaluation is no longer just a static test suiteit is a highly dynamic massive-scale distributed problem. Our platform enables teams to run high-throughput agentic simulations orchestrate multi-model judging pipelines and generate real-time observability dashboards across billions of tokens and complex data types.n

We are looking for a Full-Stack Software Engineer to own the user-facing UI of our evaluation platform. Teams across Siri and Apple Intelligence use our web console to create run browse and compare evaluation jobs at scale. You will set the front-ends engineering standards and help drive the service APIs and data queries behind agent flows the UI and other clients working with the services and data hardest problems here are data-dense. Scenario browsing job comparison and cost reporting are limited by how evaluation data is stored and queried not by the UI layer. You will help shape the query and aggregation side with the data backend then build the interface on top. You will partner with the pipeline device evaluator and CLI teams rather than work inside their internals.n

Own the evaluation console front-end (TypeScript/React): architecture code review and patterns. Set the standards for consistency across data-dense interfaces for scenario browsing job comparison and cost reporting including tables filtering comparison views and charting at drive the service APIs and data queries behind agent flows the UI and other clients (CLI automation). Partner with the services and data teams on endpoint design query and aggregation shapes and the OpenAPI spec that generated clients build from. Contribute Python changes where needed and advocate for user-facing workflow needs on the shared with product and modeling DRIs on UX and workflows so evaluation builders and users can platform debt paydown: major framework upgrades and consolidating parallel old/new redesigns (for example the job creation flow and the admin console). Recommend and land the retire-or-keep calls with the team.n

5 years building production web applications. Strong TypeScript and a modern framework (React).nExperience with data-heavy UIs: large tables filtering comparison and proficiency in Python with experience collaborating on typed API contracts (OpenAPI or generated clients) with backend owning or leading a codebase or major area: code review setting patterns and mentoring cross-team or MS in Computer Science or equivalent experience.

Experience with analytical or relational data backends (for example PostgreSQL and query or aggregation design). You should be able to reason about why a view is slow and fix it at the query building internal developer platforms or analytics leading framework upgrades and migrations in a live with ML/LLM evaluation workflows such as judging traces and cost or token metering.