Software Engineering Manager - Siri Evaluation, Developer Workflows

AppleApplyPublished 1 days agoFirst seen 1 months ago
Apply

Summary

Siri's evaluation signal drives every model and product decision before a release ships. The Developer Workflows team, part of Siri's Agentic Evaluation Engineering organization, builds and maintains the next generation of developer workflows that Apple's internal teams rely on to evaluate what they build. We are looking for a hands-on engineering leader to run this team in New York and set its technical direction.

Description

Evaluation at Apple's scale is an engineering problem, not a reporting problem. Our internal customers need to know whether a change worked while they can still act on it. This team builds the systems that make that possible, driving the development of the tooling, services, and automation that enable a developer to go from a question about quality to a verified fix.

This is a hands-on leadership role. You will lead a small, senior team and remain deeply in the code and architecture.

Responsibilities

  • Lead, grow, and set technical direction for a team building developer-facing evaluation tooling, services, and automation.
  • Remain hands-on: own architecture, write and review code, and build critical components yourself.
  • Own your systems and solutions end to end -- design, delivery, reliability, and the operational health our internal customers depend on.
  • Design durable services and data models that other teams build on.
  • Apply LLMs and agentic automation to real engineering workflows, keeping human review where judgment belongs to a person.
  • Establish measurement that distinguishes real improvement from noise, and hold quality bars that survive contact with customers.
  • Turn working systems into adopted platforms, so teams can onboard themselves without your team in the loop.
  • Partner across the evaluation organization and with engineering, quality, and design stakeholders to articulate and build roadmaps and critical solutions.
  • Recruit, mentor, and develop engineers including senior ICs, with a focus on engineering rigor and clear ownership.

Minimum Qualifications

  • 8+ years of experience building production software (e.g., Python, Swift, Go, or Java), with recent hands-on delivery.
  • 2+ years leading engineers, as an engineering manager or as a tech lead responsible for a team's technical direction and delivery.
  • Demonstrably hands-on today: you set architecture, write design documents, review code, and build.
  • Practical experience applying LLMs or AI agents to real engineering workflows.
  • Experience with developer tooling, test infrastructure, CI/CD, or evaluation and ML platforms.

Preferred Qualifications

  • Depth in agentic systems with human-in-the-loop review, and the reliability, cost, and trust problems they raise in production.
  • Experience designing and operating distributed backend services and APIs in production.
  • Cloud infrastructure and container orchestration, data platforms, or large-scale test and release infrastructure.
  • Familiarity with Apple's development and testing toolchain, and with device automation.
  • A track record of driving internal adoption of a platform.
  • Demonstrated cross-functional leadership and the ability to drive quality decisions with senior stakeholders.
  • Experience hiring and growing a team, including senior engineers.
  • Excellent spoken and written communication skills, and comfort operating in ambiguity.