Software Engineering Manager, Commerce Shopping Quality Journey Orchestration

About the role

The Software Engineering Manager within the Journey Orchestration and Autorater (JOAA) team will architect the Shopping Quality Flywheel. This role focuses on understanding AI quality, detecting root causes of regressions, and driving improvements through advanced response orchestration. The successful candidate will leverage LLM-based autoraters to define success, providing high-velocity, low-cost proxies for critical user metrics.

Responsibilities

• Set and communicate team priorities that support the broader organization's goals. Align strategy, processes, and decision-making across teams.
• Set clear expectations with individuals based on their level and role and aligned to the broader organization's goals. Meet regularly with individuals to discuss performance and development and provide feedback and coaching.
• Develop the mid-term technical outlook and roadmap within the scope of your (often multiple) team(s). Evolve the roadmap to meet anticipated future requirements and infrastructure needs.
• Design, guide, and vet systems designs within the scope of the broader area, and write product or system development code to solve ambiguous problems.
• Review code developed by other engineers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).

Qualifications

• Minimum qualifications:
• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 3 years of experience in a technical leadership role.
• 2 years of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
• 2 years of experience in a people management or team leadership role.
• Preferred qualifications:
• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 3 years of experience working in a complex, matrixed organization.

Pay

$207,000 - $301,000 (USD) + 20% bonus target + equity + benefits

Schedule

N/A

Benefits

N/A