Software Engineer - Evaluation

Founded in 2016 in Silicon Valley, Pony.ai is a global leader in autonomous mobility, pioneering autonomous mobility technologies and services worldwide. Operating Robotaxi, Robotruck, and Personally Owned Vehicles (POV) business units, Pony.ai is committed to developing the safest autonomous driving capabilities on a global scale. Recognized as #10 on CNBC’s 2022 Disruptor list and #12 on the 2023 XPRIZE/Bessemer Venture Partners "XB100," Pony.ai has accumulated nearly 21 million miles of autonomous driving globally and went public on NASDAQ in November 2024.

Responsibilities

• Design and implement algorithms and evaluation metrics to drive core AI decision-making
• Build scalable data pipelines and toolchains for large-scale data ingestion, batch processing, and evaluation
• Design system-level evaluation metrics, testing frameworks, and simulation environments across business components
• Design and implement high-performance backend services and distributed architectures capable of handling large-scale real-time event processing
• Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations
• Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs

Requirements

• Strong programming skills in C/C++, Python, and software design
• Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis
• Solid engineering discipline or demonstrated interest and potential in building large-scale systems, with the ability to maximize performance while minimizing complexity and cost
• BS/MS or Ph.D in Computer Science or a related field

Benefits

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (Traditional and Roth 401k)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Free Food & Snacks

Pay

Base Salary Range: $120,000 - $200,000 Annually. Compensation may vary outside of this range depending on qualifications, skills, experience, and location. This role may also be eligible for bonuses, incentives, and restricted stock units.