Applied Scientist II, Alexa International Team

Key job responsibilities

• Analyze, understand, and model customer behavior and the customer experience based on large-scale data.
• Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants.
• Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF.
• Set up experimentation frameworks for agile model analysis and A/B testing.
• Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies.
• Contribute to end-to-end delivery of solutions from research to production, including reusable science components.
• Communicate solutions clearly to partners and stakeholders.
• Contribute to the scientific community through publications and community engagement.

Basic Qualifications

• PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
• Experience in patents or publications at top-tier peer-reviewed conferences or journals
• Experience programming in Java, C++, Python or related language
• Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

Preferred Qualifications

• Experience in professional software development
• PhD