Software Development Engineer, AGI - Web information retrieval

Description

Amazon AGI is pioneering the next frontier of artificial general intelligence, leveraging over 25 years of AI and machine learning expertise along with Amazon's world-class infrastructure and commitment to responsible AI. Join our diverse team of scientists, engineers, and researchers to push the boundaries of what's possible - from reinventing commerce and enterprise productivity to advancing universal agents and robotics. We are looking for a Software Development Engineer within AGI to develop a multi-modal, multi-lingual web-scale information retrieval system to make the world’s information accessible to AI models and customers everywhere.

Key job responsibilities

• Build high-throughput, cost-effective data pipelines to support feature extraction and indexing for our web-scale Information Retrieval (IR) system
• Develop and optimize the core algorithms in Rust and ranking models that power the search engine's ability to retrieve and rank relevant results for user queries
• Design and implement efficient data structures and indexing techniques to store and retrieve massive amounts of web data and content using Rust programming language
• Optimize the performance, scalability, and reliability of the search engine's core components, including query parsing, retrieval, ranking, and result rendering
• Collaborate with machine learning teams to integrate and deploy advanced machine learning models for query understanding, ranking, and personalization
• Develop and maintain the control plane systems that manage and orchestrate the IR system infrastructure, including the distributed compute clusters, storage systems, and networking components
• Design and implement real-time updates and freshness mechanisms to ensure the I engine reflects the latest web content and user behavior
• Develop efficient, state-of-the-art streaming algorithms for processing large datasets (e.g. deduplication, topic clustering)

Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 1+ years of software development engineer or related occupational experience
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl
• 1+ years of Object Oriented Design experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Preferred Qualifications

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Proficiency in Rust
• Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.