Software Development Engineer II, AWS Marketplace & Partner Services (AMPS)
About the role
The AWS Marketplace & Partner Services (AMPS) Science team seeks a Software Engineer to design and build the infrastructure and tooling behind our AI solutions, including LLM training pipelines, custom LLM model hosting, and AI agent monitoring and evaluation infrastructure. This role will be instrumental in transforming how AMPS customers and partners interact with our AI-powered products, including AMPS AI agents.
Responsibilities
Design, develop, and maintain scalable infrastructure for large language model training pipelines, model hosting, and agent-based systems, employing best engineering practices and iterating from simple to complex solutions.
Build and operate monitoring, evaluation, and observability frameworks to measure AI agent performance, reliability, and effectiveness in production.
Develop reusable tooling, APIs, and automation that accelerate the team's ability to experiment, deploy, and iterate on ML/AI solutions.
Contribute to a fast-paced, experimental environment by rapidly prototyping and operationalizing infrastructure that leverages the most recent advances in ML/AI.
Collaborate with cross-functional teams—including Data Scientists, Applied Scientists, Data Engineers, Software Engineers, Product Managers, and Science and Engineering leaders—to translate scientific innovations into robust, production systems.
Participate in research initiatives alongside scientists and engineers—contributing to experiments, prototyping, and co-authoring internal and external publications that advance the team's technical knowledge and industry presence.
Requirements
Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
Experience programming with at least one software programming language.
3+ years of non-internship professional software development experience.
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
2+ years of experience working with cloud services (e.g., AWS, Azure, GCP).
Preferred Qualifications
Master's degree in computer science or equivalent.
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
Knowledge of machine learning methodologies and experience with agentic AI systems, and related frameworks and SDKs (e.g., LangChain, LangGraph, Amazon Bedrock Agents, Claude), with hands-on experience building, deploying, and maintaining infrastructure for AI-powered systems in production environments.
Experience with building infrastructure for LLM fine-tuning pipelines and model hosting services—including training orchestration, model versioning, deployment automation, and cost-efficient serving at scale.