Software Engineer III - Applied AI

About the role

This role is part of Enterprise Technology (ET), where we're developing the digital infrastructure needed to build the road to space, with an emphasis on digital capabilities required to advance Blue Origin’s mission. Enterprise Technology is the center of excellence for digital technology at Blue Origin, providing oversight and governance to align technology and business strategies.

Responsibilities

• Lead full-stack development of search, RAG (Retrieval-Augmented Generation), and agentic AI applications using Python, TypeScript/React, and Java
• Own retrieval pipeline quality: design and maintain evaluation harnesses for chunking strategies, embedding models, reranking, and end-to-end RAG response quality; drive improvements through offline and online evals
• Build and maintain LLM evaluation frameworks - including automated regression suites, human preference datasets, and task-specific benchmarks - to ensure consistent, trustworthy AI output
• Architect and deliver production-grade React frontends with deep component design, accessible UI patterns, state management (Redux, Zustand, or equivalent), and performance profiling
• Establish observability standards for AI systems: distributed tracing, structured logging, LLM-specific metrics (latency, token cost, hallucination rate, retrieval relevance), dashboards, and alerting
• Design and operate AWS-based infrastructure (ECS/EKS, Lambda, OpenSearch, S3, CloudWatch) using Infrastructure as Code (Terraform/CDK); champion DevOps practices including CI/CD, automated testing gates, and release management
• Collaborate with other engineers to integrate embedding models, vector databases, and reranking systems into production-ready pipelines
• Mentor junior engineers in engineering craft, testing discipline, and AI product quality
• Partner with product, design, and mission stakeholders to translate complex requirements into durable technical solutions
• Contribute to engineering standards, ADRs, and team knowledge bases

Requirements

• Bachelor's degree in Computer Science, Software Engineering, or a related field
• 5+ years of software engineering experience, with demonstrated ownership of production systems
• Fluent with LLMs as a development tool - spec-driven development, and building AI-first features
• Hands-on experience building and maintaining LLM/RAG pipelines (from embedding and retrieval through reranking and prompt design) and evaluation frameworks (offline evals, regression testing, relevance scoring, hallucination detection)
• Strong frontend engineering skills: React (hooks, context, custom component libraries), TypeScript, state management, accessibility, and performance optimization
• Solid backend development in Python and/or Java; REST and GraphQL API design
• Experience with observability tooling: structured logging, distributed tracing (OpenTelemetry, X-Ray, or equivalent), metrics dashboards (CloudWatch, Datadog, Grafana), and alerting
• AWS cloud experience: ECS/EKS, Lambda, S3, OpenSearch, CloudWatch, IAM
• Familiarity with Infrastructure as Code (Terraform, CDK, or CloudFormation)
• Strong CI/CD practices: automated test gates, deployment pipelines, rollback strategies
• Excellent communication and cross-functional collaboration skills; ability to represent engineering decisions to non-technical stakeholders

Qualifications

• Experience with enterprise search platforms (Sinequa, Elasticsearch, OpenSearch)
• Knowledge graph or graph database experience (Neo4j, Amazon Neptune)
• AWS certification (Solutions Architect, Developer, or Machine Learning Specialty)
• Experience with agentic AI frameworks (LangChain, LlamaIndex, AutoGen, CrewAI)
• Background in AI system reliability engineering
• Familiarity with data visualization (D3.js, Plotly, Recharts) or 3D rendering (Three.js)
• Experience in aerospace, defense, or manufacturing industries

Skills

• Python
• TypeScript/React
• Java
• Frontend engineering (React, TypeScript, Redux, Zustand)
• Backend development (Python, Java)
• Observability tooling (structured logging, distributed tracing, metrics dashboards)
• AWS cloud services (ECS/EKS, Lambda, S3, OpenSearch, CloudWatch)
• CI/CD practices (automated test gates, deployment pipelines)
• LLMs (spec-driven development, building AI-first features)
• Knowledge graph or graph database technologies (Neo4j, Amazon Neptune)
• Agentic AI frameworks (LangChain, LlamaIndex, AutoGen, CrewAI)

Benefits

• Medical, dental, vision, basic and supplemental life insurance
• Paid parental leave
• Short and long-term disability
• 401(k) with a company match of up to 5%
• Education Support Program
• Stock Options for all regular employees (working at least 20 hours/week)
• Paid Time Off: Up to four (4) weeks per year based on weekly scheduled hours, and up to 14 company-paid holidays

Pay

For WA applicants is $164,652.00 - $230,512.80

Schedule

Not specified