AI Solutions Engineer - Experienced

Company Federal Reserve Bank of Richmond When you join the Federal Reserve—the nation's central bank—you’ll play a key role, collaborating with leading tech professionals to strengthen and protect our economic, financial and payments systems. We invest in contemporary and emerging technology each year to support the Federal Reserve and our economy, and we’re building a dynamic and diverse team for our future. AI Solutions Engineer - Experienced In this role you will be responsible for developing and maintaining enterprise-scale AI/ML solutions using Generative AI, Retrieval-Augmented Generation (RAG), and Agentic AI frameworks, combined with Infrastructure as Code and automation practices. You will participate in design and implement scalable, secure, and efficient AI-powered systems supporting critical business functions across the Federal Reserve System. This position requires a moderate level of experience and proficiency in AI/ML technologies, cloud infrastructure, and DevOps practices. Infrastructure Platforms & Operations: You will be joining the Infrastructure, Platforms & Operations portfolio. This business line supports the strategic direction and product delivery for System IT infrastructure and operations, as well as the alignment of technology to business strategies. The team serves as the business partner for secure and reliable IT products, services, and operations. This position does not sponsor employment visas. Candidates must be U.S. citizens or lawful permanent residents with at least three years of legal residency. Why Join Us: Lead significant AI infrastructure initiatives at a critical national institution supporting the nation's financial systemWork with cutting-edge Generative AI, RAG, and Agentic AI technologies alongside modern automation frameworksOpportunity to architect and implement enterprise-scale AI solutions with real business impactMentorship opportunities with junior engineers while continuing to grow your own technical expertiseExposure to diverse technology stacks and complex problem domains across multiple business linesCollaborative environment that values innovation, continuous improvement, and public serviceComprehensive benefits package, competitive compensation, and work-life balanceProfessional development support including training, certifications, and conference attendance What You Will Do: AI Solution Architecture & Engineering Develop conceptual, logical, and physical designs for AI/ML solutions using Terraform that support the infrastructure requirements of varying levels of technical and business application projects across AWS Cloud environmentsDesign and implement complex GenAI, RAG, and Agentic AI solutions leveraging AWS Bedrock and related AI/ML services, along with supporting compute, storage, networking, and security infrastructureArchitect RAG pipelines, vector database integrations, and multi-agent orchestration systems for production use casesComplete analysis of business requirements as they relate to AI solution design, and ensure traceability of the design to business requirementsAssess testing requirements and prepare testing strategies, as well as implementation and transition plans for AI infrastructure changesPrepare detailed specifications and documentation from which AI infrastructure will be provisioned and maintained CI/CD & Automation Design, implement, and maintain sophisticated CI/CD pipelines for automated testing, deployment, and infrastructure provisioning of AI solutions using GitLabDevelop and maintain complex automation scripts using Python or Bash to streamline model deployment, data pipelines, and manual processes to improve operational efficiencyUtilize available tools for automation of manual processes, contributing to increased team productivityFollow and ensure adherence to technical standards for AI solution design and automation techniques Problem Resolution & System Reliability Perform resolution of complex AI infrastructure and application problems affecting system operations; initiate problem avoidance actionsAnalyze and revise existing system logic, AI pipeline patterns, and documentation as necessaryRecommend solutions to minimize and/or prevent system interruption based on trend analysis and proactive system checksSupport system health and performance reviews to help ensure reliability of deployed AI solutions Application Development & Integration Develop user interfaces and internal tools using React for AI front end, monitoring solutions, and administrative applicationsBuild and maintain APIs and integration services to support AI solution automation and orchestrationDesign, code, test, debug, document, and maintain moderately complex software enhancements to support AI infrastructure and pipelines Project Leadership & Collaboration May indirectly lead moderately complex AI infrastructure projects and participate on technical/complex cross-functional projectsProvide project updates and prepare management reports as required, tailored for both technical and business audiencesWork and collaborate as part of an Agile team to develop and implement AI capabilities that enable business processes and decision-makingTrain technical staff on use of AI tools, Terraform, CI/CD pipelines, and related platforms in accordance with required standards and proceduresParticipate in design reviews, architecture discussions, and provide technical mentorship to junior engineers Governance & Compliance Perform change and problem management using standard tools, following FRIT change management policies and procedures for AI infrastructure propagation to other platforms and/or environmentsContribute to development and revision of department standards, procedures, and best practicesAssist with monitoring compliance with internal audit requirements and Information Security Manual guidelinesEnsure AI solution implementations adhere to security best practices, responsible AI principles, compliance requirements, and cost optimization strategies Knowledge And Skills: Required: Progressive experience building GenAI, RAG, and Agentic AI solutions, including prompt engineering, RAG pipeline design, and agent orchestration frameworksHands-on experience with AWS Bedrock and related AI/ML servicesStrong programming skills in Python and Bash for automation, scripting, AI/ML tooling, and API developmentAdvanced proficiency in Cloud infrastructure provisioning tools, specifically Terraform, including module development and state managementProgressive experience using core AWS services to build and support cloud solutions leveraging architecture best practices (EC2, S3, Lambda, VPC, IAM, RDS, Systems Manager)Strong proficiency in CI/CD and deployment automation using GitLab pipelinesProficiency in React for frontend development of internal tools and administrative interfacesStrong understanding of version control systems (Git), branching strategies, and collaborative development workflowsExperience with SQL and NoSQL databases, data modeling, and performance optimization Nice to Have: Experience with vector databases, embedding models, and semantic search implementationsExperience integrating advanced agentic frameworks (e.g., LangChain, LangGraph, or similar) into production systemsExpertise in containerization technologies (Docker, ECS, EKS) and container orchestrationUnderstanding of FinOps practices and cloud cost optimizationFamiliarity with security scanning tools and DevSecOps practicesExperience with disaster recovery planning and implementationGeneral familiarity with observability and monitoring practices (e.g., logging, metrics, tracing, alerting) and related tools such as CloudWatch, Grafana, or similar platforms Qualifications: 3-5 years of relevant work experience in AI/ML engineering, cloud infrastructure, DevOps, or platform engineeringMinimum bachelor's degree in computer science, Information Technology, EngineeringCertifications related to Information Technology or AI/ML strongly preferred:AWS Certified Solutions Architect - Associate or ProfessionalAWS Certified Machine Learning or AI PractitionerHashiCorp Certified: Terraform Associate or higherAWS Certified DevOps Engineer - Professional Technical Competencies: Progressive knowledge of AI/ML system architecture, cloud computing concepts, microservices, and distributed systemsStrong understanding of networking fundamentals, security principles, system design, and scalability considerations for AI workloadsAdvanced problem-solving skills with ability to debug complex technical issues across AI pipelines and multiple layers of the stackAbility to interpret and apply technical standards for programming and infrastructure design techniquesExperience with Agile methodologies, sprint planning, and iterative developmentGeneral awareness of performance measures, metrics, and system health indicators (nice to have) Professional Competencies: Strong interpersonal, negotiation, creativity, and attention to detail skillsExcellent oral and written communication skills tailored for the intended audience, including executives, business stakeholders, and technical teamsDemonstrated ability to lead technical discussions and influence architecture decisionsProven track record of delivering AI/infrastructure projects on time and within scopeStrong mentorship and knowledge-sharing abilitiesUnderstanding and application of risk management discipline in decision-making, particularly regarding responsible AI useWorks under direction with infrequent checks; makes independent decisions based on established methods and policies Additional Information: Hours: May require extended work hours for deployments, maintenance windows, or incident responseAvailability: May be subject to on-call rotation and callback as needed for production supportTravel: Occasional travel including overnight stays may be necessary for training, conferences, or cross-site collaboration The full salary range for the Engineer, Experienced job profile: $94,600- $118,200- $153,700 The candidate’s new job title and associated pay range will be determined by the employing District, and they will be subject to the employing District’s people policies and practices. As a Federal Reserve System National Business Line, it is standard practice to post System IT positions in multiple Districts to provide transparency and equitable opportunities. Internal candidate(s) selected for this position will remain employed by their current employing District and serve as an employee of System IT*. Current remote employees will not be guaranteed to keep their remote status with their employing bank. The selected candidate will reside within a reasonable commuting distance, as defined by the employing Reserve Bank, and will work full-time onsite.Eligible Locations for Hire: Boston, MA- New York, NY- Philadelphia, PA- Cleveland, OH- Richmond, VA- Atlanta, GA- Chicago, IL- St. Louis, MO- Minneapolis, MN- Kansas City, MO- Dallas, TX- San Francisco, CA OR The following Reserve Bank locations are preferred due to the concentration of System IT team members in these locations: Atlanta, Boston, Chicago, Kansas City, Minneapolis, New York, Richmond, and San Francisco. (example for limited posting locations) Screening: This position has additional screening requirements due to the information accessed while performing the job. These additional screenings would be initiated at the time of offer acceptance and could take up to a couple of months to be completed. You can begin work before the screening is completed; however, continued employment is contingent on acceptable screening results. The areas screened may include education/employment verification, criminal history, credit history, and reference checks. Our total rewards program offers benefits that are the best fit for you at every stage of your career: Comprehensive healthcare options (Medical, Dental, and Vision) 401(k) match, and a fully funded pension plan Paid time off and holidays Annual educational assistance Professional development programs, training and conferences And more… The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences. Full Time / Part Time Full time Regular / Temporary Regular Job Exempt (Yes / No) Yes Job Category Information Technology Family Group Work Shift First (United States of America) The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences. Always verify and apply to jobs on Federal Reserve System Careers (https://rb.wd5.myworkdayjobs.com/FRS) or through verified Federal Reserve Bank social media channels. Privacy Notice