AI Engineer, Sr. (Remote Eligible)

About the Company

Capital One is a leading financial services company dedicated to transforming banking through innovative technology and responsible AI systems. With a strong reputation for leveraging machine learning and data analytics, Capital One has established itself as an industry pioneer in delivering personalized, real-time customer experiences. The company's commitment to technological excellence is reflected in its substantial investments in infrastructure and talent, enabling it to stay at the forefront of AI-driven financial solutions. Capital One's mission is to reimagine banking by harnessing emerging AI capabilities to serve customers and businesses more effectively, fostering trust, simplicity, and security in every interaction.

About the Role

We are seeking a highly skilled and experienced Senior Distinguished Engineer specializing in AI Compute. This remote-eligible position offers an exciting opportunity to lead the development and scaling of foundational compute capabilities within our cloud-based enterprise AI and machine learning platform. As a key technical leader, you will architect and implement high-performance, highly available, and secure distributed systems that support a wide array of AI workloads, including large language model training, inference, and generative AI applications. Your expertise will directly influence the platform's ability to facilitate complex AI and ML tasks, from model training to deployment, across diverse environments. You will collaborate with cross-functional teams, mentor internal talent, and contribute to the strategic direction of our AI infrastructure, ensuring that Capital One remains a leader in responsible AI innovation.

Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or
• Master's degree in relevant fields plus at least 8 years of experience in AI/ML development
• Minimum of 10 years programming experience with Python, Go, Scala, or Java
• Proven experience in building large-scale distributed systems and infrastructure
• Strong understanding of cloud computing platforms and container orchestration (e.g., Kubernetes)
• Experience with high-performance computing frameworks such as Spark, Dask, Ray, or Flink
• Knowledge of ML+AI workload patterns, model training, inference, and feature pipelines
• Excellent leadership, communication, and collaboration skills

Responsibilities

• Design and develop control and data plane implementations to realize a secure, multi-tenant, large-scale AI platform
• Develop and optimize distributed compute engines using Ray and Spark to support diverse workloads, including LLM pre-training, reinforcement learning, and data processing
• Implement systemic improvements for operational excellence, including automation of routine workflows
• Lead technical execution across multiple projects, collaborating with teams working on microservices, foundation models, and AI infrastructure
• Work closely with product management, stakeholders, and partners to align technical solutions with business objectives
• Stay current with emerging AI and distributed systems technologies, experimenting and contributing to internal and external tech communities
• Lead system design reviews, code reviews, and mentorship initiatives to elevate team capabilities
• Mentor internal talent and actively participate in recruiting efforts to strengthen the engineering team

Benefits

• Competitive salary packages with performance-based incentives
• Comprehensive health, dental, and vision insurance
• Retirement savings plans and financial wellness programs
• Flexible work arrangements, including remote work eligibility
• Generous paid time off and holidays
• Opportunities for professional development and continuous learning
• Inclusive and diverse work environment fostering innovation and growth