AI Engineer, Sr.
About The Company
At Capital One, we are dedicated to transforming the banking industry through innovative and responsible AI systems. With a long-standing reputation as an industry leader, we leverage machine learning and advanced technology infrastructure to deliver real-time, personalized experiences for our customers. Our commitment to investing in cutting-edge technology and attracting world-class talent positions us at the forefront of enterprise AI adoption. We aim to create solutions that simplify banking, enhance security, and provide valuable insights to our customers, fostering trust and loyalty. Our culture emphasizes continuous innovation, collaboration, and a passion for leveraging emerging technologies to reimagine financial services for the digital age.
About The Role
We are seeking a highly experienced Senior Distinguished Engineer specializing in AI Compute to join our remote-eligible team. In this strategic leadership role, you will be instrumental in designing and scaling our foundational AI compute infrastructure that supports a broad spectrum of machine learning and deep learning workloads. Your expertise will drive the development of high-performance, scalable, and reliable distributed systems on CPU and GPU platforms, powering everything from developer notebooks and model training to large-scale inference and generative AI applications. You will collaborate closely with cross-functional teams, including product managers, data scientists, and engineers, to deliver innovative solutions that meet the evolving needs of our enterprise AI platform. Your leadership will also extend to mentoring internal talent, fostering a culture of technical excellence, and contributing to the broader engineering community at Capital One.
Qualifications
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 10 years of experience developing AI and ML algorithms or technologies
- Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 8 years of relevant experience
- Minimum of 10 years programming experience with Python, Go, Scala, or Java
- Deep understanding of distributed systems, cloud computing, and high-performance computing architectures
- Experience with container orchestration platforms such as Kubernetes and serverless environments like AWS Lambda
- Proficiency in developing and optimizing large-scale machine learning workloads, including LLM training, inference, and data processing pipelines
- Strong knowledge of frameworks like Spark, Dask, Ray, or Flink and their internal components
- Experience with cloud-native compute primitives, especially AWS services like EKS, EC2 UltraClusters, and Graviton processors
- Track record of contributing to open-source distributed systems projects is preferred
Responsibilities
- Architect and implement control and data plane solutions to realize a highly available, multi-tenant, and secure AI compute platform at scale
- Develop distributed compute engine solutions using Ray and Spark to accelerate diverse workloads including LLM pre-training, reinforcement learning, and large-scale data processing
- Optimize operational workflows by automating routine tasks and maintaining system reliability and performance
- Lead technical execution across multiple projects, collaborating with developers working on distributed microservices and foundation models
- Partner with product and program management teams to align technical solutions with business objectives
- Stay abreast of emerging technologies, participate in internal and external tech communities, and lead system design and code review sessions
- Contribute to the growth of the Capital One Distinguished Engineering community by mentoring talent and recruiting top external candidates
- Drive innovation in AI infrastructure to support next-generation applications, including generative AI and agentic systems
Benefits
- Competitive salary aligned with experience and location
- Performance-based incentive compensation, including bonuses and long-term incentives
- Comprehensive health, dental, and vision insurance plans
- Retirement savings options and financial wellness programs
- Paid time off and flexible work arrangements
- Access to professional development resources and continuous learning opportunities
- Inclusive and diverse workplace culture that values innovation and collaboration