Senior Staff Engineer, AI Compute (Remote Eligible)
Capital One · Cambridge, MA · 1 mo ago
Engineering$286k–$327k/yrFull-time
We need to output HTML fragment with sections: About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule. Only include sections that have real specific content. We must not repeat job title as heading. Must not include Job ID etc. Must remove boilerplate, navigation, legal, EEO, etc. Must preserve all substantive info.
We need to parse the posting.
Let's extract sections:
- Intro paragraph about Capital One AI etc. Could be "About the role" or maybe "About Capital One"? The instruction: use for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). So we need to decide which sections have content.
We have:
- Team Description: description of team and role responsibilities. That could go under "Responsibilities" or "About the role". The role description includes bullet points after "In this role, you will :". Those are responsibilities.
- Basic Qualifications: list of qualifications.
- Preferred Qualifications: list.
- Salary info: Pay.
- Benefits: mention of comprehensive benefits.
- Schedule: Not mentioned explicitly; maybe remote work? It says "Capital One is open to hiring a Remote Employee for this opportunity". That's about location/remote, not schedule. No explicit schedule (full-time, part-time). Could infer full-time but not explicit. According to rule: never create Pay/Schedule/Benefits sections unless posting actually states them. Benefits is stated: "Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits". So we can include Benefits.
Pay: salary ranges listed. So include Pay.
Schedule: Not stated. There's mention of "This role is expected to accept applications for a minimum of 5 business days." That's about application period, not schedule. No mention of work hours. So we should NOT include Schedule section.
Skills: Could be derived from qualifications? Might be separate. The posting mentions technologies: Golang, Python, Spark/Dask/Ray/Flink, Kubernetes, AWS Lambda, etc. Could be under Skills. But we also have Requirements (Basic Qualifications) and Qualifications (Preferred). Might combine. The instruction: Use sections as needed. We can have About the role (intro), Responsibilities (the bullet list), Requirements (basic qualifications), Qualifications (preferred qualifications), Skills (maybe list of tech stacks), Benefits, Pay.
We must not invent or summarize away detail. Must preserve all substantive info. So we need to include all details from the posting, but we can reorganize into sections.
We must not include boilerplate like EEO, legal, accommodation, etc. Must remove those.
We must not duplicate lines.
Let's extract substantive content:
Intro paragraphs:
"At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine learning — position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build."
That's about the company and role; could be "About the role".
Team Description:
"Team Description: The Capital One machine learning platform organization manages our cloud-based enterprise AI+ML system delivering the high-scale developer and runtime environments required to build, orchestrate, and deploy compute and data intensive AI systems across real-time and batch workloads. We are seeking a Senior Distinguished Engineer, a hands-on technical leader passionate about distributed systems, to engineer and scale foundational compute capabilities for our platform. You will use your experience in building large scale, highly available and high performance systems to develop our common compute infrastructure on top of CPU and GPU substrates. Your contributions will power everything from developer notebooks to ML / DL model training, model inference and feature generation pipelines to pre-training and fine tuning Transformer-based models as well as generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark / Dask / Ray / Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical element that is paramount to our team's success."
That's also role description.
Then bullet list after "In this role, you will :"
- Architect and build control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform
- Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit economics
- Engineer systemic improvements for operational excellence including automating KTLO (Keep The Lights On) workflows
- Direct the technical execution of a diverse project portfolio, collaborating with developers specializing in everything ranging from distributed microservices to running large foundation models
- Work cross-functionally with product and program management disciplines, and stakeholder and partners across Capital One to help optimize business outcomes while driving towards strong technology solutions
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and leading system design and code review sessions
- Help elevate the Capital One Distinguished Engineering community and establish yourself as a go-to resource on given technologies and technology-enabled capabilities
- Lead the way in creating next-generation talent, mentoring internal talent and actively recruiting external talent to bolster the Capital One tech talent pool
Then: "Capital One is open to hiring a Remote Employee for this opportunity"
Then Basic Qualifications:
"Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies
At least 10 years of experience programming with Python, Go, Scala, or Java"
Preferred Qualifications:
"Master’s Degree in Computer Science or a Master’s Degree in Software Engineering
Hands on experience in the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management)
Experience building platforms that support LLM training, fine-tuning, or high-throughput inference
Hands-on experience with AWS-specific compute primitives (EKS, EC2 UltraClusters, Graviton) and cost-optimization strategies
History of upstream contributions to major distributed systems projects"
Then: "Capital One will consider sponsoring a new qualified applicant for employment authorization for this position."
Then salary info: list ranges per location.
Then: "This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan."
Then benefits: "Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level."
Then: "This role is expected to accept applications for a minimum of 5 business days. No agencies please."
Then EEO etc which we must remove.
Also mention about accommodation contact etc - remove.
Also mention about third-party disclaimer - remove.
Also mention about Capital One Financial entities - remove.
Now we need to produce HTML with sections.
We need to decide which sections to include:
- About the role: could combine intro + team description? Might be too long but okay.
- Responsibilities: the bullet list after "In this role, you will :"
- Requirements: Basic Qualifications
- Qualifications: Preferred Qualifications
- Skills: maybe we could list the technologies mentioned (Golang, Python, Spark/Dask/Ray/Flink, Kubernetes, AWS Lambda, etc.) but that's already covered in qualifications. Could still create a Skills section summarizing technical skills. However we must not invent or summarize away detail; we can list them as they appear. But we already have them in qualifications. Might be redundant but okay if we keep them only once. The instruction: Prefer a few substantive sections over many thin ones. So maybe we combine Requirements and Qualifications into one "Requirements" section that includes both basic and preferred? But they said use headings like Requirements, Qualifications. Could have both.
We could have:
for section headings (e.g. About the role, Responsibilities, Requirements, Qualifications, Skills, Benefits, Pay, Schedule). So we need to decide which sections have content.
We have:
- Team Description: description of team and role responsibilities. That could go under "Responsibilities" or "About the role". The role description includes bullet points after "In this role, you will :". Those are responsibilities.
- Basic Qualifications: list of qualifications.
- Preferred Qualifications: list.
- Salary info: Pay.
- Benefits: mention of comprehensive benefits.
- Schedule: Not mentioned explicitly; maybe remote work? It says "Capital One is open to hiring a Remote Employee for this opportunity". That's about location/remote, not schedule. No explicit schedule (full-time, part-time). Could infer full-time but not explicit. According to rule: never create Pay/Schedule/Benefits sections unless posting actually states them. Benefits is stated: "Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits". So we can include Benefits.
Pay: salary ranges listed. So include Pay.
Schedule: Not stated. There's mention of "This role is expected to accept applications for a minimum of 5 business days." That's about application period, not schedule. No mention of work hours. So we should NOT include Schedule section.
Skills: Could be derived from qualifications? Might be separate. The posting mentions technologies: Golang, Python, Spark/Dask/Ray/Flink, Kubernetes, AWS Lambda, etc. Could be under Skills. But we also have Requirements (Basic Qualifications) and Qualifications (Preferred). Might combine. The instruction: Use sections as needed. We can have About the role (intro), Responsibilities (the bullet list), Requirements (basic qualifications), Qualifications (preferred qualifications), Skills (maybe list of tech stacks), Benefits, Pay.
We must not invent or summarize away detail. Must preserve all substantive info. So we need to include all details from the posting, but we can reorganize into sections.
We must not include boilerplate like EEO, legal, accommodation, etc. Must remove those.
We must not duplicate lines.
Let's extract substantive content:
Intro paragraphs:
"At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine learning — position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build."
That's about the company and role; could be "About the role".
Team Description:
"Team Description: The Capital One machine learning platform organization manages our cloud-based enterprise AI+ML system delivering the high-scale developer and runtime environments required to build, orchestrate, and deploy compute and data intensive AI systems across real-time and batch workloads. We are seeking a Senior Distinguished Engineer, a hands-on technical leader passionate about distributed systems, to engineer and scale foundational compute capabilities for our platform. You will use your experience in building large scale, highly available and high performance systems to develop our common compute infrastructure on top of CPU and GPU substrates. Your contributions will power everything from developer notebooks to ML / DL model training, model inference and feature generation pipelines to pre-training and fine tuning Transformer-based models as well as generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark / Dask / Ray / Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical element that is paramount to our team's success."
That's also role description.
Then bullet list after "In this role, you will :"
- Architect and build control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform
- Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit economics
- Engineer systemic improvements for operational excellence including automating KTLO (Keep The Lights On) workflows
- Direct the technical execution of a diverse project portfolio, collaborating with developers specializing in everything ranging from distributed microservices to running large foundation models
- Work cross-functionally with product and program management disciplines, and stakeholder and partners across Capital One to help optimize business outcomes while driving towards strong technology solutions
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and leading system design and code review sessions
- Help elevate the Capital One Distinguished Engineering community and establish yourself as a go-to resource on given technologies and technology-enabled capabilities
- Lead the way in creating next-generation talent, mentoring internal talent and actively recruiting external talent to bolster the Capital One tech talent pool
Then: "Capital One is open to hiring a Remote Employee for this opportunity"
Then Basic Qualifications:
"Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies
At least 10 years of experience programming with Python, Go, Scala, or Java"
Preferred Qualifications:
"Master’s Degree in Computer Science or a Master’s Degree in Software Engineering
Hands on experience in the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management)
Experience building platforms that support LLM training, fine-tuning, or high-throughput inference
Hands-on experience with AWS-specific compute primitives (EKS, EC2 UltraClusters, Graviton) and cost-optimization strategies
History of upstream contributions to major distributed systems projects"
Then: "Capital One will consider sponsoring a new qualified applicant for employment authorization for this position."
Then salary info: list ranges per location.
Then: "This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan."
Then benefits: "Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level."
Then: "This role is expected to accept applications for a minimum of 5 business days. No agencies please."
Then EEO etc which we must remove.
Also mention about accommodation contact etc - remove.
Also mention about third-party disclaimer - remove.
Also mention about Capital One Financial entities - remove.
Now we need to produce HTML with sections.
We need to decide which sections to include:
- About the role: could combine intro + team description? Might be too long but okay.
- Responsibilities: the bullet list after "In this role, you will :"
- Requirements: Basic Qualifications
- Qualifications: Preferred Qualifications
- Skills: maybe we could list the technologies mentioned (Golang, Python, Spark/Dask/Ray/Flink, Kubernetes, AWS Lambda, etc.) but that's already covered in qualifications. Could still create a Skills section summarizing technical skills. However we must not invent or summarize away detail; we can list them as they appear. But we already have them in qualifications. Might be redundant but okay if we keep them only once. The instruction: Prefer a few substantive sections over many thin ones. So maybe we combine Requirements and Qualifications into one "Requirements" section that includes both basic and preferred? But they said use headings like Requirements, Qualifications. Could have both.
We could have:
About the role
with intro + team description.
Responsibilities
with bullet list.
Requirements
with basic qualifications.
Qualifications
with preferred qualifications.
Skills
maybe not needed if we already covered. But we could include a concise list of technical skills extracted from the description (Golang, Python, Spark, Dask, Ray, Flink, Kubernetes, AWS Lambda, etc.) but that's already in qualifications. Might be thin. Better to omit Skills section.
Benefits
with benefits description.
Pay
with salary ranges.
We must not include Schedule.
Now we need to format lists: Use - for any list of duties/requirements/benefits. For prose, use
.
Thus:
- About the role: could be prose paragraphs (maybe two paragraphs). Use
.
- Responsibilities: list of duties ->
- each.
- Requirements: list of basic qualifications -> each line as
- . Could be two items: education/experience combo and programming experience. Actually basic qualifications have two bullet-like sentences: "Bachelor's degree ... plus at least 10 years ..." and "or a Master's degree ... plus at least 8 years ..." and "At least 10 years of experience programming with Python, Go, Scala, or Java". We'll treat each as separate
- .
- Qualifications: list of preferred qualifications -> each bullet as
- .
- Benefits: prose ->
.
- Pay: we need to present salary ranges. Could be a
- each location with range. Or a
with details. Since it's a list, we can use
.
We must preserve all substantive info: include all locations and ranges.
Also include note about remote employee eligibility? That's under "Capital One is open to hiring a Remote Employee for this opportunity". That's not a benefit or pay; maybe could be under About the role or Responsibilities? It's a note about remote eligibility. Could be included in About the role as a sentence. We'll incorporate that into About the role paragraph.
Also include note about sponsorship: "Capital One will consider sponsoring a new qualified applicant for employment authorization for this position." That's substantive; could be under About the role or Requirements? Probably under About the role.
Also note about performance based incentive compensation: that's part of Pay? Could be under Pay as additional note.
Also note about benefits eligibility varying: include in Benefits paragraph.
Also note about application period: "This role is expected to accept applications for a minimum of 5 business days. No agencies please." That's not a section; maybe we could put under About the role as a note? But it's about application process, which we are told to remove application instructions. The instruction says: "Remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions." So we should remove application instructions. So we remove that line.
Thus we exclude "This role is expected to accept applications for a minimum of 5 business days. No agencies please."
Now we need to ensure we don't include any boilerplate like EEO, accommodation, third-party disclaimer, etc.
Now produce HTML.
Let's craft:
. Thus: - About the role: could be prose paragraphs (maybe two paragraphs). Use
. - Responsibilities: list of duties ->
- each. - Requirements: list of basic qualifications -> each line as
- . Could be two items: education/experience combo and programming experience. Actually basic qualifications have two bullet-like sentences: "Bachelor's degree ... plus at least 10 years ..." and "or a Master's degree ... plus at least 8 years ..." and "At least 10 years of experience programming with Python, Go, Scala, or Java". We'll treat each as separate
- . - Qualifications: list of preferred qualifications -> each bullet as
- .
- Benefits: prose ->
. - Pay: we need to present salary ranges. Could be a
- each location with range. Or a
with details. Since it's a list, we can use
- .
We must preserve all substantive info: include all locations and ranges.
Also include note about remote employee eligibility? That's under "Capital One is open to hiring a Remote Employee for this opportunity". That's not a benefit or pay; maybe could be under About the role or Responsibilities? It's a note about remote eligibility. Could be included in About the role as a sentence. We'll incorporate that into About the role paragraph.
Also include note about sponsorship: "Capital One will consider sponsoring a new qualified applicant for employment authorization for this position." That's substantive; could be under About the role or Requirements? Probably under About the role.
Also note about performance based incentive compensation: that's part of Pay? Could be under Pay as additional note.
Also note about benefits eligibility varying: include in Benefits paragraph.
Also note about application period: "This role is expected to accept applications for a minimum of 5 business days. No agencies please." That's not a section; maybe we could put under About the role as a note? But it's about application process, which we are told to remove application instructions. The instruction says: "Remove cookie/navigation/legal/EEO/equal-opportunity/scam-warning boilerplate, duplicated lines, and application instructions." So we should remove application instructions. So we remove that line.
Thus we exclude "This role is expected to accept applications for a minimum of 5 business days. No agencies please."
Now we need to ensure we don't include any boilerplate like EEO, accommodation, third-party disclaimer, etc.
Now produce HTML.
Let's craft:
- each location with range. Or a
Similar jobs
Senior Staff Engineer, AI Compute (Remote Eligible)
Engineering$286k–$327k/yrapply on dsp.prng.co
Senior Staff Engineer, AI Compute (Remote Eligible)
Engineering$286k–$327k/yrapply on dsp.prng.co
Senior Staff Engineer, AI Compute (Remote Eligible)
Engineering$286k–$327k/yrapply on dsp.prng.co
Senior Staff Engineer, AI Compute (Remote Eligible)
Engineering$286k–$327k/yrapply on dsp.prng.co
Senior Staff Engineer, AI Compute (Remote Eligible)
Engineering$286k–$327k/yrapply on dsp.prng.co
Senior Staff AI Engineer (Remote Eligible)
RemoteEngineering$286k–$327k/yrapply on theladders.com