Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI)

Overview

The Team:

• The Marketing and Messaging team is responsible for delivering hyper-personalized messages and experiences that will delight the customer, attract prospects and drive increasing business value.
• The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech channels.

What You’ll Do

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
• Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
• Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
• Optimize information system for end-user and downstream application consumers by using sound data design practices
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
• Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Basic Qualifications

• Bachelor’s Degree
• At least 6 years of experience in application development (Internship experience does not apply)
• At least 2 years of experience in big data technologies
• At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Preferred Qualifications

• Master's Degree
• 9+ years of experience in application development including Python, SQL, Spark, ETL tools, AWS Glue
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)
• 4+ year experience working on real-time data and streaming applications
• 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 4+ years of data warehousing experience (Redshift or Snowflake)
• 4+ years of experience with UNIX/Linux including basic commands and shell scripting
• 4+ years experience with data modeling for data warehousing
• 2+ years of experience with Agile engineering practices
• Experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.

This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being.