Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
About the role
The Marketing and Messaging team at Capital One is responsible for delivering hyper-personalized messages and experiences that delight customers, attract prospects, and drive increasing business value. They build scalable platforms that deliver omnichannel messages in owned and paid Adtech channels.
Responsibilities
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
- Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
- Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
- Optimize information systems for end-user and downstream application consumers by using sound data design practices
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
- Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
- Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Requirements
- Bachelor’s Degree
- At least 4 years of experience in application development
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Qualifications
- 7+ years of experience in application development including Python, SQL, Spark, ETL tools, AWS Glue
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 4+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)
- 4+ years of experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 4+ years of experience with data modeling for data warehousing
- 2+ years of experience with Agile engineering practices
- 1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery
Skills
- Programming languages: Python, SQL, Spark, ETL tools, AWS Glue
- Distributed data/computing tools: MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL
- NoSQL implementation: MongoDB, Cassandra
- Data warehousing: Redshift or Snowflake
- UNIX/Linux: Basic commands and shell scripting
- Data modeling for data warehousing
- Agile engineering practices
- AI-assisted coding tools (Claude Code, GitHub Copilot)
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being. Learn more at the Capital One Careers website.
Pay
Salaries for Lead Data Engineer positions vary by location. For Chicago, IL, the range is $179,400 - $204,700; for McLean, VA, the range is $197,300 - $225,100. For other locations, the pay range is determined by the location-specific minimum and maximum full-time annual salaries listed above.
Schedule
Full-time positions are available.
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being. Learn more at the Capital One Careers website.
Pay
Salaries for Lead Data Engineer positions vary by location. For Chicago, IL, the range is $179,400 - $204,700; for McLean, VA, the range is $197,300 - $225,100. For other locations, the pay range is determined by the location-specific minimum and maximum full-time annual salaries listed above.
Equal Opportunity Employer
Capital One is an equal opportunity employer (EOE), including disability/vet.