Lead Data Engineer (Python, PySpark, AWS)

About the role

At Capital One you’ll join a large community of makers, breakers, doers, and disruptors who solve real problems and meet real customer needs. As a Lead Data Engineer you will be at the forefront of a major transformation, building and pioneering technology solutions in a fast‑paced, collaborative, inclusive, and iterative delivery environment.

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using full‑stack development tools and technologies.
• Work with developers experienced in machine learning, distributed microservices, and full‑stack systems.
• Utilize programming languages such as Java, Scala, Python and work with open‑source RDBMS, NoSQL databases, and cloud‑based data warehousing services (e.g., Redshift, Snowflake).
• Share passion for staying on top of tech trends, experimenting with new technologies, participating in internal & external technology communities, and mentoring other engineers.
• Collaborate with digital product managers to deliver robust cloud‑based solutions that empower millions of Americans financially.
• Perform unit tests and conduct code reviews to ensure rigorous design, elegant implementation, and optimal performance.

Basic Qualifications

• Bachelor’s degree.
• At least 4 years of experience in application development (internship experience does not apply).
• At least 2 years of experience with big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• 7+ years of experience in application development using Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, or Google Cloud).
• 4+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
• 4+ years of experience building real‑time data and streaming applications.
• 4+ years of experience with NoSQL implementations (Mongo, Cassandra).
• 4+ years of data warehousing experience (Redshift or Snowflake).
• 4+ years of experience with UNIX/Linux, including basic commands and shell scripting.
• 2+ years of experience with Agile engineering practices.
• Experience leveraging interactive AI tooling to accelerate productivity beyond basic code completion.

Pay

• McLean, VA: $197,300 – $225,100 (Lead Data Engineer)
• Richmond, VA: $179,400 – $204,700 (Lead Data Engineer)
• Other locations: salary range will correspond to the local pay band for this role.
• Eligibility for performance‑based incentive compensation, including cash bonuses and/or long‑term incentives.

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support total well‑being. Eligibility varies based on full‑ or part‑time status, exempt or non‑exempt classification, and management level.