DirectJobHub
Jobs · Information Technology · Virginia

Lead Data Engineer (Python, PySpark, AWS)

Capital One · Richmond, VA · 3 wk ago
Information Technology$197k–$225k/yrFull-time

About the role

At Capital One you’ll join a large community of makers, breakers, doers, and disruptors who solve real problems and meet real customer needs. As a Lead Data Engineer you will be at the forefront of a major transformation, building and pioneering technology solutions in a fast‑paced, collaborative, inclusive, and iterative delivery environment.

Responsibilities

  • Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using full‑stack development tools and technologies.
  • Work with developers experienced in machine learning, distributed microservices, and full‑stack systems.
  • Utilize programming languages such as Java, Scala, Python and work with open‑source RDBMS, NoSQL databases, and cloud‑based data warehousing services (e.g., Redshift, Snowflake).
  • Share passion for staying on top of tech trends, experimenting with new technologies, participating in internal & external technology communities, and mentoring other engineers.
  • Collaborate with digital product managers to deliver robust cloud‑based solutions that empower millions of Americans financially.
  • Perform unit tests and conduct code reviews to ensure rigorously designed, elegantly coded, and high‑performance implementations.

Basic Qualifications

  • Bachelor’s degree.
  • At least 4 years of experience in application development (internship experience does not apply).
  • At least 2 years of experience with big data technologies.
  • At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

  • 7+ years of experience in application development using Python, SQL, Scala, or Java.
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, or Google Cloud).
  • 4+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
  • 4+ years of experience building real‑time data and streaming applications.
  • 4+ years of experience with NoSQL implementations (Mongo, Cassandra).
  • 4+ years of data‑warehousing experience (Redshift or Snowflake).
  • 4+ years of experience with UNIX/Linux, including basic commands and shell scripting.
  • 2+ years of experience with Agile engineering practices.
  • Experience leveraging interactive AI tooling to accelerate productivity beyond basic code completion.

Pay

  • McLean, VA: $197,300 – $225,100 (Lead Data Engineer)
  • Richmond, VA: $179,400 – $204,700 (Lead Data Engineer)
  • Other locations: salary range will correspond to the local pay band for this role.
  • Eligibility for performance‑based incentive compensation, including cash bonuses and/or long‑term incentives.

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support total well‑being. Eligibility varies based on full‑ or part‑time status, exempt or non‑exempt classification, and management level.

Additional Information

Capital One will not sponsor a new applicant for employment authorization or provide immigration‑related support for this position. The role is open to direct applicants only; agencies are not accepted.

Similar jobs