Lead Data Engineer - Risk Tech (Python, AWS)

About the role

As a Lead Data Engineer at Capital One, you will play a pivotal role in driving a major transformation within the organization's Risk Tech division. Your responsibilities will involve collaborating with and across agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies. You will also work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems.

Responsibilities

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
• Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
• Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements

• Bachelor’s Degree
• At least 4 years of experience in application development
• At least 2 years of experience in big data technologies
• At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

Qualifications

• 7+ years of experience in application development including Python, SQL, Golang, Java or Scala
• 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 4+ years experience with Distributed data/computing tools (MapReduce, Flink, EMR, Kafka, Spark, or MySQL)
• 4+ year experience working on real-time data and streaming applications
• 4+ years of experience with SQL implementation (PostgreSQL) and NoSQL implementation (DynamoDB)
• 4+ years of data warehousing experience (Snowflake or Redshift)
• 4+ years of experience with UNIX/Linux including basic commands and shell scripting
• 2+ years of experience with Agile engineering practices
• Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion

Skills

• Programming Languages: Java, Scala, Python
• Big Data Technologies: SQL, NoSQL databases
• Cloud Computing: AWS, Microsoft Azure, Google Cloud
• Distributed Data/Computing Tools: MapReduce, Flink, EMR, Kafka, Spark
• Real-Time Data/Streaming Applications
• Data Warehousing: Snowflake, Redshift
• UNIX/Linux: Basic Commands, Shell Scripting
• Agile Engineering Practices
• Interactive AI Tooling

Benefits

Capital One offers a comprehensive benefits package including health insurance, retirement plans, and paid time off.

Pay

The salary range for this role is $100,000 - $150,000 annually.

Schedule

The schedule for this role is typically full-time.