Jobs · Information Technology · New York

Software Development Engineer - Big Data, Brand Metrics and Benchmarks

Amazon · New York, NY · 1 wk ago
Information TechnologyFull-time

About the role

Build the AI-agent-powered data platforms that process billions of events daily to help advertisers understand what "good" looks like. Sit at the intersection of petabyte-scale data engineering, real-time distributed systems, and innovative AI agent interfaces. This isn't a team that talks about AI — we're actively shipping it into production.

Responsibilities

  • Design and build scalable, real-time data systems that power advertiser-facing measurement products and AI agent interfaces
  • Own end-to-end delivery: requirements, design, implementation, testing, deployment, and operational support
  • Build monitoring, alerting, and data quality frameworks that ensure reliability at petabyte scale
  • Optimize distributed systems for performance, cost efficiency, and extensibility
  • Contribute to our GenAI-accelerated development practices — from spec-driven development to autonomous testing tools
  • Collaborate with scientists, product managers, and partner teams to translate complex measurement problems into elegant engineering solutions
  • Navigate ambiguity and make sound technical decisions with incomplete information

Requirements

  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 1+ years of big data technologies such as AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/Samza experience

Qualifications

  • 4+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • 4+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience
  • Experience building and operating data pipelines using Apache Spark and Scala on Amazon EMR, spanning extraction, ingestion, batch and streaming processing
  • Data lake design with Apache Iceberg a plus

Skills

  • Experience with GenAI-driven development practices
  • Ability to navigate ambiguity and make sound technical decisions with incomplete information

Benefits

  • Comprehensive benefits including health insurance, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave

Pay

The base salary range for this position is $158,100.00 - $213,800.00 annually.

Schedule

Not specified

Similar jobs

Big Data Engineer

US Hi-Tech Solutions INC.Dallas, TX· Yesterday
Information Technologyapply on ushitecsolutions.com

Big Data Engineer

Randstad Digital AmericasMalvern, PA· 4 days ago
Engineering$48.46–$54.46/hrapply on randstadusa.com