Senior Staff Data Engineer

What You’ll Do

• Design and build high-performance, reliable, and scalable reporting APIs and data pipelines.
• Lead high-level architecture discussions and planning sessions.
• Work with ad measurement, revenue and addressability data.
• Collaborate with the Product team to clarify the scope of the projects by giving thoughtful feedback which challenges and clarifies requirements intent.
• Execute tasks with utmost clarity and precision, demonstrating a strong sense of ownership and providing clear direction to drive projects forward effectively.
• Collaborate with the Global Operations and Cloud Infrastructure teams to ensure flawless production deployments and support the Incident Management team.
• Responsible for mentoring and guiding junior engineers.

What You’ll Need

• 12+ years of software engineering experience in Python or Java programming language (preferably JDK17 or higher).
• 7+ years designing, building, and managing data pipelines using Spark, BigQuery, AWS EMR, and GCP Cloud Analytics.
• 7+ years of experience crafting REST API based-microservices and scalable products, utilizing diverse cloud platforms (ideally AWS).
• Cloud data warehouse & analytics platforms (Snowflake, BigQuery).
• Observability tools like Prometheus, Grafana, ELK stack.
• Data pipeline expectations framework experience (like Monte Carlo data, Great Expectations, Soda).
• Working with containers (Docker, Kubernetes).
• Messaging platforms and stream data processing (like Kafka, Flink, Pub/Sub).
• Collaboration tools like Miro (or Lucidchart), Jira and Confluence.
• Strong understanding of engineering software processes, lifecycle methodology, configuration management, release management, and system verification and testing.
• Able to work independently and oversee entire projects or significant parts, focusing on research and completing the tasks on time.
• Strong analytical and problem-solving skills, with meticulous attention to detail and a dedication to continuous improvement.

Nice to Have

• Expertise in Caching implementations (like Redis, Memcached, etc.).
• Expertise in Designing and maintaining Public APIs and data contracts.
• Security basics (e.g., OAuth2 standard).
• Foundational Amazon Cloud Services, like S3, CloudTrail, SQS, SNS, Lambda, API Gateway, ElasticCache, Athena, Kinesis, EKS, Cognito, and others.
• NoSQL databases knowledge (Druid, DynamoDB, SingleStore, or others).
• Hands on experience with AI coding assistants and tools to help with coding and data analytics.

Qualifications

• Bachelor’s Degree in Computer Science/Mathematics or a similar field.
• Must have legal right to work in the U.S.