Sr Staff ML Infra Engineer - Search & Discovery

Role Overview

We are seeking a Staff Software Engineer, ML infra Engineer for the Search & Discovery organization. Your responsibilities include:

• Proactively drive the execution of end-to-end data platform, data quality roadmap for Search & Discovery ML efforts
• Take ownership, consolidate and optimize the Search & Discovery core data logging, processing, and ML model training pipelines
• Develop and scale data infrastructure that powers batch and real-time data processing, monitoring, and debugging for ML experiments
• Drive design and implementation of scalable ML based ranking system and online ML inference services
• Build strong cross-functional partnerships with Data Scientists, Analysts, Product Managers, Indexing Platform Engineers, Ranking Engineers and Data Platform Engineers to understand both the offline and online needs and deliver on those needs
• Research, analyze and select technical approaches for solving difficult and challenging development and integration problems, coach and mentor other engineers in process and methodologies

Basic Qualifications

• Bachelor's degree in computer science, electrical engineering, mathematics, statistics or closely related fields
• 5 years of professional experience in applied machine learning
• Experience in machine learning, deep learning, and statistical modeling
• Proficiency in Python and/or Java, with experience in building production grade ML systems

Preferred Qualifications

• Computer science fundamentals: data structures, algorithms, performance complexity, and implications of computer architecture on software performance (e.g., I/O and memory tuning)
• Experience with Big Data tools and ETL frameworks (Hadoop, Hive, Presto, Spark, Scala, Apache Airflow, etc.)
• Experience with ML frameworks such as Tensorflow and Pytorch
• Experience with deploying highly robust and scalable data pipelines processing petabytes of data
• Experience in managing mission critical services with high throughput and low latency
• Experience with integrating applications and platforms with cloud technologies (i.e, AWS and GCP)
• Strong verbal and written communication skills
• Ability to conduct meetings and make professional presentations, and explain complex concepts and technical material to non-technical users
• Experience with machine learning platform for search & discovery related rankings is a strong plus