Senior Software Engineer, ML/AI Platform

About the role

We're looking for a self-motivated, highly driven Senior Software Engineer to join our Machine Learning Platform (MLPlatform) team. As a team, we enable Attentive’s Machine Learning (ML) practice to directly impact Attentive’s AI product suite through the tools to train, serve, and deploy ML models with higher velocity and performance, while maintaining reliability. We build and maintain a foundational ML platform that spans the full ML lifecycle for use by ML engineers and data scientists.

Responsibilities

• Unlock offline & real-time access to trillions of data points for our ML and Data Science teams
• Manage, expand, and optimize our feature store that enables feature engineering, multi-TB scale training jobs, and offline / real-time inferencing
• Partner with other teams and business stakeholders to deliver ML and AI initiatives

Requirements

• You have been working in the areas of Data Engineering / MLOps for 5+ years, and have built and matured the pipelines of a PB-scale feature store
• You have deep Apache Spark, Spark Streaming, and Ray Data experience and built data pipelines for ML use cases using these tools
• You understand the correlation between data cardinality, query plans, configuration settings, and hardware and the impact of each on data pipeline performance
• You know/have created infrastructure for Training ML models/fine-tuning LLMs
• You understand the key differences between online and offline ML inferences and can voice the critical elements to be successful with each to meet business needs

Qualifications

• You have a Bachelor's degree in Computer Science, Engineering, or a related field
• You have 5+ years of experience in software development
• You have experience with Java / Spring Boot microservices
• You have experience with AWS services such as EKS, Kinesis, AirFlow, Postgres, Planetscale, and Redis
• You have experience with React and TypeScript
• You have experience with GraphQL, Storybook, Radix UI, Vite, esbuild, and Playwright
• You have experience with Python, Metaflow, HuggingFace 🤗, PyTorch, TensorFlow, and Pandas

Skills

• Experience with Data Engineering / MLOps
• Deep knowledge of Apache Spark, Spark Streaming, and Ray Data
• Experience with PB-scale feature stores
• Experience with Training ML models/fine-tuning LLMs
• Understanding of online and offline ML inferences

Benefits

• Competitive perks and benefits
• Equity
• Benefits package

Pay

• The US base salary range for this full-time position is $180,000 - $250,000 annually

Schedule

• Full-time