Senior Machine Learning Engineer, Recommendations
BAM Ventures · San Francisco, CA · 5 days ago
EngineeringFull-time
About the role
We're seeking a Senior Machine Learning Engineer to own the systems that determine how products are surfaced, ranked, and discovered across Arena Club's marketplace, spanning search relevance, ranking, and personalization on every surface and category. This is production machine learning in the request path, where model quality translates directly into conversion, engagement, and revenue.
Responsibilities
- Recommendations & Ranking Design, train, and deploy recommendation and ranking models that improve relevance and conversion across the marketplace
- Own a recommendation and search index that beats a strong third-party control on conversion and cuts fallback rates
- Build homepage, onboarding, and category-level personalization ranking
- Develop retrieval and candidate-generation systems using embeddings and semantic search
- Reuse cross-domain features such as item scores and tier weights as ranking signals across surfaces
- Production ML & ML Operations - Own the full ML lifecycle: data ingestion, feature engineering, training, evaluation, deployment, monitoring, and iteration
- Deploy and operate low-latency inference in the request path, and design scalable systems for serving and pipeline execution
- Build and maintain batch and near-real-time data pipelines using Python and PySpark
- Deploy and operate ML workloads on AWS (EC2, S3, and related services)
- Improve reproducibility, experiment tracking, and observability across the stack
- Collaborate with backend engineers to integrate models into customer-facing systems
- Cross-Functional Partnership & AI-Accelerated Development - Partner with Product, Engineering, and the marketplace squad to translate high-level needs into technical problem statements
- Design and interpret A/B tests to validate model and product changes
- Communicate model behavior, trade-offs, and timelines in plain language to non-technical stakeholders
- Leverage AI tools and agents throughout the ML lifecycle for code scaffolding, debugging, and optimization
- Operate with high ownership and autonomy in a fast-moving, ambiguous environment
Qualifications
- Bachelor's degree in Computer Science, Statistics, Mathematics, or a related quantitative field; advanced degree preferred
- 5+ years in applied ML or ML engineering, with a track record of shipping models to production in a consumer-facing environment
- 3+ years building recommendation, ranking, search relevance, or personalization systems
- Expert-level proficiency in Python and the ML ecosystem (PyTorch, TensorFlow, Scikit-learn)
- Experience with learning-to-rank, embeddings, retrieval, and semantic search
- Advanced SQL for complex data extraction and processing
- Experience applying ML to user behavior data (clickstream, transactional, event logs)
- Strong AWS experience (EC2, S3, and related services) for model hosting and data workflows
- Comfort with experimentation (A/B testing, lift measurement, business impact interpretation)
- Knowledge of MLFlow or an equivalent experiment-tracking and model-registry tool
Preferred Qualifications
- Experience with AWS OpenSearch, Algolia, or other search and retrieval systems
- Experience with Marketplace recommendation system modeling
- Experience with vector databases and approximate nearest-neighbor search
- NLP experience, including embeddings, text classification, or semantic search