Research Engineer, FlexOlmo

About the role

Persons in these roles are expected to work from our offices in Seattle. On-site requirements vary based on position and team.

Responsibilities

• Building infrastructure to facilitate the next generation of LLM research.
• Optimizing training and inference for language models.
• Triaging between experiments and executing on the most impactful.
• Bridging the gap between cutting-edge research and a widely adopted product.
• Bringing software engineering best practices to a research environment.
• Supporting and collaborating with an open-source community.
• Releasing your contributions back to the broader community in the form of open source software, model releases, and additions to Ai2’s public API and open research datasets, as well as technical reports.

Requirements

• A bachelor’s degree in Data Science/CS/EE/Applied Mathematics/Statistics/ML/NLP, or a related field, or equivalent relevant experience, and expertise at building ML infrastructure.
• 4+ years of experience building infrastructure that handles data preprocessing/transformation and model training, evaluation, inference, and deployment. Experience in the complete model development cycle, including data set construction, training, tuning, evaluation, performance profiling, and monitoring.
• Knowledge of modern deep learning and natural language processing techniques.
• Strong software engineering skills, particularly around building performant systems and debugging.
• Must have experience with Python and PyTorch/Jax/Tensorflow as well as feel at ease in picking up new programming languages, libraries, or APIs as tools as project needs evolve.
• Familiarity working with cloud compute resources (e.g. AWS) and containerization (e.g. Docker).
• Strong collaboration and communication skills - our environment is small and collaborative, and we'd like you to thrive while working closely with others, sometimes with complementary skills/perspectives.

Qualifications

• Advanced degree in Data Science/CS/EE/Applied Mathematics/Statistics/ML/NLP or related fields and/or relevant and equivalent engineering experience.
• Contributions to open-source ML or research libraries (e.g. spaCy, AllenNLP, transformers).
• Experience successfully operating models at scale in a production setting.
• Experience in HPC settings.
• Curiosity about AI research.

Skills

• Python and PyTorch/Jax/Tensorflow.
• Cloud computing (AWS).
• Containerization (Docker).
• Software engineering best practices.
• Collaboration and communication skills.
• Open-source contributions.
• Model operation at scale.
• HPC experience.
• Curiosity about AI research.

Benefits

• Medical, dental, vision, life insurance, accidental death and dismemberment insurance, short-term disability, long-term disability, and an employee assistance program.
• Voluntary life insurance, accidental death and dismemberment, health savings account, healthcare reimbursement arrangement, and health care and dependent care flexible spending accounts.
• 401(k) plan.
• Commuting and internet expense assistance, fitness and wellbeing expense assistance, sick days, personal days, vacation days, and paid holidays.
• Annual bonuses and participation in the long-term incentive plan.

Pay

Base salary range: $128,880 - $193,320, with generous bonus plans.

Schedule

On-site requirements vary based on position and team.