Research Engineer, Pre-Training
Jump Trading · New York, NY · 1 wk ago
On-siteEngineering$300k/yrFull-time
What You'll Do
- Own and drive the entire training stack
- Build fault-tolerant infrastructure that scales across thousands of GPUs and TPUs with near-linear performance
- Engineer data pipelines that stream terabytes per second as our models train on petabytes of data from every corner of the global markets
- Design custom kernels that unlock 10x efficiency gains
- Co-design novel architectures with researchers and pioneer cutting-edge approaches to mixed-precision training and model parallelism
- Balance ambitious research goals with practical engineering constraints
- Have the latest generation hardware at your disposal
Skills You'll Need
- Expertise and track record of significant, measurable performance improvements in large-scale distributed training (MFU, throughput, convergence, cost-per-token)
- Published research in efficient training methods, scaling laws, architectures, or systems for ML
- Background in numerical computing, HPC, or distributed systems, including familiarity with GPUs/TPUs, high-performance networking (NVLink/InfiniBand), Kubernetes/Slurm, and OS internals
- Expertise in Python and deep experience with modern deep learning frameworks (PyTorch and/or JAX)
- Advanced degree (MS or PhD) in Computer Science, Machine Learning, Physics, Mathematics, or a related quantitative field, or equivalent industry experience at a frontier lab
- Strong problem-solving skills, results orientation, and excellent collaborative communication
- Reliable and predictable availability
Bonus Points
- Expertise in: CUDA kernel development, Triton/Pallas/CuTe DSLs, PyTorch/JAX internals, XLA optimization, or hardware acceleration (FPGA/ASIC)
- Knowledge of reinforcement learning, post-training, or fine-tuning techniques
- Knowledge of financial markets or trading
Benefits
- Discretionary bonus eligibility
- Medical, dental, and vision insurance
- HSA, FSA, and Dependent Care options
- Employer Paid Group Term Life and AD&D Insurance
- Voluntary Life & AD&D insurance
- Paid vacation plus paid holidays
- Retail plan with employer match
- Paid parental leave
- Wellness Programs
Annual Base Salary Range
$300,000 USD - $350,000 USD