ML Research Scientist -Deep Learning & Transformer Architectures

Principal Responsibilities

• Design and implement a custom decoder-only Transformer architecture optimized for tokenized financial time-series data
• Develop a novel tokenization scheme for intraday market data: price movements, volume, order flow, and cross-sectional features
• Implement efficient training pipelines using PyTorch with mixed-precision training, gradient checkpointing, and multi-GPU parallelism
• Design attention mechanisms adapted to financial data: temporal attention patterns, cross-asset attention, and multi-scale representations
• Build evaluation frameworks for next-token prediction accuracy, signal quality, and trading performance
• Implement inference optimization for low-latency production deployment: model quantization, KV-cache, speculative decoding
• Conduct rigorous ablation studies to validate architecture choices and training methodology
• Collaborate with the team to integrate model predictions into the live trading pipeline
• Document research methodology, experimental results, and architectural decisions

Required Skills / Qualifications

• PhD in Machine Learning, Computer Science, Statistics, Applied Mathematics, or a related field with a focus on deep learning
• Demonstrated ability to implement Transformer architectures from scratch (not just finetuning pre-trained models)
• Deep understanding of attention mechanisms, positional encodings, tokenization strategies, and training dynamics
• Expert-level PyTorch skills including custom modules, training loops, mixed-precision, and multi-GPU training
• Strong mathematical foundations: linear algebra, probability theory, optimization, information theory
• Experience training models at scale (100M+ parameters)
• Strong programming skills in Python and C++ for performance-critical components
• Self-directed researcher capable of defining and executing a multi-month research agenda
• Familiarity with Al-assisted development tools (Cursor, Claude Code)

Preferred Skills / Experience

• Experience applying deep learning to financial data or time-series forecasting
• Familiarity with tokenization approaches for continuous or non-text data
• Published research in top ML venues (NeurIPS, ICML, ICLR) or equivalent industry experience
• Knowledge of market microstructure and intraday trading dynamics
• Experience with model compression, quantization, and inference optimization

Benefits

Millennium offers a total compensation package which includes a base salary, discretionary performance bonus, and comprehensive benefits. The estimated base salary range for this position is $150,000 to $200,000, which is specific to New York and may change in the future. When finalizing an offer, we take into consideration an individual’s experience level and the qualifications they bring to the role to formulate a competitive total compensation package.