ML Infrastructure Engineer

About The Role

We are seeking a highly skilled ML Infrastructure Engineer to join our dynamic team on a full-time, remote basis. In this role, you will be responsible for designing, building, and maintaining the platform infrastructure that supports large-scale AI training and inference workloads. Your expertise will be crucial in managing GPU clusters, distributed training frameworks, and high-performance storage and networking systems.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Six or more years of experience in infrastructure, platform, or high-performance computing (HPC) engineering
• Hands-on experience operating GPU clusters or large-scale machine learning training infrastructure
• Proficiency in Python and at least one systems programming language such as Go or C++
• Deep understanding of distributed training, accelerator architectures, and collective communication protocols
• Experience with Kubernetes, Slurm, Ray, or similar scheduling and orchestration systems for ML workloads
• Strong knowledge of Linux internals, networking (including RDMA, InfiniBand), and high-performance storage solutions
• Experience working with cloud provider ML infrastructure offerings (AWS, GCP, Azure)
• Solid software engineering practices including testing, CI/CD pipelines, and code review processes
• Excellent communication skills and ability to collaborate across cross-functional teams

Responsibilities

• Design, implement, and operate GPU and accelerator infrastructure for AI training and inference, across on-premises, cloud, and hybrid environments
• Develop scheduling, queuing, and resource management systems to maximize hardware utilization across multiple teams
• Integrate popular ML frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a cohesive platform
• Manage high-performance storage systems and data pipelines to ensure efficient data delivery for training workloads
• Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth communication protocols
• Build observability solutions to monitor utilization, throughput, training stability, and failure modes
• Optimize costs through scheduling, spot capacity utilization, and right-sizing of resources
• Develop developer tooling and workflows to facilitate safe and efficient experimentation for researchers
• Collaborate with research and ML teams to plan capacity and infrastructure needs for upcoming training projects
• Implement security controls, access management, and isolation techniques for multi-tenant AI environments
• Maintain operational documentation, dashboards, and runbooks for ongoing platform management
• Stay informed about advancements in AI hardware, open-source tools, and infrastructure research to continuously improve platform capabilities

Benefits

• Competitive salary range of $100,000 to $150,000
• 100% remote work within the Continental United States
• Full-time, W2 employment with no third-party involvement
• Support for H1B visa transfers for qualified candidates
• Opportunities for professional growth and career advancement
• Collaborative and inclusive work environment
• Access to cutting-edge AI infrastructure and tools
• Comprehensive onboarding and ongoing training programs
• Flexible work schedule to promote work-life balance

Equal Opportunity

Bright Vision Technologies is an equal opportunity employer. We are committed to creating a diverse and inclusive workplace where all employees and applicants are treated with respect and fairness. We do not discriminate based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected characteristic under applicable law. We also provide reasonable accommodations for religious practices, mental health, and physical disabilities. Our commitment to diversity and inclusion is integral to our success, and we strive to foster a workplace culture that values the unique perspectives and talents of every individual.