Software Engineer - Kernels

What You'll Do

• Design and optimize kernels that interface directly with our hardware
• Work in partnership with our ML Research and Hardware Engineering teams
• Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack

Who You Are

• Bachelor of Computer Science or equivalent degree
• Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
• Language: at least one of assembly, C++, C, Zig, or Rust

What We Offer

• A Stake in our success
• A flexible cash equity compensation mix that fits your needs
• Health & Wellness
• Company subsidized Health, Dental, Vision, and Life insurance
• Pre-tax Health Savings Accounts with generous company contribution (even if you don’t)
• Time To Recharge
• 4 weeks paid time off (accrued)
• 12 company holidays
• 3 weeks remote/flexible work per year
• Support to Parents
• Up to 12 weeks of paid parental leave, regardless of your path to parenthood
• Learning & Development
• $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities
• Team Connection
• Team Lunches
• Quarterly off-sites
• Regular town halls
• Financial Wellbeing
• 401K and/or Roth IRA, with 5% company contribution, even if you don’t!
• Flexible Spending Accounts
• Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses
• Commute On Us
• For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!
• MatX E[x]tras
• $50 per month to use on the perks you care about most
• Remote Perks
• We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement

Job Details

• This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday
• Bonus Points If You Have Experience implementing kernels for ML models such as Transformers
• Bonus Points If You Have Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
• Bonus Points If You Are Familiar with how compilers work

Compensation

• The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training.
• Early Career - $120,000 - $275,000 + equity
• Mid Career - $175,000 - $400,000 + equity
• Senior Career - $250,000 - $600,000 + equity

Qualifications

• Bachelor of Computer Science or equivalent degree
• Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
• Language: at least one of assembly, C++, C, Zig, or Rust

Required Skills

• Experience implementing kernels for ML models such as Transformers
• Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
• Familiarity with how compilers work

Benefits

• Health & Wellness
• Company subsidized Health, Dental, Vision, and Life insurance
• Pre-tax Health Savings Accounts with generous company contribution (even if you don’t)
• Time To Recharge
• 4 weeks paid time off (accrued)
• 12 company holidays
• 3 weeks remote/flexible work per year
• Support to Parents
• Up to 12 weeks of paid parental leave, regardless of your path to parenthood
• Learning & Development
• $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities
• Team Connection
• Team Lunches
• Quarterly off-sites
• Regular town halls
• Financial Wellbeing
• 401K and/or Roth IRA, with 5% company contribution, even if you don’t!
• Flexible Spending Accounts
• Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses
• Commute On Us
• For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!
• MatX E[x]tras
• $50 per month to use on the perks you care about most
• Remote Perks
• We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement

Application Instructions

• This position requires access to information that is subject to U.S. export controls.
• This offer of employment is contingent upon the applicants capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.
• MatX does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies in response to job postings. No fee will be paid to third parties who submit unsolicited candidates directly to our hiring managers or People team and any resumes submitted are deemed to be the property of MatX.