Silicon Architect, AI Accelerator

MatX designs hardware tailored for the world’s best AI models. Our hardware will make a given level of intelligence available 3-5 years sooner. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the world’s largest models.

About the role

We are seeking an AI Accelerator Compute Architect to help define the compute architecture for our next-generation GenAI accelerators. The successful candidate will be responsible for delivering performant silicon architecture at the full-chip or subsystem level.

Responsibilities

• Define the architecture for MatX’s AI compute subsystem, including ISA, connectivity, memories, and control.
• Derive architectural requirements from AI use cases.
• Conduct analytical and empirical performance analysis.
• Collaborate closely with Research, SW, and HW teams to ensure we architect just-right silicon for workloads, programmability, and PPA.
• Work through power, area, performance tradeoffs with stakeholders.
• Support test plan reviews, first-silicon bring-up, and post-silicon debug.

Requirements

• Strong background in computer architecture, especially AI accelerators, GPUs, TPUs, vector processors, SIMD, VLIW, or other parallel compute architectures.
• Experience translating workloads into hardware architecture.
• Solid microarchitecture fundamentals.
• First-principles understanding of latency, throughput, utilization, and scalability.
• Familiarity with numeric formats, quantization, rounding, and precision/performance tradeoffs.
• Programming, code optimization, or kernel-level performance analysis experience.
• Excellent written and verbal communication skills.
• Familiarity with performance-optimization techniques in large-scale transformer models is a plus.

Schedule

This is a hybrid role based in our Mountain View, CA office, with in-office work Tuesday through Thursday. In exceptional cases, remote work arrangements may be considered.

Pay

The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training. Career length is only a guideline for compensation.

• Early Career - $120,000 - $275,000 + equity
• Mid Career - $175,000 - $450,000 + equity
• Senior Career - $275,000 - $600,000 + equity

Benefits

• Time off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote work
• Health: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively.
• Financial Wellbeing: Choose from Roth IRA/401K (or both) retirement plans with up to 5% company contribution to 401K (even if you don't contribute). Also, 100% company-paid life insurance (up to $300K) and long-term disability insurances.
• Professional Development: $1500 Professional Development Budget (per year)
• Team Meals: Onsite team lunch & dinner Monday - Friday, with your choice of ordering via WeBox, Specialty’s or via our reimbursement system
• Commute: Commute on our company Uber account, or reimburse your train rides. Either way, we pay 100% for your daily commute.
• MatX E[x]tras: $50/mo to use on the perk you value most
• Cell & Internet Reimbursement: $35/mo for cellular and $40/mo for wifi
• Mental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP.
• Support to Parents: Up to 12 weeks paid parental leave regardless of path to parenthood, 10 weeks pregnancy disability leave, flexible return-to-work hours, and Benepass reproductive health & parental benefit.
• AI Resources: Up to $20K/month plus a dedicated internal AI Tooling Team to support your productivity