Principal Architect, Performance Analysis and Modeling
The Role
d-Matrix is seeking a Principal Software Engineer, Performance Analysis and Modeling to join our team. This role focuses on analyzing and modeling performance across the hardware/software boundary of our AI inference accelerators, particularly with emerging hardware technologies like DIMC, D2D, and 3D-DRAM, and emerging workloads such as generative inference and multi-modal Large Language Models (LLMs).
What You Will Do
- Analyze emerging ML workloads, multi-modal LLMs, CoT reasoning models, and video/audio generation to identify performance-relevant properties.
- Build and maintain analytical performance models that project behavior on current and future d-Matrix hardware generations.
- Develop and extend architecture simulators to support performance analysis of proposed HW/SW features.
- Partner with hardware design, compiler, inference server, kernel, and product teams to validate modeling assumptions and surface downstream implications.
- Track relevant ML architecture and algorithms research and incorporate findings into modeling work.
- Propose targeted HW/SW feature improvements based on modeling results and workload analysis.
- Document modeling methodology and findings for reuse across the architecture team.
What You Will Bring
- BSEE with 6+ years of industry experience, or MSEE with 4+ years of industry experience.
- Working knowledge of computer architecture, HW/SW co-design, performance modeling, and ML fundamentals (particularly DNNs).
- Programming fluency in C/C++ or Python.
- Experience building or working with analytical performance models or architecture simulators.
- Self-motivated and collaborative, comfortable working across hardware and software teams.
Preferred Qualifications
- Experience optimizing AI/ML workloads on accelerator technologies.
- Research and investigation in AI/ML architecture/microarchitecture.
Equal Opportunity Employment Policy
d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We're committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.