Principal Software Engineering (AI Infrastructure) - North America Software Center

About the role

We are seeking a talented and experienced AI Infrastructure Engineer to define and build TSMC's enterprise AI Infrastructure Platform. You will design and lead enterprise-scale AI infrastructure that enables thousands of engineers across multiple global regions to securely develop, deploy, and operate AI applications using both internal and external foundation models.

Responsibilities

• Define AI Platform Architecture.
• Lead the architecture and technical strategy for enterprise AI infrastructure.
• Drive long-term technical direction for:
  • AI Platform,
  • Enterprise AI Gateway,
  • Multi-model inference platform,
  • GPU infrastructure,
  • AI governance,
  • AI observability.
  • Build Enterprise AI Infrastructure:
    • Design highly scalable platforms supporting LLM serving,
    • GPU scheduling,
    • Model routing,
    • Model lifecycle management,
    • RAG infrastructure,
    • Vector databases,
    • AI orchestration.
    • Design Distributed Systems:
      • Lead architecture for high availability AI services,
      • Multi-region deployment,
      • disaster recovery,
      • service mesh,
      • distributed caching,
      • event-driven architecture,
      • global load balancing.
      • AI Platform Engineering:
        • Drive engineering best practices for:
          • Kubernetes,
          • Platform-as-a-Service,
          • AI deployment automation.

          Requirements

          • BS/MS/PhD in Computer Science or related field.
          • 7+ years of software engineering experience.
          • 3+ years leading architecture for distributed systems or cloud infrastructure.
          • 2+ years hands-on experience designing enterprise AI platforms.
          • 1+ years’ experience as a Principal Engineer, Staff Engineer, Distinguished Engineer, or Technical Lead.
          • Strong technical communication skills for collaborating with global cross-functional teams.

          Minimum Requirements

          • Minimum of 3+ years leading architecture for distributed systems or cloud infrastructure.
          • Minimum of 2+ years hands-on experience designing enterprise AI platforms.
          • Minimum of 1+ years’ experience as a Principal Engineer, Staff Engineer, Distinguished Engineer, or Technical Lead.
          • Strong technical communication skills for collaborating with global cross-functional teams.

          Technical Experience

          • AI Infrastructure, strong experience with: LLM inference, Enterprise AI Gateway, AI serving infrastructure, GPU scheduling, Multi-model AI architecture, Model lifecycle management.
          • Experience With Technologies Such As NVIDIA GPU ecosystem, vLLM, TensorRT-LLM, Triton Inference Server, Ray, Kubeflow, MLflow, Cloud Native Infrastructure.
          • Deep expertise With Kubernetes, Docker, Helm, ArgoCD, Service Mesh, AWS, Azure, or GCP.
          • Experience with REST APIs, Microservices, SDKs.

          Eligibility

          Applicants must have legal authorization to work in the United States. We currently cannot provide sponsorship or take over sponsorship of an employment visa. Employment at TSMC is contingent upon passing a background check and drug screening. In compliance with Washington state regulations, cannabis (marijuana) use will not be included in the drug screening.

          Work Location & Schedule

          This position is based on-site at our Vancouver, Washington location during core business hours, Monday through Friday from 8 am to 5 pm. Additional hours may be required to meet project demands.

          Compensation And Benefits

          At TSMC, your base pay is just one component of your comprehensive compensation package. For new hires in this position, the starting salary typically ranges between $137,300 and $183,650 per year. The full salary range for this Job Grade extends from $137,300 - $199,100 depending on factors such as skills, qualifications, education, experience, tenure, and position level. TSMC’s total compensation package also includes market-competitive pay, profit sharing and incentive bonuses, and tuition assistance. Comprehensive benefits include medical, dental, and vision insurance, life insurance, and access to a 401(k) plan with employer match. Employees enjoy 12 holidays per year and accrue paid time off annually. Onsite amenities include a fitness center, game room, physical therapist, and subsidized café.

          EEO Statement

          TSMC Washington, LLC is committed to employing a diverse workforce and provides Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, or any other characteristic protected by applicable law. TSMC is an equal opportunity employer prizing diversity and inclusion. We are committed to treating all employees and applicants for employment with respect and dignity.