ML Performance Engineer

Company: Tbwa Chiat/Day Inc
Location: Mountain View
Posted on: February 1, 2025

Job Description:

MatX's mission is to make the world's best AI models run as efficiently as allowed by physics, bringing the world years ahead in AI quality and availability. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We are looking for people who are excited about systems-focused ML research.
Responsibilities include:

• 
  
• Build performance models and tooling to validate and guide scheduling decisions for current and future ML models.
  
• Write production-grade libraries for efficient distributed training and serving.
  
• Collaborate with architects, hardware, and software teams to drive solutions from model to metal.
  
  Requirements:
  
  • 
    
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
    
  • Strong programming skills in Python
    
  • Expertise in ML frameworks such as JAX, PyTorch, or Tensorflow.
    
  • Deep knowledge of the Transformer architecture.
    
  • Experience with distributed computing, high performance networking, or large-scale ML systems.
    
    Preferred Skills:
    
    • 
      
    • Hands-on experience with flash attention, quantization, pruning, or other systems performance optimizations.
      
    • Fluency in parallelism strategies that balance computation, communication, and memory to improve throughput and latency of large models.
      
    • Experience with performance analysis tools and profilers for large scale systems.
      
    • Solid understanding of computer architecture and low-level optimization techniques.
      
    • A track record of impactful ML Systems Research, through publication and/or industrial practice.
      
    • Experience in pre-silicon exploration, post-silicon bringup, and fleet debug.
      
      Compensation: The US base salary for this full-time position is $120,000 - $400,000 + equity + benefits.
      As part of our dedication to the diversity of our team and our focus on creating an inviting and inclusive work experience, MatX is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, gender, gender identity, gender expression, sexual orientation, age, physical or mental disability, medical condition, marital/domestic partner status, military and veteran status, genetic information or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances.
      All candidates must be authorized to work in the United States and work from our offices in Mountain View Tuesdays-Thursdays.
      This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicant's capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.
      Apply for this job
      * indicates a required field
      First Name *
      Last Name *
      Email *
      Phone *
      Resume/CV *
      LinkedIn Profile
      Website
      Are you currently authorized to work in the US? * Select...
      Are you available to work from our offices in downtown Mountain View Tuesday-Thursdays? * Select...
      Can you share about a project that you feel is relevant or that you're particularly proud of, and include a link to the repository/Github if available?
      If you have one available, please share a link to a GitHub project that shows your proficiency in torch or jax.
      #J-18808-Ljbffr

Keywords: Tbwa Chiat/Day Inc, Rancho Cordova , ML Performance Engineer, Engineering , Mountain View, California