D Matrix

Staff Test & Release Engineer, Inference Cloud

Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “Santa Clara”
Apply on D Matrix's site ↗

Opens the employer's official application page.

Generate a CV for this job

A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.

Generate my CV

About this role

D Matrix is hiring for a Staff Test & Release Engineer, Inference Cloud role (full-time). See the official posting for full details.

Requirements

  • Experience testing or releasing LLM serving systems such as vLLM, SGLang, or TensorRT-LLM, including accuracy evals (such as GSM8K, HumanEval, MMLU) and performance benchmarks as release gates.
  • Familiarity with speculative decoding, disaggregated serving, or heterogeneous inference.
  • Hardware-in-the-loop testing experience, including qualifying software across driver, firmware, and hardware versions.
  • Experience with operator and controller testing tools such as envtest, kuttl, or chainsaw, and with upgrade and CRD version-migration testing.
  • Experience shipping software into customer-managed, on-premises Kubernetes environments, including compatibility matrices and customer install packaging.
  • Experience with canary or progressive rollouts for customer-facing services.
  • Rust experience.
  • Startup experience or comfort in environments where priorities shift quickly.

Summarized from the employer's posting — check the full posting for every requirement.