Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “Santa Clara; Remote”
Apply on D Matrix's site ↗
Opens the employer's official application page.
Generate a CV for this job
Generate my CV
A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.
About this role
D Matrix is hiring for a Senior Staff Inference Performance Engineer role (full-time). See the official posting for full details.
Requirements
- Experience with LLM serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
- Hands-on experience building or tuning speculative decoding, disaggregated serving, or heterogeneous serving architectures.
- Experience tuning KV-cache management, request and batch scheduling, or weight prefetch and residency in an LLM serving system.
- GPU programming and profiling experience (such as CUDA, Nsight, NCCL), valued as transferable background.
- Experience with pre-production or bring-up hardware, or in organizations where root causes routinely cross team boundaries.
- Rust experience.
- Startup experience or comfort in environments where priorities shift quickly.
Summarized from the employer's posting — check the full posting for every requirement.
New remote jobs for your state, by email.
A short digest only when there's something new. Confirm by email, unsubscribe anytime.