Inferact

Member of Technical Staff, Inference

Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “Remote”
Apply on Inferact's site ↗

Opens the employer's official application page.

Generate a CV for this job

A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.

Generate my CV

About this role

Inferact is hiring for a Member of Technical Staff, Inference role (full-time). See the official posting for full details.

Requirements

  • Bachelor's degree or equivalent experience in computer science, engineering, or similar.
  • Deep understanding of transformer architectures and their variants.
  • Strong programming skills in Python with experience in PyTorch internals.
  • Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI).
  • Ability to read and implement model architectures and inference techniques from research papers.
  • Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases.
  • Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving.
  • Familiarity with RL frameworks and algorithms for LLMs.

Summarized from the employer's posting — check the full posting for every requirement.