Lumaai

Software Engineer, Inference

Who can apply: Only open to applicants in: California, New York, Washington.
Location as listed by the employer: “Redwood City, CA; Remote, US; New York, NY; Seattle, WA”
Apply on Lumaai's site ↗

Opens the employer's official application page.

Generate a CV for this job

A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.

Generate my CV

About this role

Lumaai is hiring for a Software Engineer, Inference role (full-time). See the official posting for full details.

Requirements

  • Strong Python and system-architecture skills.
  • Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar.
  • Experience with queues, scheduling, traffic control, and fleet management at scale.
  • Experience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling.
  • Familiarity with Redis and S3-compatible storage.

Summarized from the employer's posting — check the full posting for every requirement.