Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “Palo Alto”
Apply on Elorian Ai Inc's site ↗
Opens the employer's official application page.
Generate a CV for this job
Generate my CV
A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.
About this role
Elorian Ai Inc is hiring for a Inference Infrastructure Engineer, Serving role (full-time). See the official posting for full details.
Requirements
- 3+ years of experience building low-latency, high-throughput inference serving systems for large models
- Strong knowledge of inference optimization techniques (quantization, batching, speculative decoding, KV cache management)
- Hands-on experience with serving frameworks such as vLLM, TensorRT-LLM, Triton, or SGLang
- Experience with multi-GPU/multi-node model parallelism for serving (tensor or pipeline parallel)
- Strong systems programming skills; C++/CUDA a plus alongside Python
- Experience with autoscaling and load balancing for production ML services
- A track record of GPU cost optimization at scale
- Experience serving multimodal (vision + language) models
Summarized from the employer's posting — check the full posting for every requirement.
New remote jobs for your state, by email.
A short digest only when there's something new. Confirm by email, unsubscribe anytime.