Careers.Azx.Io

Senior Software Engineer (AI Inference & Runtime Platform)

Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “Seattle”
Apply on Careers.Azx.Io's site ↗

Opens the employer's official application page.

Generate a CV for this job

A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.

Generate my CV

About this role

Careers.Azx.Io is hiring for a Senior Software Engineer (AI Inference & Runtime Platform) role (full-time). See the official posting for full details.

Requirements

  • 5+ years of shipping production systems in a systems language. Rust is the house language, but polyglots are welcome — deep Go, C/C++, or Zig with genuine appetite for Rust counts. Async runtimes, memory-safety discipli…
  • Operated Kubernetes workloads that other people depended on — controllers or operators, scheduling, autoscaling, node lifecycle. You've been paged, and the experience changed how you build.
  • Strong ability to threat-model isolation boundaries (namespaces, cgroups, seccomp, hypervisors), including identifying what an untrusted guest could observe, forge, or exhaust, and applying security best practices for a…
  • Hands-on experience deploying or operating open-weight LLM serving infrastructure (vLLM/SGLang or similar), including packaging models into reliable, metered production endpoints.
  • Performance discipline in distributed systems: you measure before you optimize, and you can tell the story of a latency you killed with the numbers attached.
  • Practical depth in some of our core stack — Rust (tokio), Python/FastAPI, Kubernetes operators (controller-runtime/Kubebuilder/CRDs), KEDA, Karpenter, GPU device plugins/DRA — with a genuine willingness to research your…
  • Familiarity with isolation technology (Firecracker, Kata, gVisor, or comparable), secrets management and egress control (Vault/KMS-class), and hosting stateful systems (vector stores like pgvector/Qdrant, graph stores l…
  • Comfort operating across cloud and GPU substrates — AWS/Azure/GCP plus managed GPU clouds — using infrastructure-as-code (Terraform/OpenTofu, Bicep) and observability tooling (OpenTelemetry).

Summarized from the employer's posting — check the full posting for every requirement.