Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “San Francisco, NYC, or Fully Remote”
Apply on Office Hours's site ↗
Opens the employer's official application page.
Generate a CV for this job
Generate my CV
A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.
About this role
Office Hours is hiring for a Software Engineer- Benchmarking role (full-time). See the official posting for full details.
Requirements
- Solid engineering skills: 4+ years of professional experience building and maintaining complex systems, with strong Python. You write robust, maintainable code and are comfortable diving deep into existing codebases and…
- Data rigor: Experience preparing, cleaning, and maintaining datasets, and the care to make sure two results are genuinely comparable.
- Comfort with containers and environments: Experience with Docker and building reproducible execution environments.
- Collaborative: You work well alongside researchers and scientists and can translate their methodology into working systems.
- Experience fine-tuning or post-training open-source LLMs, or other hands-on machine learning work
- Experience with agentic, multi-turn, long-context, or tool-use evaluation
- Experience validating LLM-as-judge or rubric-based grading setups
- Background or strong interest in a scientific or technical domain
Summarized from the employer's posting — check the full posting for every requirement.
New remote jobs for your state, by email.
A short digest only when there's something new. Confirm by email, unsubscribe anytime.