Who can apply: US-based role. The employer has not said which states are eligible — confirm before applying.
Location as listed by the employer: “San Francisco”
Apply on Harvey's site ↗
Opens the employer's official application page.
Generate a CV for this job
Generate my CV
A CV tailored to this job's requirements in one click — boosted with testimonials from people who know your work.
About this role
Harvey is hiring for a Senior Product Operations Manager, Evaluation Quality role (full-time). See the official posting for full details.
Requirements
- 6+ years in product operations, research operations, evaluation/QA operations, or quality program management
- A track record of owning quality inputs (guidelines, instructions, benchmarks, QA procedures) for complex, expert-driven or human-in-the-loop work
- Experience onboarding, training, and calibrating a distributed pool of expert raters, annotators, or reviewers, and running the feedback loop that improves their quality over time
- Enough grounding in measurement concepts (calibration, inter-rater reliability, sampling, rubric design) to independently set up and own the quality of our evaluation loop yourself
- Experience with running quantitative and qualitative data analyses, interpreting and running statistical tests on evaluation data (natively or with AI tool support), and communicating conclusions to various stakeholders
- A record of scaling and streamlining evaluation quality processes under shipping pressure, with a bias toward documentation and reproducibility over one-off analysis
- Ability to work deeply with domain experts (e.g., ALR / lawyers) and translate nuanced judgment into repeatable, documented standards
- Strong cross-functional coordination across Product, Engineering, Research, ALR, and data providers/vendors
Summarized from the employer's posting — check the full posting for every requirement.
New remote jobs for your state, by email.
A short digest only when there's something new. Confirm by email, unsubscribe anytime.