Data Model Quality Analyst Job at Russell Tobin, San Jose, CA

U3M5TWpZWFBzOFBsNStXUjdVb2NwMjlYZkE9PQ==
  • Russell Tobin
  • San Jose, CA

Job Description

Russell Tobin & Associates is currently seeking a Hybrid Data Model Quality Analyst to work for our client in the AI/tech industry. Apply now for consideration!

Contract: W2, 6- Months

Location: Hybrid | Tues–Thurs On-site in San Jose, CA

Pay Range: $75-85/Hour depending on experience

Responsibilities:

  • Ensure data quality during task development for human-created content used in training Large Language Models (LLMs).
  • Define detailed data requirements based on model goals and analysis of model loss patterns.
  • Design high-quality, nuanced instructions for expert content creators with illustrative examples.
  • Rapidly iterate with content-production vendors to improve data quality in small batch reviews.
  • Develop benchmark datasets to assess and validate data quality.
  • Benchmark vendor outputs against competitor models using both quantitative and qualitative methods.
  • Analyze data from vendor teams and optimize rater pools for quality.
  • Audit datasets, identify quality issues, and help develop tools to streamline data review processes.
  • Use experimentation to demonstrate data impact and uncover model blind spots.
  • Generate regular stakeholder reports on data quality metrics, iteration times, and vendor performance.
  • Author and maintain best practices documentation and instructional guidelines.

Requirements:

  • Bachelor’s degree in English, Creative Writing, Linguistics, Science, Computer Science, or a related field.
  • 3+ years of experience in Technical Writing, Quality Assurance, or a related field.
  • Excellent writing and editing skills with adaptability to varied styles and tones.
  • Strong analytical and problem-solving skills.
  • Ability to work independently and collaboratively across technical and non-technical teams.

Preferred Qualifications:

  • PhD in a relevant field (English, Linguistics, Computer Science, etc.)
  • 5+ years experience in relevant roles with exposure to LLM development or content creation at scale.
  • Experience with data benchmarking, quality auditing, or content vendor management.
  • Familiarity with model evaluation techniques and qualitative dataset analysis.

Russell Tobin / Pride Global offers eligible employees comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance, and hospital indemnity), a 401(k)-retirement savings plan, life & disability insurance, an employee assistance program, identity theft protection, legal support, auto and home insurance, pet insurance, and employee discounts with preferred vendors.

#LI-JJ2

Job Tags

Contract work,

Similar Jobs

CLAE SOLUTIONS

Sales & Account Management Role - Renewable Energy Job at CLAE SOLUTIONS

 ...Identify and pursue new sales opportunities through door-to-door and retail channels. # Close Sales: Present and sell our community solar and third-party energy solutions to potential customers. # Build Relationships: Develop and maintain strong relationships with... 

Walmart

Warehouse Associate Job at Walmart

**Job Summary:** As a Warehouse Associate at Walmart, you will play a crucial role in the efficient operation of the distribution center or warehouse. Your responsibilities will include receiving, storing, picking, packing, and shipping merchandise to Walmart stores... 

Keurig Dr Pepper

Relief Sales Manager Job at Keurig Dr Pepper

 ...Job Overview: Relief Sales Manager for Greater Lakewood and Longmont, CO Hiring Immediately The Relief Sales Manager is responsible for up-selling and fulfillment/replenishment, focusing on execution and merchandising. This person will be accountable for retention... 

ServiceNow, Inc.

Product Designer - Emerging Talent Intern (July 2025 - December 2025) Job at ServiceNow, Inc.

 ...backgrounds and cultures. This diversity inspires passion and creativity among our teams and propels innovation in our products. This role is part of our Product Design team that uses their superpower of empathizing, understanding, and applying our users' and customers' needs,... 

Avera Health

Behavioral Health Technician II | Behavioral Health Child Unit Job at Avera Health

 ...Adolescent & Child Units are designed to be a structured and age-appropriate therapeutic environment for adolescents and...  ...Nurse that: Enjoys working with children ages 5 to 12 years old and adolescent ages 13 to 17 years old as well as their families. Has a passion...