H

LLM Evaluation Researcher/Benchmarking Engineer

House of Scribes · Seattle, King County · posted 20 Oct 2026
Full-timeIT & Softwareest. 1,11,746 a year

About the job

Budget: $2000 fixed I'm developing a proprietary AI-assisted story evaluation system for film, television and literature. I need an experienced Python/LLM evaluation engineer to implement and stress-test an existing 20-dimension narrative assessment framework. The framework, evaluation protocol and initial global benchmark manifest are already prepared. Responsibilities: - Build a reproducible Python-based LLM evaluation harness. - Prepare and test 16 global benchmark works. - Evaluate eight ad…

Read the full description on House of Scribes's site ↗

Skills

Upload your CV on LitCareer to see which of these you match.

Similar jobs

(USA) Senior, Machine Learning Engineer
Walmart · (USA) SUNNYVALE TECH CORNERS BLDG 6 CA SUNNYVALE Home Office · 16 Nov 2026
Senior Machine Learning Graphics Engineer, AI for Experiences
Nvidia · US, CA, Santa Clara · 16 Nov 2026
D
Product Manager, Filtration
Devicor Medical Products · Marlborough, Massachusetts, United States · 16 Nov 2026
Mission Systems Software Chief Architect
Boeing · USA - Berkeley, MO · 16 Nov 2026
MQ-25 Core Avionics & Sensors Engineering Manager L
Boeing · USA - Hazelwood, MO · 16 Nov 2026
Software Engineer–Developers (Associate / Experienced / Senior)
Boeing · USA - El Segundo, CA · 16 Nov 2026

Collected from House of Scribes's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.