H
LLM Evaluation Researcher/Benchmarking Engineer (Seattle)
House of Scribes · Times Square, King County · posted 21 Oct 2026
Full-timeIT & Softwareest. 1,14,010 a year
About the job
Budget: $2000 fixed I'm developing a proprietary AI-assisted story evaluation system for film, television and literature. I need an experienced Python/LLM evaluation engineer to implement and stress-test an existing 20-dimension narrative assessment framework. The framework, evaluation protocol and initial global benchmark manifest are already prepared. Responsibilities: - Build a reproducible Python-based LLM evaluation harness. - Prepare and test 16 global benchmark works. - Evaluate eight ad…
Similar jobs
A
Specialist, Software Engineer – IBM ACE & ETL
AB3 Nationwide Life and Annuity Insurance · · 17 Nov 2026
A
Consultant, Software Engineer (DevXP)
AB3 Nationwide Life and Annuity Insurance · · 17 Nov 2026
A
Specialist, Software Engineer (Full Stack)
AB3 Nationwide Life and Annuity Insurance · · 17 Nov 2026
AWS Cloud Engineer
Nemetschek India · Bangalore, Karnataka · 17 Nov 2026
C
Entry Level Software Engineer - Atlanta, GA
CAI Cox Automotive Svcs · Atlanta GA · 17 Nov 2026
(USA) Senior, Machine Learning Engineer
Walmart · (USA) SUNNYVALE TECH CORNERS BLDG 6 CA SUNNYVALE Home Office · 16 Nov 2026
Collected from House of Scribes's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.