Frontier AI Benchmark Research Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
HUD in San Francisco seeks Research Engineers to build high-quality benchmarks for evaluating frontier agents on domain-specific tasks. You will own the design of HUD's internal agent benchmarks and work with experts to define tasks that mirror realistic workflows. You will develop infrastructure to run models and agents against benchmarks, create metrics to assess difficulty and failure modes, and ensure results align with real-world needs and lab expectations, with clear documentation and #J-18808-Ljbffr