m3rad jobs

Research Scientist, Agentic Data & Benchmarking

Ifm Us
On-siteData
Location
United States
Work type
On-site
Salary
Not listed in the posting
Posted
5 months ago
Source
jobs.lever.co
Original language
English

From the original posting

Sunnyvale, CA Key responsibilities Benchmarking & evaluation Design and run evaluations of agentic capabilities — multi-step reasoning, tool use, long-horizon planning, computer use, and safety properties — turning ambiguous notions of "intelligence" into defensible, reproducible metrics. Build and harden evaluation harnesses so benchmarks run reliably at scale against training checkpoints, with clear signal on regressions and model health. Run experiments characterizing how prompting, sampling, scaffolding, and environment design affect agentic performance on internal and public benchmarks.…

Excerpt from the original posting (English). Full details are on the employer site.

m3rad Jobs does not hire and does not represent the employer. The original posting is the reference.

Similar jobs