Back To Jobs New Product Designer, Evals & Prompts… | hitIT
Back To Jobs New Product Designer, Evals & Prompts
9 сентября 2026 г.
Гибрид
Senior
San Francisco
Важно перед откликом
У вакансии есть условия, которые могут повлиять на решение об отклике
Обязательное посещение офиса
Описание
Anthropic builds reliable, interpretable and steerable AI systems. The New Product Designer, Evals & Prompts will design prompts and evaluation tools that keep model behavior aligned with product strategy, safety requirements and user expectations.
Обязанности
Write and revise prompts for Claude’s tools, features and behaviors
Build graders that automate prompt fixes and rerun evaluations
Create visual low‑code evaluation tools usable without engineers
Monitor designers using the tools and simplify their workflow
Support model releases by testing surfaces and writing prompt migrations
Stand up and scale the eval harness across dozens of tools
Package unevaluable prompts into training data for model improvement
Требования
Production‑quality Python programming experience
Experience building evaluation pipelines for large language model products
Experience creating internal low‑code tools for non‑engineers
Experience standing up test harnesses and sandboxing tool calls
Experience shipping prompts and understanding model‑specific behavior
Условия
Hybrid work model with at least 25 % office attendance