About this role
Section: Overview A role for an Evaluation Specialist who is a recent graduate and able to develop original, challenging question-and-answer pairs to test the limits of advanced AI models across diverse subjects. The position involves in-depth research, rigorous source triangulation to ensure accuracy, and creating multi-step questions requiring synthesis and analytical reasoning.
Section: Responsibilities
- Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects.
- Conduct in-depth research, applying rigorous source triangulation to ensure each answer is accurate, comprehensive, and well-documented.
- Create multi-step questions that require synthesis and analytical reasoning — not just single-source lookups.
Section: Requirements
- Proven ability to conduct thorough, independent research and critically evaluate information from multiple sources.
- Exceptional attention to detail and written precision in English (fluency required, but it does not need to be your first language).
- Talent for crafting nuanced and well-structured questions that probe deep understanding.
Section: Apply
- Apply Below
- Link: https://t.co/9wMS2WPAR3
- Note: The posting does not specify additional contact details beyond the link.