Mathematical Reasoning Expert · Remote

Commitment: 40 hours/week, with at least 4 hours overlap during PST business hours

Role Responsibilities

• Design and solve challenging Mathematics problems that test the reasoning and problem-solving capabilities of large language models.
• Create clear, high-quality, step-by-step solutions with detailed and well-structured reasoning.
• Develop novel mathematical scenarios that evaluate complex reasoning pathways and identify areas where AI models struggle.
• Provide detailed annotations and constructive feedback to improve model performance and evaluation quality.

Requirements

• PhD in Mathematics or an equivalent technical field with strong analytical, research, and problem-solving skills.
• Strong foundation in Mathematics, spanning advanced undergraduate through graduate and PhD-level concepts.
• Ability to break down complex mathematical concepts into clear, structured, step-by-step reasoning.
• Strong written communication skills with the ability to provide detailed feedback and annotations.
• Prior experience in AI evaluation, data annotation, content review, quality assurance, mathematical research, or related analytical roles is preferred.