Job Description
We are sharing a specialised part-time consulting opportunity for PhD-level mathematicians interested in contributing to the evaluation and improvement of advanced AI systems.
This role supports collaborations with leading AI labs focused on improving how conversational AI models reason about mathematical concepts, proofs, and problem-solving processes.
Experts will evaluate AI-generated responses to mathematical questions, ensuring rigorous reasoning, conceptual accuracy, and clear explanations aligned with academic mathematical standards.
Key Responsibilities
Write and refine prompts to guide AI model behavior in mathematical contexts
Evaluate AI-generated responses for correctness, logical consistency, and rigor
Verify mathematical claims, derivations, and proofs using domain expertise
Conduct fact-checking using authoritative mathematical sources
Annotate model responses by identifying strengths, weaknesses, and inaccuracies
Assess clarity, structure, and pedagogical quality of explanations
Apply structured evaluation guidelines and benchmarking standards
Ensure model responses align with expected reasoning quality and system guidelines
Ideal Profile
Strong candidates will have:
PhD in Mathematics or a closely related field
Expertise in one or more areas such as:
Probability & Statistics
Algebra & Number Theory
Calculus & Analysis
Geometry & Topology
Discrete Mathematics, Logic & Computation
Additional qualities include:
Experience working with large language models (LLMs)
Excellent technical writing and explanation skills
Strong analytical reasoning and mathematical rigor
Ability to identify subtle conceptual or logical issues in mathematical arguments
Location Requirements
Candidates should be based in one of the following regions:
United States
United Kingdom
Canada
European Union
Nice-to-Have Experience
Experience with RLHF, model evaluation, or AI data annotation
Experience teaching or mentoring mathematics
Familiarity with evaluation rubrics or structured review frameworks
Experience reviewing or editing academic or technical writing
Why This Opportunity
Contribute directly to improving the mathematical reasoning of advanced AI systems
Apply deep theoretical expertise to real-world AI development
Work with cutting-edge AI research teams
Flexible remote work with competitive compensation
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Compensation: $73.29/hr
Weekly payments via Stripe or Wise
Projects may extend depending on performance and project needs
About the Platform
This opportunity is available through a leading AI-driven work platform.
...is seeking skilled and dedicated teachers to lead a three-week Summer Academy designed to boost student achievement and close learning... ...and deliver grade-level curriculum in the subject area. Use school-identified key standards to drive acceleration and remediation....
...Job Opportunity Pay: From $20.00 per hour Job description: Pay rate: up to $20.00hr + uncapped commission Read this first: If you're good at sales and tired of: Income caps Micromanagement Selling boring products, you don't believe in Having...
...Description Summary The Facility Operations Technician is responsible for ensuring the efficient and safe operation of all facility... ...manufacturing. This role involves performing routine maintenance, troubleshooting, and repairs of machinery, HVAC, electrical,...
...Golf Maintenance-Landscaping Crew at Moonlight Basin Moonlight Club LLC d/b/a Moonlight Basin, located in Big Sky, Montana, seeks twenty-five (25) full-time, temporary Golf Maintenance-Landscaping Crew who will be responsible for maintaining golf course and club grounds...
...cosmetologistavailable. To apply to our salon or learn more, text Holly at (***) ***-**** Your Tips Matter Now, thanks to an industry-wide effort championed by Sport Clips, you can deduct up to $25,000 of your tips, keeping more of what you earn. Were proud to...