Pay rate - $60/hr. to $65/hr. Bill rate
100% Remote
Key Responsibilities:
• Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)
• Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options
• Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs
• Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts
• Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities
• Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Compelling Story & Candidate Value Proposition
Being able to work on a team working to improve products in the client's family continuously.
Job Description:
As an LLM Evaluation Expert specializing in Mathematics, you will play a crucial role in assessing and improving our language models' mathematical capabilities.
Your expertise will be instrumental in evaluating LLM-generated mathematical solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted mathematical problem-solving.
Key Responsibilities:
• Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)
• Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options
• Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs
• Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts
• Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities
• Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Required Qualifications:
• Advanced degree (Ph.D. preferred) in Mathematics, Applied Mathematics, or a closely related field
• Extensive experience (5+ years) in mathematical research, problem-solving, or applied mathematics across multiple subfields
• Demonstrated ability to critically evaluate mathematical proofs, solutions, and reasoning for correctness, efficiency, and elegance
• Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
• Excellent written and verbal communication skills, with the ability to explain complex mathematical concepts clearly
• Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials
Preferred Qualifications:
• Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
• Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
• Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
• Experience in creating or contributing to mathematical textbooks, research papers, or educational content
This role requires a unique blend of mathematical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world mathematical applications.
Your work will directly influence the development of next-generation AI mathematical assistants, potentially transforming fields such as scientific computing, data analysis, and mathematical research.
If you're passionate about mathematics, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing mathematical understanding and problem-solving, we encourage you to apply for this pivotal role at AGI Data Services.
looking for candidates with a very strong Math background.
A bachelors degree in Math or Masters's degree in Math or a similar demonstration of proficiency will be required.
Date Posted: 28 February 2025
Apply for this Job