Data Engineer II

Seattle, Washington

Intelliswift
Apply for this Job
Pay rate - $60/hr. to $65/hr. Bill rate
100% Remote

Key Responsibilities:

• Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)

• Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options

• Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs

• Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight

• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts

• Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities

• Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Compelling Story & Candidate Value Proposition
Being able to work on a team working to improve products in the client's family continuously.

Job Description:
As an LLM Evaluation Expert specializing in Mathematics, you will play a crucial role in assessing and improving our language models' mathematical capabilities.
Your expertise will be instrumental in evaluating LLM-generated mathematical solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted mathematical problem-solving.

Key Responsibilities:

• Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)

• Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options

• Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs

• Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight

• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts

• Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities

• Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge

Required Qualifications:

• Advanced degree (Ph.D. preferred) in Mathematics, Applied Mathematics, or a closely related field

• Extensive experience (5+ years) in mathematical research, problem-solving, or applied mathematics across multiple subfields

• Demonstrated ability to critically evaluate mathematical proofs, solutions, and reasoning for correctness, efficiency, and elegance

• Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts

• Excellent written and verbal communication skills, with the ability to explain complex mathematical concepts clearly

• Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials

Preferred Qualifications:

• Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving

• Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages

• Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving

• Experience in creating or contributing to mathematical textbooks, research papers, or educational content

This role requires a unique blend of mathematical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world mathematical applications.
Your work will directly influence the development of next-generation AI mathematical assistants, potentially transforming fields such as scientific computing, data analysis, and mathematical research.
If you're passionate about mathematics, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing mathematical understanding and problem-solving, we encourage you to apply for this pivotal role at AGI Data Services.

looking for candidates with a very strong Math background.
A bachelors degree in Math or Masters's degree in Math or a similar demonstration of proficiency will be required.

Date Posted: 28 February 2025
Apply for this Job