LLM Evaluation Expert - Domain: Biology

Company: Aditi Consulting
Location: Bellevue
Posted on: May 14, 2025

Job Description:

Payrate: $50.00 - $51.00/hr.

The following information aims to provide potential candidates with a better understanding of the requirements for this role.

Job Location: Remote

Summary:

This role requires a unique blend of Biology expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world applications in Biology. Your work will directly influence the development of next-generation AI Biology assistants, potentially transforming fields such as scientific computing, data analysis, and Biology research.

If you're passionate about Biology, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing the understanding of Biology we encourage you to apply for this pivotal role at AGI Data Services.



Key Responsibilities:

Critically analyze and evaluate Biology responses generated by our LLMs across various fields of Biology
Exercise expert judgment to select the most appropriate and efficient Biology solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous Biology standards, are logically sound, and address specific research or application needs
Develop and write Biology demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Biology concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities
Stay abreast with the latest developments in Biology and AI to ensure our evaluations remain cutting-edge
Using your expertise, to provide step-by-step solutions and explanations to complex problems in Biology. This includes inductive/deductive reasoning, experimental design, data interpretation, and systems-level thinking.



Required Qualifications:

Advanced degree (Ph.D. preferred) in Biology or a closely related field
Extensive experience (5+ years) in Biology research, problem-solving, or applied Biology across multiple subfields
Demonstrated ability to critically evaluate Biology proofs, solutions, and reasoning for correctness, efficiency, and elegance
Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
Excellent written and verbal communication skills, with the ability to explain complex Biology concepts clearly
Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials



Preferred Qualifications:

Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
Experience in creating or contributing to Biology textbooks, research papers, or educational content.





Pay Transparency: The typical base pay for this role across the U.S. is: $50.00 - $51.00/hr. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience and the benefits package you select. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, 10 paid days off, 401(k) plan participation, commuter benefits and life and disability insurance.



For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our Privacy Policy (https://www.aditiconsulting.com/privacy policy).



Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human based decision making in employment decisions. By applying for this position, you agree to Aditi's use of AI technology, including calls from an AI Voice Recruiter.

Keywords: Aditi Consulting, Bellevue , LLM Evaluation Expert - Domain: Biology, Other , Bellevue, Washington