Data Science Expert

About the role

We are looking for seasoned data scientists to assist a top-tier AI research firm in assessing how effectively artificial intelligence handles practical data tasks. Instead of building models yourself, you will establish high-quality benchmarks and provide detailed, evidence-based evaluations of work samples produced by AI and humans.

Key facts

What you'll do

• Create specific grading rubrics for data science outputs including models, dashboards, experiment results, and business recommendations.
• Evaluate work samples by assigning scores and writing thorough justifications for your decisions.
• Maintain high standards of consistency so that your assessments remain defensible and reproducible.
• Adjust your evaluation approach based on structured feedback from senior team members.

Requirements

• Minimum of 5 years of professional experience in data science.
• Previous work history in growth, product, or business operations data science at major technology firms.
• Mastery of Python, SQL, A/B testing, experiment design, and presenting insights to executive leadership.
• Excellent writing skills.
• High attention to detail and willingness to have your work calibrated against other experts.

Nice to have

• Previous involvement in AI training, human-in-the-loop data projects, or model evaluation.

Skills & tools

• Python
• SQL
• A/B testing
• Experiment design

Practical notes

• This is an independent contractor position.
• You have the flexibility to set your own schedule.
• Project duration is subject to change based on performance and organizational needs.
• Compensation is paid weekly via Wise or Stripe.
• To apply, submit your resume or a summary of your technical background. You may be required to complete a technical assessment.
• YO IT Consulting provides reasonable accommodations for applicants and considers all candidates regardless of protected characteristics.