Job Overview : Data Science Expert (AI Model Evaluation, Remote)
| 💰 Salary | $120–$170 per hour |
| 📍 Location | Global (fully remote) |
| 🏢 Company | Mercor |
| 💼 Category | Data Science / AI Training |
| 🌍 Remote | Yes – your own schedule |
| 📋 Contract Type | Hourly contract (independent contractor) |
| 💸 Payment | Weekly via Stripe or Wise |
| 👥 Hired this month | 172+ people |
About the role:
Mercor is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
What you will do:
- Design precise, task-specific grading criteria for real-world data science deliverables (analyses, models, dashboards, experiment readouts, and written recommendations)
- Score AI-generated and human work samples against those criteria, with detailed written justifications for every score
- Apply consistent, evidence-based judgment so that scores are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate quickly on your work
What you need:
- 5+ years of professional data science experience in industry
- Background in business operations, product, or growth data science at top-tier technology companies
- Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders
- Exceptionally strong written communication
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers
Nice to have (but not required):
- Prior experience with AI training, evaluation, or human-data projects
Important notes:
- 🌍 Global remote – work from anywhere
- 💰 Premium rate – $120-170/hour for top-tier data scientists
- 📋 Independent contractor – not W-2
- 172+ people hired this month – active, high-demand project
- Focus is on evaluation and criteria design, not production work
Why this job is worth your time:
$120-170/hour to apply your elite data science expertise to define excellence for AI systems, with the flexibility of remote work.