Job Overview : Generalist – English & Odia (Bilingual AI Evaluation)
| 💰 Salary | $15–$20 per hour |
| 📍 Location | Global (fully remote) |
| 🏢 Company | Mercor |
| 💼 Category | AI Training / Bilingual |
| 🌍 Remote | Yes – your own schedule |
| 📋 Contract Type | Part-time (independent contractor) |
| 💸 Payment | Weekly via Stripe or Wise |
| 🗣️ Languages | Odia (native) + English (strong) |
About the role:
Mercor is hiring native Odia speakers to evaluate AI-generated responses in Odia. You will identify strengths, areas for improvement, and factual inaccuracies. Your feedback will help create the “perfect AI-generated response” in Odia. All analysis and feedback will be written in English.
What you will do:
- Conduct fact-checking using trusted public sources
- Generate high-quality human evaluation data
- Assess reasoning quality, clarity, tone, and completeness
- Identify factual inaccuracies and reasoning errors
- Ensure responses align with expected conversational behavior
What you need:
- Bachelor’s degree (required)
- Native fluency in Odia (must take Bilingual Competency interview in Odia)
- Strong proficiency in English (for writing feedback)
- Significant experience using large language models (LLMs)
- Strong attention to detail and analytical thinking
- Background in research, policy, analytics, linguistics, or engineering
Nice to have (but not required):
- Prior experience with RLHF, model evaluation, or data annotation
- Experience writing or editing high-quality content
- Experience comparing multiple outputs and making qualitative judgments
What success looks like:
- You identify factual inaccuracies, reasoning errors, and communication gaps
- You produce clear, consistent, and reproducible evaluation feedback
- Your feedback leads to measurable improvements in response quality
Important notes:
- Must take Bilingual Competency interview in Odia
- No H1-B or STEM OPT sponsorship available
- You work as an independent contractor
- Weekly payment via Stripe or Wise
Why this job is worth your time:
$15-20/hour to apply your Odia and English skills to cutting-edge AI development, with flexible hours and global remote work.