Step 2 of 4

Expert Vetting

30-minute deep-dive interviews to verify domain expertise

Live verification

Only verified experts touch your data

Every expert undergoes a 30-minute live interview with biometric verification. We test actual domain knowledge, not resumes or credentials alone.

Live video with screen sharing required
Real-world problem solving, not multiple choice
Biometric identity verification
The Oracle Interview
8-phase adaptive assessment
1
Identity Verification
2 min
2
Background Check
3 min
3
Domain Fundamentals
5 min
4
Real-World Scenario
8 min
5
Edge Case Handling
5 min
6
Explanation Quality
4 min
7
Speed Assessment
2 min
8
Final Scoring
1 min

What we evaluate

Domain expertise

Can they solve real problems in their field? We present actual failed prompts from our queue.

• Depth of knowledge
• Problem-solving approach
• Ability to explain reasoning

Communication quality

Can they articulate why a response is wrong and how to fix it? Quality rubrics require clear explanation.

• Clarity of explanation
• Teaching ability
• Technical writing

Speed & accuracy

Can they work efficiently without sacrificing quality? We measure both speed and correctness.

• Time to solution
• First-pass accuracy
• Attention to detail

Weight of Evidence (WoE) Scoring

Our AI interviewer assigns a WoE score based on 20+ factors. This determines your initial tier and earning potential.

3
Tier 3
Standard
WoE Score: 60-79
$2-4
per prompt
2
Tier 2
Verified
WoE Score: 80-89
$5-8
per prompt
1
Tier 1
Gold Standard
WoE Score: 90+
$10-15
per prompt

Security & verification

Biometric enrollment

Face scan and identity verification during interview. This becomes your permanent profile for all future sessions.

Prevents account sharing and ensures every correction is traceable to a verified individual.

Recording & audit trail

Full interview recorded and analyzed by our AI grader. Helps us improve the vetting process and detect fraud.

Recordings are encrypted and stored for 90 days for quality assurance purposes.
12%
Pass rate
30m
Average interview
2,400+
Verified experts
97%
Quality retention

Why rigorous vetting matters

Your training data is only as good as the humans who verify it. A low-quality expert produces low-quality corrections, which poison your model. We reject 88% of applicants to maintain the highest data quality standards in the industry.

Without vetting
• Anyone can claim expertise
• No accountability for errors
• Data quality varies wildly
• Models learn from mistakes
With RawEval vetting
• Proven domain expertise
• Tracked quality scores
• Consistent high accuracy
• Gold standard corrections