Quick facts
- Pay
- $10–$16/task
- Type
- Contract
- Location
- Remote
- Platform
- Globik AI — 100 open jobs
- Payout
- Not published by Globik AI
- Apply
- Free to apply — never pay to get AI training work
Globik AI is seeking Search Query–Result Relevance Specialists to evaluate whether search results genuinely match what users are looking for.
The role focuses on reviewing queries alongside returned results, judging relevance and usefulness, identifying weak or irrelevant results, and providing consistent ratings that help improve search systems.
Responsibilities
- Review user search queries and returned search results.
- Determine whether each result directly addresses the user's intent.
- Rate results according to relevance, usefulness, freshness, and project criteria.
- Identify unrelated, partially relevant, misleading, duplicate, or low-quality results.
- Distinguish genuinely useful results from results that only share keywords with the query.
- Consider ambiguity and likely user expectations when making judgments.
- Apply project-specific relevance guidelines consistently.
- Document difficult or ambiguous cases and escalate them when required.
- Maintain accuracy across large evaluation batches.
- Participate in calibration and quality-review sessions.
Qualifications
- Strong reading comprehension and analytical judgment.
- Excellent attention to detail.
- Experience in search evaluation content review QA research or AI evaluation is a plus.
- Ability to understand search queries and determine user intent.
- Maintain high accuracy and consistency across assigned evaluation tasks.
- Follow project-specific search evaluation rubrics precisely.
- Participate in training and calibration exercises when required.
- Regular quality reviews may be conducted throughout the project.
Pay
$10–$16/task