RAG Source Relevance Specialist
Quick facts
- Pay
- $12–$18/task
- Type
- Contract
- Location
- Remote
- Platform
- Globik AI — 15 open jobs
- Payout
- Not published by Globik AI
- Apply
- Free to apply — never pay to get AI training work
Globik AI is seeking RAG Source Relevance Specialists to evaluate whether documents, passages, or knowledge-base entries retrieved by an AI system are relevant to a user's question.
You will review queries and retrieved sources, determine whether the content is useful for answering the question, and identify irrelevant, redundant, outdated, or missing information.
Responsibilities
- Review user queries together with retrieved documents or passages.
- Determine whether retrieved sources are relevant to the query.
- Assess whether retrieved content contains information needed to answer the question.
- Identify irrelevant, redundant, outdated, or weak source material.
- Identify missing information needed to support a correct answer.
- Compare retrieved passages with reference documents when provided.
- Evaluate whether retrieval provides sufficient context for generation.
- Categorize retrieval errors using project frameworks.
- Document ambiguous retrieval cases.
- Provide structured feedback to improve retrieval quality.
Pay
$12–$18/task
Apply by 2026-11-09.