Project Sceptrum - Multilingual AI Coding Evaluation Specialist
Quick facts
- Type
- Contract
- Location
- Netherlands
- Skills
- Coding
- Platform
- Welocalize — 306 open jobs
- Typical pay at Welocalize
- $7–38/hour · median $25 (87 jobs on our site)
- Payout
- Hyperwallet, Bank transfer (weekly invoices, paid 14 days after invoice · reported by workers)
- Apply
- Free to apply — never pay to get AI training work
This role is also open in other regions
Join a short, paid project that tests whether AI coding agents work as well on instructions written in the target language as they do in English. Your language skills and technical background decide where you fit.
About the project
Welo Data is helping evaluate how well AI coding agents perform when the instructions they receive are written in languages other than English. Agents are given a real software engineering task in a code repository, and automated tests check whether they solved it. The code, repositories and tests stay exactly as they are. Only the human-written instructions change language, so the quality of every instruction directly affects the result.
About the roles
There are two roles on this project. We place you in one of them based on your experience& skillsets.
Translator: translate English software engineering task briefs into the target language. You keep every requirement, constraint and success condition, and you leave commands, file paths, API names, code and test conditions exactly as written in English. This role suits people with a stronger technical background, and translation experience is a plus.
Welocalize is a global localization company with a large AI data division. Its remote roles include search and ad quality raters, linguists, transcribers and evaluators for AI-generated content.