Business Analyst (Computer Use Agent) - II

Review AI responses and validate information through detailed analysis.

About Turing:
Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities in coding, reasoning, tool use, and multimodality. In coding, Turing is the largest and longest-running data provider in the category. 

Role Overview :

The Business Analyst works on a Computer-Using Agent (CUA) evaluation project designed to assess and improve how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations

Job Responsibilities:

• Analyze, summarize, and structure complex written content clearly and accurately.
• Conduct online research to verify claims, sources, and supporting evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

Job Requirements:

• Demonstrate excellent English communication and reading comprehension skills.
• Apply analytical, logical, critical, and creative thinking to solve complex problems.
• Identify reliable information and distinguish it from inaccurate or unsupported claims.
• Interpret data, identify patterns, compare information, and perform basic calculations.
• Work independently while following detailed instructions, quality standards, and timelines.

Preferred Qualifications:

• Hold or pursue a degree in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or a related field.
• Demonstrate relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar fields.
• Candidates without a bachelor’s degree may also be considered based on relevant experience and demonstrated skills.
• Demonstrate familiarity with Excel, Google Sheets, Google Docs, and Google Workspace.
• Show an interest in artificial intelligence, large language models, online research, and emerging technologies.

Selection Process :

• Please complete the Assessment in the Google Form (You will find the link of the Google form in the application form of this Job)
  • Please use a desktop/laptop to complete the Google form
  • This Google form assessment is of ~45-50 minutes
  • Please complete this form as soon as possible to be considered for the opportunity.
• Candidates who successfully pass our internal assessment review will be considered for this role
  

Project Details:

• Engagement Type: Hourly, long-term engagement.
• Duration: 16 weeks, with potential opportunities for extension.
• Expected Start Date: Around 15 October or nearby dates.

Skills: Business Analysis