AI Research Engineer - USA (Google DeepMind RE-Bench Project)

Research Engineer (AI Evaluation & Benchmarking) – Google DeepMind RE-Bench Project

About the Opportunity

We are hiring experienced Research Engineers, AI Researchers, Machine Learning Engineers, Applied Scientists, and Research Scientists to contribute to a cutting-edge AI evaluation initiative supporting the Google DeepMind RE-Bench Project.

The project focuses on developing the next generation of AI evaluation benchmarks by creating challenging, real-world research engineering tasks that assess the capabilities of advanced AI systems.

This is a unique opportunity to work on frontier AI research alongside leading researchers and help shape the future of AI evaluation.

What You'll Do

As a Research Engineer (RE) Curator, you will design, implement, and review complex, multi-step research tasks that simulate real-world machine learning and software engineering challenges.

Your responsibilities will include:

• Design challenging research engineering tasks for advanced AI systems.

• Implement solutions using Python and modern software development tools.

• Plan, execute, and analyze machine learning experiments.

• Perform statistical analysis and interpret experimental results.

• Create reproducible research workflows using Jupyter Notebook or Google Colab.

• Evaluate AI system performance through structured benchmarking and testing.

• Collaborate closely with researchers in an iterative feedback environment.

• Document findings and produce high-quality technical reports.

Required Qualifications

Education

• MSc or PhD in a STEM discipline such as:

  • Computer Science

  • Artificial Intelligence

  • Machine Learning

  • Data Science

  • Statistics

  • Mathematics

  • Physics

  • Computational Science

  • Engineering

• Equivalent research-intensive experience involving coding, experimentation, and data analysis will also be considered.

Professional Experience

• 1+ years of experience in one or more of the following roles:

  • Research Engineer

  • Research Scientist

  • Applied Scientist

  • Machine Learning Engineer

  • AI Researcher

  • Data Scientist

  • Software Engineer (ML/AI)

• Experience working on research, experimentation, or AI development projects.

Required Technical Skills

Programming

• Strong Python programming skills

• Code debugging and software development best practices

Software Engineering

• Git version control

• Modern IDEs (VS Code, PyCharm, etc.)

• Clean, maintainable code

Machine Learning & AI

• Machine Learning fundamentals

• Model training and evaluation

• Large Language Models (LLMs)

• AI experimentation

• Prompt engineering or AI agent workflows

• Understanding of AI coding assistants is a plus

Data Science

• Data analysis and visualization

• Statistical analysis

• Data cleaning and interpretation

• Jupyter Notebook / Google Colab

Research & Experimentation

• Experimental design

• Scientific methodology

• Hypothesis testing

• Research documentation

• Analytical problem-solving

Preferred Qualifications

Candidates with experience in any of the following will be highly preferred:

• AI Evaluation

• Benchmark Development

• LLM Evaluation

• AI Red Teaming

• Reinforcement Learning (RL)

• Test Engineering

• Quality Assurance for AI systems

• Research publications in AI, ML, Data Science, or related fields

• Experience working with Research Scientists on experimental projects

What We're Looking For

The ideal candidate demonstrates:

• Strong research mindset

• Exceptional attention to detail

• Creativity in solving open-ended technical problems

• Ability to work independently with minimal supervision

• Comfort working in ambiguous, research-driven environments

• Excellent written and spoken English communication skills

Ensure you submit resume covering:

• Research experience

• Publications (if any)

• AI/ML expertise

• Python coding background

• Experience with AI evaluation, benchmarking, testing, or LLM red teaming

• Relevant research engineering or experimentation projects

Why Join?

• Work on a frontier AI research program supporting Google DeepMind.

• Contribute to the development of next-generation AI evaluation benchmarks.

• Solve challenging real-world research engineering problems.

• Collaborate with world-class AI researchers.

• Competitive hourly compensation with a flexible remote work model.

We are actively reviewing applications and moving quickly. Qualified candidates are encouraged to apply as soon as possible.

Guidelines

Truelancer AI verifies each project before posting. Apply on Truelancer AI; never pay to get work.