# GAIA

**Repository Path**: wowai/GAIA

## Basic Information

- **Project Name**: GAIA
- **Description**: https://github.com/aymeric-roucher/GAIA.git
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2025-09-06
- **Last Updated**: 2025-09-06

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Beating GAIA with Transformers Agents 🚀

This is the exact code used for our submission that scores #2 on the test set, #1 on the validation set.

![GAIA leaderboard screenshot](figures/leaderboard.png)

Check out the current leaderboard [here](https://huggingface.co/spaces/gaia-benchmark/leaderboard).

### How to run tests?

First, install requirements:
```bash
pip install -r requirements.txt
```

Setup your secrets in a `.env`file:
```bash
HUGGINGFACEHUB_API_TOKEN
SERPAPI_API_KEY
OPENAI_API_KEY
ANTHROPIC_API_KEY
```

And optionally if you want to use Anthropic models via AWS bedrock:
```bash
AWS_BEDROCK_ID
AWS_BEDROCK_KEY
```

Then run `gaia_multiagent.py` to launch tests!

### Head to smolagents for a better version!

We've mnaged to increase score to 55% using the new framework smolagents!
Head to [this folder in smolagents](https://github.com/huggingface/smolagents/tree/main/examples/open_deep_research) to find a more recent run on GAIA, with better scores than this one!