Hugging Face's logo

rhymes-ai
/
Aria

Text Generation
Transformers
Safetensors
English
aria
multimodal
conversational
custom_code
Model card Files Community
2
JunnanLi commited on
Commit
ba771dc
•
1 Parent(s): cf92ada

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -37,11 +37,11 @@ tags:
37
 
38
  ## Benchmark
39
  | Category | Benchmark | Aria | Pixtral 12B | Llama3.2 11B | GPT-4o mini | Gemini-1.5 Flash |
40
- |-------------------------------------|-------------------|--------|-------------|--------------|-------------|------------------|
41
- | **Knowledge (Multimodal)** | MMMU | 54.9 | 52.5 | 49.6 | 59.4 | 56.1 |
42
- | **Math (Multimodal)** | MathVista | 66.1 | 58.0 | 51.5 | - | 63.8 |
43
  | **Document** | DocQA | 92.6 | 90.7 | 84.4 | - | 89.9 |
44
- | **Chart** | ChartQA | 86.4 | 81.8 | 78.7 | - | 85.4 |
45
  | **Scene Text** | TextVQA | 81.1 | - | - | - | 78.7 |
46
  | **General Visual QA** | MMBench-1.1 | 80.3 | - | - | 76.0 | - |
47
  | **Video Understanding** | LongVideoBench | 66.6 | 47.4 | 45.7 | 58.8 | 62.4 |
 
37
 
38
  ## Benchmark
39
  | Category | Benchmark | Aria | Pixtral 12B | Llama3.2 11B | GPT-4o mini | Gemini-1.5 Flash |
40
+ |:-------------------------------------|:-------------------|:--------:|:-------------:|:--------------:|:-------------:|:------------------:|
41
+ | **Knowledge (Multimodal)** | MMMU | 54.9 | 52.5 | 50.7 | 59.4 | 56.1 |
42
+ | **Math (Multimodal)** | MathVista | 66.1 | 58.0 | 51.5 | - | 63.9 |
43
  | **Document** | DocQA | 92.6 | 90.7 | 84.4 | - | 89.9 |
44
+ | **Chart** | ChartQA | 86.4 | 81.8 | 83.4 | - | 85.4 |
45
  | **Scene Text** | TextVQA | 81.1 | - | - | - | 78.7 |
46
  | **General Visual QA** | MMBench-1.1 | 80.3 | - | - | 76.0 | - |
47
  | **Video Understanding** | LongVideoBench | 66.6 | 47.4 | 45.7 | 58.8 | 62.4 |