---
license: apache-2.0
---
**Base Model**: BLIP2-t5 pretrained version

**Finetune data**: LLAVA 150k (sample one pair of instruction-answer if multi-round conversations)

**Hyper-parameters**: 

v0:
* lr = 2e-5 --> 0.0 with cosine lr scheduler
* gbs = 32
* image size = 480
* weight decay = 0.05

v1 (same as LLAVA):
* lr = 2e-5
* gbs = 32
* image size = 480
* weight decay = 0.0