Feature Request: Make Adapter/ Delta Models specify both its and the base model's commit

#957
by CombinHorizon - opened

the commit field seems less clear if it's a adapter/delta model

  • ?: does it mean itself, or is it for the base model? and for that field, how then do you specify both?

also it seems right to list both, for good versioning documentation.

Perhaps a semicolon or comma delimited field for those situations, such as
{adapter/delta commit};{base model commit}

Open LLM Leaderboard org

Hi @CombinHorizon ,

Currently, if you submit an adapter or delta model, please, provide a commit of a model you want to evaluate, not the base model. For the base model we currently use the main commit. We will consider to update this system later, to make it more clear

Sign up or log in to comment