---
base_model: unsloth/mistral-7b-v0.3-bnb-4bit
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- mistral
- trl
- legal
datasets:
- hugsid/legal-contracts
metrics:
- bertscore
- perplexity
- rouge
library_name: transformers
pipeline_tag: text-generation
---
# About

Best Summer School Project, IIIT Hyderabad - Jul 2024

Awarded 2nd place for Continued Pre-training of LLM on Legal Contracts - LLM Domain Adaptation project at Summer School on NLP, IIIT Hyderabad.

Slide deck of the presentation is linked [here](https://1drv.ms/p/s!Aoy5GE6lUEKygbYU2-ZCFVsI5Kiawg?e=pREbff).

![image/png](https://cdn-uploads.huggingface.co/production/uploads/64b97d7bf602541ef75e9d18/Gng-MI5hRICq0Sea1vpLv.png)

# Uploaded  model

- **Developed by:** kirankunapuli
- **License:** apache-2.0
- **Finetuned from model :** unsloth/mistral-7b-v0.3-bnb-4bit

This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)