Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,10 @@ datasets:
|
|
| 5 |
|
| 6 |
[replit/replit-code-v1-3b](https://huggingface.co/replit/replit-code-v1-3b) finetuned on [matorus/coder](https://huggingface.co/datasets/matorus/coder).
|
| 7 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
Finetuning format:
|
| 9 |
```
|
| 10 |
{function_defintion}
|
|
|
|
| 5 |
|
| 6 |
[replit/replit-code-v1-3b](https://huggingface.co/replit/replit-code-v1-3b) finetuned on [matorus/coder](https://huggingface.co/datasets/matorus/coder).
|
| 7 |
|
| 8 |
+
**HumanEval scores**: pass@1: 28.7%, pass@10: 43.3%
|
| 9 |
+
<br>
|
| 10 |
+
See [torusresearch/code-eval](https://github.com/torusresearch/code-eval) for evaluation code.
|
| 11 |
+
|
| 12 |
Finetuning format:
|
| 13 |
```
|
| 14 |
{function_defintion}
|