SmolLM models in MLC, ONNX and GGUF format for local applications + in-browser demos
Hugging Face TB Research
Enterprise
community
AI & ML interests
Exploring synthetic datasets, generated by Large Language Models (TB is for Textbook, as inspired by the "Textbooks are all your need" paper)
Organization Card
HuggingFaceTB
This is the home of synthetic datasets for pre-training, such as Cosmopedia v1 and v2. We're trying to scale synthetic data generation by curating diverse prompts that cover a wide range of topics and efficiently scaling the generations on GPUs with tools like llm-swarm.
We released:
- Cosmopedia: the largest open synthetic dataset, with 25B tokens and more than 30M samples. It contains synthetic textbooks, blog posts, stories, posts, and WikiHow articles generated by Mixtral-8x7B-Instruct-v0.1.
- Cosmo-1B a 1B model trained on Cosmopedia.
- FineWeb-Edu: a filtered version of FineWeb dataset for educational content
- SmolLM models: a series of strong small models in three sizes: 135M, 360M and 1.7B
- Smollm-Corpus: the pre-training corpus of SmolLM models including Cosmopedia v0.2, FineWeb-Edu and Python-Edu.
For more details check our blog posts: https://huggingface.co/blog/cosmopedia and https://huggingface.co/blog/smollm
models
27
HuggingFaceTB/classifier-typescript-clip-500k
Updated
•
26
HuggingFaceTB/classifier-php-clip-500k
Updated
•
19
HuggingFaceTB/classifier-javascript-clip-500k
Updated
•
30
HuggingFaceTB/classifier-llama3-python-new-100
Updated
•
5
HuggingFaceTB/classifier-swift-clip-500k
Updated
•
16
HuggingFaceTB/classifier-rust-clip-500k
Updated
•
10
HuggingFaceTB/classifier-csharp-clip-500k
Updated
HuggingFaceTB/classifier-c-clip-500k
Updated
•
4
HuggingFaceTB/classifier-cpp-clip-500k
Updated
HuggingFaceTB/SmolLM-135M-Instruct
Text Generation
•
Updated
•
16.2k
•
89
datasets
30
HuggingFaceTB/mcf-qa-prompt-explanation
Viewer
•
Updated
•
2.26k
•
1
HuggingFaceTB/alpaca_eval_details
Viewer
•
Updated
•
3.22k
•
4
HuggingFaceTB/smollm-corpus
Viewer
•
Updated
•
237M
•
4.45k
•
214
HuggingFaceTB/everyday-conversations-llama3.1-2k
Viewer
•
Updated
•
2.38k
•
1.75k
•
74
HuggingFaceTB/instruct-data-basics-smollm-H4
Viewer
•
Updated
•
767
•
397
HuggingFaceTB/self-oss-instruct-sc2-H4
Viewer
•
Updated
•
50.7k
•
456
•
1
HuggingFaceTB/Magpie-Pro-300K-Filtered-H4
Viewer
•
Updated
•
300k
•
468
•
2
HuggingFaceTB/OpenHermes-2.5-H4
Viewer
•
Updated
•
1M
•
473
•
1
HuggingFaceTB/bisac_expanded_topics
Viewer
•
Updated
•
34.2k
•
188
HuggingFaceTB/cosmopedia
Viewer
•
Updated
•
31.1M
•
5.23k
•
553