AI PC: Text Generation
Text generation LLMs that have been validated to run on the AI PC Intel® Core™ Ultra CPU and iGPU.
- Text Generation • Updated • 55 • 2
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation • Updated • 43 • 3OpenVINO/phi-2-fp16-ov
Text Generation • Updated • 45 • 1OpenVINO/phi-2-int8-ov
Text Generation • Updated • 76OpenVINO/phi-2-int4-ov
Text Generation • Updated • 15 • 1OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation • Updated • 51OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation • Updated • 86OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation • Updated • 285OpenVINO/starcoder2-15b-fp16-ov
Text Generation • Updated • 10OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 13OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 17OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation • Updated • 21OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation • Updated • 29OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation • Updated • 35OpenVINO/mpt-7b-fp16-ov
Text Generation • Updated • 10OpenVINO/mpt-7b-int8-ov
Text Generation • Updated • 8OpenVINO/mpt-7b-int4-ov
Text Generation • Updated • 3OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation • Updated • 55OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 53 • 2OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation • Updated • 556 • 2OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation • Updated • 2OpenVINO/falcon-7b-instruct-int8-ov
Text Generation • Updated • 4OpenVINO/falcon-7b-instruct-int4-ov
Text Generation • Updated • 6OpenVINO/open_llama_3b_v2-fp16-ov
Text Generation • Updated • 44OpenVINO/open_llama_3b_v2-int8-ov
Text Generation • Updated • 175 • 1OpenVINO/open_llama_3b_v2-int4-ov
Text Generation • Updated • 20OpenVINO/open_llama_7b_v2-fp16-ov
Text Generation • Updated • 23OpenVINO/open_llama_7b_v2-int8-ov
Text Generation • Updated • 80OpenVINO/open_llama_7b_v2-int4-ov
Text Generation • Updated • 25OpenVINO/gpt-j-6b-fp16-ov
Text Generation • Updated • 3OpenVINO/gpt-j-6b-int8-ov
Text Generation • Updated • 13OpenVINO/gpt-j-6b-int4-ov
Text Generation • Updated • 8OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov
Text Generation • Updated • 3OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov
Text Generation • Updated • 5OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov
Text Generation • Updated • 3OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov
Text Generation • Updated • 11OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov
Text Generation • Updated • 3OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov
Text Generation • Updated • 4OpenVINO/dolly-v2-7b-fp16-ov
Text Generation • Updated • 8OpenVINO/dolly-v2-7b-int8-ov
Text Generation • Updated • 30OpenVINO/dolly-v2-7b-int4-ov
Text Generation • Updated • 3OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation • Updated • 13OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 267 • 1OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 188 • 1OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation • Updated • 14OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 17OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation • Updated • 223 • 3OpenVINO/pythia-1.4b-fp16-ov
Text Generation • Updated • 3OpenVINO/pythia-1.4b-int8-ov
Text Generation • Updated • 3OpenVINO/pythia-1.4b-int4-ov
Text Generation • Updated • 24OpenVINO/pythia-2.8b-fp16-ov
Text Generation • Updated • 2OpenVINO/pythia-2.8b-int8-ov
Text Generation • Updated • 2OpenVINO/pythia-2.8b-int4-ov
Text Generation • Updated • 3OpenVINO/pythia-6.9b-fp16-ov
Text Generation • Updated • 7OpenVINO/pythia-6.9b-int8-ov
Text Generation • Updated • 2OpenVINO/pythia-6.9b-int4-ov
Text Generation • Updated • 2OpenVINO/pythia-1b-fp16-ov
Text Generation • Updated • 2OpenVINO/pythia-1b-int8-ov
Text Generation • Updated • 7OpenVINO/pythia-1b-int4-ov
Text Generation • Updated • 9OpenVINO/neural-chat-7b-v1-1-fp16-ov
Text Generation • Updated • 1OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation • Updated • 3OpenVINO/neural-chat-7b-v1-1-int4-ov
Text Generation • Updated • 16OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 2OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation • Updated • 4OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 2
AhmedSSoliman/MarianCausalLM
Text Generation • Updated • 2Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
AurelPx/Pegasus-7b-slerp
Text Generation • Updated • 62 • 1Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/Aquila-7B
Updated • 6.77k • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/Aquila2-7B
Text Generation • Updated • 462 • 6Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/AquilaChat-7B
Updated • 2.78k • 48Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BAAI/AquilaChat2-7B
Text Generation • Updated • 513 • 15Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
BigSalmon/GPT2Neo1.3BPoints
Text Generation • Updated • 5Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-1.4b
Text Generation • Updated • 35.6k • 22Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-12b
Text Generation • Updated • 6.22k • 131Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-14m
Text Generation • Updated • 215k • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-160m
Text Generation • Updated • 182k • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-1b
Text Generation • Updated • 28.3k • 33Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-2.8b
Text Generation • Updated • 21.2k • 28Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-410m
Text Generation • Updated • 67.9k • 21Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-6.9b
Text Generation • Updated • 21.9k • 43Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
EleutherAI/pythia-70m
Updated • 68.3k • 55Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
HuggingFaceH4/zephyr-7b-beta
Text Generation • Updated • 1.19M • • 1.58kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Intel/neural-chat-7b-v1-1
Text Generation • Updated • 17 • 23Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Intel/neural-chat-7b-v3-3
Text Generation • Updated • 117k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/CodeQwen1.5-7B-Chat
Text Generation • Updated • 45.5k • 299Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-1_8B
Text Generation • Updated • 2.32k • 60Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-1_8B-Chat
Text Generation • Updated • 26.6k • 105Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-7B
Text Generation • Updated • 30.4k • 362Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen-7B-Chat
Text Generation • Updated • 30.6k • 746Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-0.5B
Text Generation • Updated • 618k • 142Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-0.5B-Chat
Text Generation • Updated • 256k • 73Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-1.8B
Text Generation • Updated • 636k • 43Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-1.8B-Chat
Text Generation • Updated • 33.2k • 44Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-4B
Text Generation • Updated • 12.1k • 34Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-4B-Chat
Text Generation • Updated • 10.7k • 38Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-7B
Text Generation • Updated • 216k • 45Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Qwen/Qwen1.5-7B-Chat
Text Generation • Updated • 21.3k • 161Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-2B-multi
Text Generation • Updated • 1.07k • 34Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-350M-mono
Text Generation • Updated • 10.7k • 85Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen-6B-multi
Text Generation • Updated • 1.18k • 19Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-1B_P
Text Generation • Updated • 1.92k • 38Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-3_7B_P
Text Generation • Updated • 481 • 15Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
Salesforce/codegen2-7B_P
Text Generation • Updated • 573 • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
WizardLMTeam/WizardMath-7B-V1.1
Text Generation • Updated • 43.8k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
X-D-Lab/MindChat-Qwen2-4B
Text Generation • Updated • 33 • 4Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
adept/persimmon-8b-chat
Text Generation • Updated • 994 • 42Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-13B-Chat
Text Generation • Updated • 68.1k • 421Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-7B-Base
Text Generation • Updated • 1.92k • 75Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
baichuan-inc/Baichuan2-7B-Chat
Text Generation • Updated • 11.4k • 156Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloom-560m
Text Generation • Updated • 138k • 343Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-1b1
Text Generation • Updated • 4.04k • 31Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-3b
Text Generation • Updated • 9.01k • 77Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
bigscience/bloomz-7b1-mt
Text Generation • Updated • 1.8k • 139Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-1.3b
Text Generation • Updated • 82.1k • 148Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-125m
Text Generation • Updated • 5.41M • 160Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-13b
Text Generation • Updated • 23.1k • 65Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-2.7b
Text Generation • Updated • 40.2k • 79Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-350m
Text Generation • Updated • 178k • 126Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-6.7b
Text Generation • Updated • 57.5k • 106Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
facebook/opt-iml-1.3b
Text Generation • Updated • 618 • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-1.1-2b
Text Generation • Updated • 101 • 17Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-1.1-7b-it
Text Generation • Updated • 146 • 49Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-2b
Text Generation • Updated • 3.31k • 69Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/codegemma-7b
Text Generation • Updated • 19.8k • 157Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-1.1-2b-it
Text Generation • Updated • 51.7k • 144Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-1.1-7b-it
Text Generation • Updated • 13.9k • • 262Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-2b
Text Generation • Updated • 479k • • 894Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-2b-it
Text Generation • Updated • 130k • 661Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-7b
Text Generation • Updated • 233k • 3.04kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
google/gemma-7b-it
Text Generation • Updated • 223k • 1.13kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-3b-code-base-2k
Text Generation • Updated • 32.4k • 33Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-3b-code-instruct-2k
Text Generation • Updated • 9.58k • 30Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-8b-code-base-4k
Text Generation • Updated • 3.41k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ibm-granite/granite-8b-code-instruct-4k
Text Generation • Updated • 4.8k • 103Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-1_8b
Text Generation • Updated • 8.86k • 28Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-7b
Text Generation • Updated • 11.4k • 40Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-1_8b
Text Generation • Updated • 7.74k • 29Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-7b
Text Generation • Updated • 12k • 82Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-chat-7b-sft
Text Generation • Updated • 7.55k • 6Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-math-7b
Text Generation • Updated • 410 • 27Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
internlm/internlm2-math-base-7b
Text Generation • Updated • 354 • 2Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-CL-7B
Text Generation • Updated • 27 • 21Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-DS-6.7B
Text Generation • Updated • 1.15k • 37Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-S-CL-7B
Text Generation • Updated • 496 • 44Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
ise-uiuc/Magicoder-S-DS-6.7B
Text Generation • Updated • 4.18k • 200Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-13b-chat-hf
Text Generation • Updated • 639k • • 1.02kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-13b-hf
Text Generation • Updated • 65.3k • 569Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-7b-chat-hf
Text Generation • Updated • 689k • • 3.88kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Llama-2-7b-hf
Text Generation • Updated • 937k • 1.71kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-3-8B
Text Generation • Updated • 1.8M • 5.71kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-3-8B-Instruct
Text Generation • Updated • 2.12M • • 3.48kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
meta-llama/Meta-Llama-Guard-2-8B
Text Generation • Updated • 16.8k • 273Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/Phi-3-medium-4k-instruct
Text Generation • Updated • 31.5k • 210Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/Phi-3-mini-128k-instruct
Text Generation • Updated • 246k • 1.58kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
microsoft/phi-2
Text Generation • Updated • 281k • 3.23kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-Instruct-v0.2
Text Generation • Updated • 994k • • 2.53kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-Instruct-v0.3
Text Generation • Updated • 507k • • 1.02kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mistralai/Mistral-7B-v0.3
Text Generation • Updated • 123k • 366Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b
Text Generation • Updated • 35.1k • 1.16kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-8k
Text Generation • Updated • 1.16k • 26Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-8k-chat
Text Generation • Updated • 1.5k • 39Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-chat
Text Generation • Updated • 3.59k • 511Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-instruct
Text Generation • Updated • 6.22k • 462Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
mosaicml/mpt-7b-storywriter
Text Generation • Updated • 1.57k • 814Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openai-community/gpt2
Text Generation • Updated • 8.42M • 2.27kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openbmb/MiniCPM-2B-sft-bf16
Text Generation • Updated • 1.84k • 116Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
openchat/openchat-3.6-8b-20240522
Text Generation • Updated • 12.7k • 145Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-12b
Text Generation • Updated • 1.15k • 114Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-12b-chat
Text Generation • Updated • 2.03k • 86Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-1_6b
Text Generation • Updated • 12.2k • 181Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-1_6b-chat
Text Generation • Updated • 6.21k • 30Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-2-zephyr-1_6b
Text Generation • Updated • 10.6k • 179Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-3b-4e1t
Text Generation • Updated • 42.5k • 307Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-base-alpha-3b
Text Generation • Updated • 1.56k • 82Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-tuned-alpha-7b
Text Generation • Updated • 2.07k • 357Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stabilityai/stablelm-zephyr-3b
Text Generation • Updated • 10.2k • 244Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
stanford-crfm/BioMedLM
Text Generation • Updated • 2.38k • 394Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-11B
Text Generation • Updated • 17.3k • 207Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-7b
Text Generation • Updated • 84.2k • 1.07kNote This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
tiiuae/falcon-7b-instruct
Text Generation • Updated • 135k • • 908Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/Pythia-Chat-Base-7B
Text Generation • Updated • 1.07k • 66Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Base
Text Generation • Updated • 1.47k • 94Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Chat
Text Generation • Updated • 1.08k • 92Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-7B-Instruct
Text Generation • Updated • 994 • 104Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
togethercomputer/RedPajama-INCITE-Chat-3B-v1
Text Generation • Updated • 2.65k • 150Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation
xverse/XVERSE-7B-Chat
Text Generation • Updated • 42 • 8Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation