[FEEDBACK] Inference Playground
Inference Playground
This discussion is dedicated to providing feedback on the Inference Playground and Serverless Inference API.
About the Inference Playground:
The Inference Playground is a user interface designed to simplify testing our serverless inference API with chat models. It lists available models for you to try, allowing you to experiment with each model's settings, test available models via a UI, and copy code snippets.
- To view all available settings, refer to the Serverless Inference for Chat Completion documentation.
- Browse available chat models here.
If you need more usage, you can subscribe to PRO.
| User Tier | Rate Limit |
|---|---|
| Unregistered Users | 1 request per hour |
| Signed-up Users | 50 requests per hour |
| PRO and Enterprise Users | 500 requests per hour |
Upcoming Features:
- Continuous UI improvements
- A dedicated UI for function calling
- Support for vision language models
- A feature to easily compare models
Add place to change API keys in Playground.
Add place to change API keys in Playground.
Yes I'll try to add this today. edit: I added it.
support tool use🛠️
How to use this 🤗 InferenceClient with "Langchain" or "Llama-Index " ?
How to use this 🤗 InferenceClient with "Langchain" or "Llama-Index " ?
What do you mean? This is just a UI for easier testing and getting the code to do Inference on HF models.