Upload folder using huggingface_hub (#1)

- 92d2cb062d08da9b45575288ef886a3fdebd88d0cdd69429564f003aa089d29c (56154400a782872bd801c681c6fcfc2ee915af77)
- 36404d5c0b21aa6d98a806ded210e649b7ce63b375f069a37caca72154f5e56f (a66dc4dc0529ea5bc269312fdbb7849325428f0c)

README.md

@@ -0,0 +1,86 @@
+---
+license: apache-2.0
+library_name: pruna-engine
+thumbnail: "https://assets-global.website-files.com/646b351987a8d8ce158d1940/64ec9e96b4334c0e1ac41504_Logo%20with%20white%20text.svg"
+metrics:
+- memory_disk
+- memory_inference
+- inference_latency
+- inference_throughput
+- inference_CO2_emissions
+- inference_energy_consumption
+---
+<!-- header start -->
+<!-- 200823 -->
+<div style="width: auto; margin-left: auto; margin-right: auto">
+    <a href="https://www.pruna.ai/" target="_blank" rel="noopener noreferrer">
+        <img src="https://i.imgur.com/eDAlcgk.png" alt="PrunaAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+    </a>
+</div>
+<!-- header end -->
+
+# Simply make AI models cheaper, smaller, faster, and greener!
+
+[![Twitter](https://img.shields.io/twitter/follow/PrunaAI?style=social)](https://twitter.com/PrunaAI)
+[![GitHub](https://img.shields.io/github/followers/PrunaAI?label=Follow%20%40PrunaAI&style=social)](https://github.com/PrunaAI)
+[![LinkedIn](https://img.shields.io/badge/LinkedIn-Connect-blue)](https://www.linkedin.com/company/93832878/admin/feed/posts/?feedType=following)
+
+- Give a thumbs up if you like this model!
+- Contact us and tell us which model to compress next [here](https://www.pruna.ai/contact).
+- Request access to easily compress your *own* AI models [here](https://z0halsaff74.typeform.com/pruna-access?typeform-source=www.pruna.ai).
+- Read the documentations to know more [here](https://pruna-ai-pruna.readthedocs-hosted.com/en/latest/)
+- Share feedback and suggestions on the Slack of Pruna AI (Coming soon!).
+
+## Results
+
+![image info](./plots.png)
+
+**Important remarks:**
+- The quality of the model output might slightly vary compared to the base model. There might be minimal quality loss.
+- These results were obtained on NVIDIA A100-PCIE-40GB with configuration described in config.json and are obtained after a hardware warmup. Efficiency results may vary in other settings (e.g. other hardware, image size, batch size, ...).
+- You can request premium access to more compression methods and tech support for your specific use-cases [here](https://z0halsaff74.typeform.com/pruna-access?typeform-source=www.pruna.ai).
+
+## Setup
+
+You can run the smashed model with these steps:
+
+0. Check cuda, torch, packaging requirements are installed. For cuda, check with `nvcc --version` and install with `conda install nvidia/label/cuda-12.1.0::cuda`. For packaging and torch, run `pip install packaging torch`.
+1. Install the `pruna-engine` available [here](https://pypi.org/project/pruna-engine/) on Pypi. It might take 15 minutes to install.
+    ```bash
+   pip install pruna-engine[gpu] --extra-index-url https://pypi.nvidia.com --extra-index-url https://pypi.ngc.nvidia.com --extra-index-url https://prunaai.pythonanywhere.com/
+    ```
+3. Download the model files using one of these three options. 
+   - Option 1 - Use command line interface (CLI):
+       ```bash
+       mkdir prompthero-openjourney-turbo-green-smashed
+       huggingface-cli download PrunaAI/prompthero-openjourney-turbo-green-smashed --local-dir prompthero-openjourney-turbo-green-smashed --local-dir-use-symlinks False
+       ```
+   - Option 2 - Use Python:
+       ```python
+       import subprocess
+       repo_name = "prompthero-openjourney-turbo-green-smashed"
+       subprocess.run(["mkdir", repo_name])
+       subprocess.run(["huggingface-cli", "download", 'PrunaAI/'+ repo_name, "--local-dir", repo_name, "--local-dir-use-symlinks", "False"])
+       ```
+   - Option 3 - Download them manually on the HuggingFace model page.
+3. Load & run the model.
+    ```python
+    from pruna_engine.PrunaModel import PrunaModel
+   
+    model_path = "prompthero-openjourney-turbo-green-smashed/model"  # Specify the downloaded model path.
+    smashed_model = PrunaModel.load_model(model_path)  # Load the model.
+    smashed_model(prompt='Beautiful fruits in trees', height=512, width=512)[0][0]  # Run the model where x is the expected input of.
+    ```
+
+## Configurations
+
+The configuration info are in `config.json`.
+
+## License
+
+We follow the same license as the original model. Please check the license of the original model prompthero/openjourney before using this model.
+
+## Want to compress other models?
+
+- Contact us and tell us which model to compress next [here](https://www.pruna.ai/contact).
+- Request access to easily compress your own AI models [here](https://z0halsaff74.typeform.com/pruna-access?typeform-source=www.pruna.ai).

config.json

@@ -0,0 +1 @@
+{"pruners": "None", "pruning_ratio": 0.0, "factorizers": "None", "quantizers": "None", "n_quantization_bits": 32, "output_deviation": 0.005, "compilers": "['diffusers2']", "static_batch": true, "static_shape": false, "controlnet": "None", "unet_dim": 4, "device": "cuda", "save_dir": "/ceph/hdd/staff/charpent/models/.models/optimized_model", "batch_size": 1, "max_batch_size": 1, "image_height": 512, "image_width": 512, "version": "1.5", "task": "txt2img", "model_name": "prompthero/openjourney", "weight_name": "None", "save_load_fn": "stable_fast"}

model/optimized_model.pkl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cbc091314a0a90b0e43a6d7bca40059921b9ea15d833857d879d13348493bf83
+size 2743389033

model/smash_config.json

@@ -0,0 +1 @@
+{"api_key": "pruna_c4c77860c62a2965f6bc281841ee1d7bd3", "verify_url": "http://johnrachwan.pythonanywhere.com", "smash_config": {"pruners": "None", "pruning_ratio": 0.0, "factorizers": "None", "quantizers": "None", "n_quantization_bits": 32, "output_deviation": 0.005, "compilers": "['diffusers2']", "static_batch": true, "static_shape": false, "controlnet": "None", "unet_dim": 4, "device": "cuda", "cache_dir": "/ceph/hdd/staff/charpent/.cache/models", "save_dir": "/ceph/hdd/staff/charpent/models/.models/optimized_model", "batch_size": 1, "max_batch_size": 1, "image_height": 512, "image_width": 512, "version": "1.5", "task": "txt2img", "model_name": "prompthero/openjourney", "weight_name": "None", "save_load_fn": "stable_fast"}}