File size: 3,163 Bytes
6aad225 4632139 1654387 4632139 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 |
---
license: cc-by-nc-sa-4.0
---
# Magic Clothing
This repository is the official implementation of [Magic Clothing](https://github.com/ShineChen1024/MagicClothing)
Magic Clothing is a branch version of [OOTDiffusion](https://github.com/levihsu/OOTDiffusion), focusing on controllable garment-driven image synthesis
<!-- Please refer to our [previous paper](https://arxiv.org/abs/2403.01779) for more details -->
> **Magic Clothing: Controllable Garment-Driven Image Synthesis** [[arXiv paper](https://arxiv.org/abs/2404.09512)]<br>
> [Weifeng Chen](https://github.com/ShineChen1024)\*, [Tao Gu](https://github.com/T-Gu)\*, [Yuhao Xu](http://levihsu.github.io/), [Chengcai Chen](https://www.researchgate.net/profile/Chengcai-Chen)<br>
> \* Equal contribution<br>
> Xiao-i Research
## News
🔥 [2024/4/19] An 1024 version trained on both VTON-HD and DressCode for early access branch is avaliable now!
🔥 [2024/4/19] We support AnimateDiff now for generating GIF!
🔥 [2024/4/16] Our [paper](https://arxiv.org/abs/2404.09512) is available now!
🔥 [2024/3/8] We released the model weights trained on the 768 resolution. The strength of clothing and text prompts can be independently adjusted.
🤗 [Hugging Face link](https://huggingface.co/ShineChen1024/MagicClothing)
🔥 [2024/2/28] We support [IP-Adapter-FaceID](https://huggingface.co/h94/IP-Adapter-FaceID) with [ControlNet-Openpose](https://github.com/lllyasviel/ControlNet-v1-1-nightly)! A portrait and a reference pose image can be used as additional conditions.
Have fun with ***gradio_ipadapter_openpose.py***
🔥 [2024/2/23] We support [IP-Adapter-FaceID](https://huggingface.co/h94/IP-Adapter-FaceID) now! A portrait image can be used as an additional condition.
Have fun with ***gradio_ipadapter_faceid.py***
## Installation
1. Clone the repository
```sh
git clone https://github.com/ShineChen1024/MagicClothing.git
```
2. Create a conda environment and install the required packages
```sh
conda create -n magicloth python==3.10
conda activate magicloth
pip install torch==2.0.1 torchvision==0.15.2 numpy==1.25.1 diffusers==0.25.1 opencv-python==4.9.0.80 transformers==4.31.0 gradio==4.16.0 safetensors==0.3.1 controlnet-aux==0.0.6 accelerate==0.21.0
```
## Inference
1. Python demo
> 512 weights
```sh
python inference.py --cloth_path [your cloth path] --model_path [your model checkpoints path]
```
> 768 weights
```sh
python inference.py --cloth_path [your cloth path] --model_path [your model checkpoints path] --enable_cloth_guidance
```
2. Gradio demo
> 512 weights
```sh
python gradio_generate.py --model_path [your model checkpoints path]
```
> 768 weights
```sh
python gradio_generate.py --model_path [your model checkpoints path] --enable_cloth_guidance
```
## Citation
```
@article{chen2024magic,
title={Magic Clothing: Controllable Garment-Driven Image Synthesis},
author={Chen, Weifeng and Gu, Tao and Xu, Yuhao and Chen, Chengcai},
journal={arXiv preprint arXiv:2404.09512},
year={2024}
}
```
## TODO List
- [x] Paper
- [x] Gradio demo
- [x] Inference code
- [x] Model weights
- [ ] Training code
|