Clone this repo into the Your ComfyUI root directoryComfyUIcustom_nodes and install dependent Python packages:
cd Your_ComfyUI_root_directoryComfyUIcustom_nodes git clone https://github.com/Bin-sam/DynamicPose-ComfyUI.git pip install -r requirements.txt
Download pre-trained models:
./pretrained_weights/
|-- denoising_unet.pth
|-- motion_module.pth
|-- pose_guider.pth
|-- reference_unet.pth
|-- rtmpose
| |-- rtmw-x_simcc-cocktail14_pt-ucoco_270e-384x288-f840f204_20231122.pth
| |-- rtmw-x_8xb320-270e_cocktail14-384x288.py
| |-- rtmdet_m_640-8xb32_coco-person.py
| |-- rtmdet_m_8xb32-100e_coco-obj365-person-235e8209.pth
| |-- rtmpose-x_8xb256-700e_coco-384x288.py
| |-- rtmpose-x_simcc-body7_pt-body7_700e-384x288-71d7b7e9_20230629.pth
|-- DWPose
| |-- dw-ll_ucoco_384.onnx
| |-- yolox_l.onnxDownload clip image encoder (e.g. sd-image-variations-diffusers ) and put it under Your_ComfyUI_root_directoryComfyUImodelsclip_vision
Download vae (e.g. sd-vae-ft-mse) and put it under Your_ComfyUI_root_directoryComfyUImodelsvae
Download stable-diffusion-v1-5 (e.g. stable-diffusion-v1-5) and put it under Your_ComfyUI_root_directoryComfyUImodelsdiffusers
stable-diffusion-v1-5_unet
Moore-AnimateAnyone Pre-trained Models
DWpose model download links are under title "DWPose for ControlNet".
Above models need to be put under folder pretrained_weights as follow:
Using pipeline examples
this workflow is Pose_to_video
