[2024-08-02] 支援faceid,新增一些相關節點,工作流程見examples/workflow_ipa_faceid.png
[2024-07-27] 新增MZ_KolorsControlNetLoader節點,用於載入可圖ControlNet官方模型
[2024-07-26] 新增MZ_ApplySDXLSamplingSettings節點,用於V2版本重新回到SDXL的scheduler配置.
[2024-07-25] 修正sampling_settings,參數來自scheduler_config.json,僅V2生效
[2024-07-21] 感謝來自yiwangsimple對Mac修復和測試的分支https://github.com/yiwangsimple/ComfyUI-Kolors-MZ
[2024-07-21] 新增MZ_ChatGLM3TextEncodeAdvanceV2節點
[2024-07-18] IPA相關節點已在ComfyUI_IPAdapter_plus中支持
[2024-07-17] 新增支援IPAdapter_plus的載入器和進階應用節點MZ_KolorsCLIPVisionLoader,MZ_IPAdapterModelLoaderKolors,MZ_IPAdapterAdvancedKolors
[2024-07-14] 刪除自動相容ControlNet, 新增MZ_KolorsControlNetPatch節點
參考自https://github.com/kijai/ComfyUI-KwaiKolorsWrapper
使用ComfyUI原生取樣
工作流程在examples/workflow.png中獲取
unet模型放置在models/unet/ 資料夾下
模型首頁: https://huggingface.co/Kwai-Kolors/Kolors
下載網址: https://huggingface.co/Kwai-Kolors/Kolors/resolve/main/unet/diffusion_pytorch_model.fp16.safetensors
chatglm3放置在models/LLM/ 資料夾下
模型首頁: https://huggingface.co/Kijai/ChatGLM3-safetensors
下載網址: https://huggingface.co/Kijai/ChatGLM3-safetensors/resolve/main/chatglm3-fp16.safetensors
faceid相關節點已經在其中支援,IPAdapter實作需要更新ComfyUI_IPAdapter_plus到最新版本
https://github.com/cubiq/ComfyUI_IPAdapter_plus/blob/main/examples/ipadapter_kolors.json
https://github.com/cubiq/ComfyUI_IPAdapter_plus/blob/main/examples/IPAdapter_FaceIDv2_Kolors.json
模型首頁: https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_general.bin 下載至models/ipadapter/
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/image_encoder/pytorch_model.bin 下載至models/clip_vision/
模型首頁: https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus/resolve/main/ipa-faceid-plus.bin 下載至models/ipadapter/
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus/resolve/main/clip-vit-large-patch14-336/pytorch_model.bin 下載至models/clip_vision/
https://huggingface.co/MonsterMMORPG/tools/resolve/main/antelopev2.zip 下載並解壓縮至models/insightface/models/antelopev2/*.onnx
模型首頁(Depth): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Depth
模型首頁(Canny): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Canny
模型首頁(Pose): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Pose
模型首頁: https://huggingface.co/Kwai-Kolors/Kolors-Inpainting
https://huggingface.co/Kwai-Kolors/Kolors-Inpainting/resolve/main/unet/diffusion_pytorch_model.safetensors 下載至models/unet/
Reference from https://github.com/kijai/ComfyUI-KwaiKolorsWrapper
Using ComfyUI Native Sampling
The workflow is obtained in examples/workflow.png
The unet model is placed in the models/unet/ folder
Model homepage: https://huggingface.co/Kwai-Kolors/Kolors
Download link: https://huggingface.co/Kwai-Kolors/Kolors/resolve/main/unet/diffusion_pytorch_model.fp16.safetensors
The chatglm3 is placed in the models/LLM/ folder
Model homepage: https://huggingface.co/Kijai/ChatGLM3-safetensors
Download link: https://huggingface.co/Kijai/ChatGLM3-safetensors/resolve/main/chatglm3-fp16.safetensors
The faceid related nodes have been supported in it, and the IPAdapter implementation needs to update ComfyUI_IPAdapter_plus to the latest version
https://github.com/cubiq/ComfyUI_IPAdapter_plus/blob/main/examples/ipadapter_kolors.json
https://github.com/cubiq/ComfyUI_IPAdapter_plus/blob/main/examples/IPAdapter_FaceIDv2_Kolors.json
Model homepage: https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_general.bin Download to models/ipadapter/
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/image_encoder/pytorch_model.bin Download to models/clip_vision/
Model homepage: https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus/resolve/main/ipa-faceid-plus.bin Download to models/ipadapter/
https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus/resolve/main/clip-vit-large-patch14-336/pytorch_model.bin Download to models/clip_vision/
https://huggingface.co/MonsterMMORPG/tools/resolve/main/antelopev2.zip Download and unzip to models/insightface/models/antelopev2/*.onnx
Model homepage(Depth): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Depth
Model homepage(Canny): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Canny
Model homepage(Pose): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Pose
Model homepage: https://huggingface.co/Kwai-Kolors/Kolors-Inpainting
https://huggingface.co/Kwai-Kolors/Kolors-Inpainting/resolve/main/unet/diffusion_pytorch_model.safetensors Download to models/unet/
測試工作流程來自examples/workflow_same_seed_test.png
The test workflow comes from examples/workflow_same_seed_test.png
載入模型時出現的錯誤
Mac用戶無法使用(Mac users cannot use)
和IPAdapter有關的錯誤(Errors related to IPAdapter)
name 'round_up' is not defined
module 'comfy.model_detection' 有 no attribute 'unet_prefix_from_state_dict'
RuntimeError: Only Tensors of floating point dtype can require gradients
Error occurred when executing MZ_ChatGLM3Loader: 'ChatGLMModel' object has no attribute 'transformer'