ComfyUI reference implementation for IPAdapter models.
The IPAdapter are very powerful models for image-to-image conditioning. The subject or even just the style of the reference image(s) can be easily transferred to a generation. Think of it as a 1-image lora.
If you like my work and wish to see updates and new features please consider sponsoring my projects.
Not to mention the documentation and videos tutorials. Check my ComfyUI Advanced Understanding videos on YouTube for example, part 1 and part 2
The only way to keep the code open and free is by sponsoring its development. The more sponsorships the more time I can dedicate to my open source projects.
Please consider a Github Sponsorship or PayPal donation (Matteo "matt3o" Spinelli). For sponsorships of $50+, let me know if you'd like to be mentioned in this readme file, you can find me on Discord or matt3o
2024/04/12: Added scheduled weights. Useful for animations.
2024/04/09: Added experimental Style/Composition transfer for SD1.5. The results are often not as good as SDXL. Optimal weight seems to be from 0.8 to 2.0. The Style+Composition node doesn't work for SD1.5 at the moment, you can only alter either the Style or the Composition, I need more time for testing. Old workflows will still work but you may need to refresh the page and re-select the weight type!
2024/04/04: Added Style & Composition node. It's now possible to apply both Style and Composition from the same node
2024/04/01: Added Composition only transfer weight type for SDXL
2024/03/27: Added Style transfer weight type for SDXL
2024/03/23: Complete code rewrite!. This is a breaking update! Your previous workflows won't work and you'll need to recreate them. You've been warned! After the update, refresh your browser, delete the old IPAdapter nodes and create the new ones.
(I removed all previous updates because they were about the previous version of the extension)
The examples directory has many workflows that cover all IPAdapter functionalities.
The following videos are about the previous version of IPAdapter, but they still contain valuable information.
:nerd_face: Basic usage video,
Download or git clone this repository inside ComfyUI/custom_nodes/
directory or use the Manager. IPAdapter always requires the latest version of ComfyUI. If something doesn't work be sure to upgrade. Beware that the automatic update of the manager sometimes doesn't work and you may need to upgrade manually.
There's now a Unified Model Loader, for it to work you need to name the files exactly as described below. The legacy loaders work with any file name but you have to select them manually. The models can be placed into sub-directories.
Remember you can also use any custom location setting an ipadapter
entry in the extra_model_paths.yaml
file.
/ComfyUI/models/clip_vision
/ComfyUI/models/ipadapter
, create it if not present
FaceID models require insightface
, you need to install it in your ComfyUI environment. Check this issue for help. Remember that most FaceID models also need a LoRA.
For the Unified Loader to work the files need to be named exactly as shown in the table below.
/ComfyUI/models/ipadapter
Most FaceID models require a LoRA. If you use the IPAdapter Unified Loader FaceID
it will be loaded automatically if you follow the naming convention. Otherwise you have to load them manually, be careful each FaceID model has to be paired with its own specific LoRA.
/ComfyUI/models/loras
All models can be found on huggingface.
The community has baked some interesting IPAdapter models.
/ComfyUI/models/ipadapter
if you know of other models please let me know and I will add them to the unified loader.
There are many workflows included in the examples directory. Please check them before asking for support.
Usually it's a good idea to lower the weight
to at least 0.8
and increase the number steps. To increase adherece to the prompt you may try to change the weight type in the IPAdapter Advanced
node.
I'm (slowly) documenting all nodes. Please check the Nodes reference.
Please check the troubleshooting before posting a new issue. Also remember to check the previous closed issues.
It's only thanks to generous sponsors that the whole community can enjoy open and free software. Please join me in thanking the following companies and individuals!
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。