IFAdapter: Instance Feature Control for Grounded Text-to-Image Generation
Yinwei Wu1,2 Xianpan Zhou1 Bing Ma1 Xuefeng Su1 Kai Ma1 Xinchao Wang2†
1Tencent PGC 2National University of Singapore †corresponding author
Overview
We introduce the Instance Feature Adapter(IFAdapter) to to exert fine-grained control over the generation of multiple instances.
Features
The IFAdapter is readily integrated with various community models and LoRAs!
We show the results of IFAdapter in combination with PixelArt, Lelo-Lego, Claymation, and Bluepencil. We express our gratitude for these great work contributed by these communities!
Quick Start
Install the required dependencies
git clone https://github.com/WUyinwei-hah/IFAdapter.git
cd IFAdapter
pip install -r requirements.txtGeneration
Use the original SDXL for generation
Use LORAs for generation
Citation
@article{wu2024ifadapter,
title={Ifadapter: Instance feature control for grounded text-to-image generation},
author={Wu, Yinwei and Zhou, Xianpan and Ma, Bing and Su, Xuefeng and Ma, Kai and Wang, Xinchao},
journal={arXiv preprint arXiv:2409.08240},
year={2024}
}
