English
Related papers

Related papers: EasyRef: Omni-Generalized Group Image Reference fo…

200 papers

While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated images, as the model tends to copy data from the observed…

Recent advancements in Unet-based diffusion models, such as ControlNet and IP-Adapter, have introduced effective spatial and subject control mechanisms. However, the DiT (Diffusion Transformer) architecture still struggles with efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuxuan Zhang , Yirui Yuan , Yiren Song , Haofan Wang , Jiaming Liu

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Diffusion model-based low-light image enhancement methods rely heavily on paired training data, leading to limited extensive application. Meanwhile, existing unsupervised methods lack effective bridging capabilities for unknown degradation.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Jinhong He , Minglong Xue , Aoxiang Ning , Chengyun Song

The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Mohan Zhou , Yalong Bai , Qing Yang , Tiejun Zhao

Diffusion models have exhibit exceptional performance in text-to-image generation and editing. However, existing methods often face challenges when handling complex text prompts that involve multiple objects with multiple attributes and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ling Yang , Zhaochen Yu , Chenlin Meng , Minkai Xu , Stefano Ermon , Bin Cui

Visual designers naturally draw inspiration from multiple visual references, combining diverse elements and aesthetic principles to create artwork. However, current image generative frameworks predominantly rely on single-source inputs --…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Ruoxi Chen , Dongping Chen , Siyuan Wu , Sinan Wang , Shiyun Lang , Petr Sushko , Gaoyang Jiang , Yao Wan , Ranjay Krishna

Subject-driven image generation plays a crucial role in applications such as virtual try-on and poster design. Existing approaches typically fine-tune pretrained generative models or apply LoRA-based adaptations for individual subjects.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Peng Zheng , Ye Wang , Rui Ma , Zuxuan Wu

In recent years, image editing has garnered growing attention. However, general image editing models often fail to produce satisfactory results when confronted with new styles. The challenge lies in how to effectively fine-tune general…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Cong Cao , Huanjing Yue , Yujie Xu , Xiaodong Xu

In this paper, we introduce LDGen, a novel method for integrating large language models (LLMs) into existing text-to-image diffusion models while minimizing computational demands. Traditional text encoders, such as CLIP and T5, exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Pengzhi Li , Pengfei Yu , Zide Liu , Wei He , Xuhao Pan , Xudong Rao , Tao Wei , Wei Chen

Despite recent advances in photorealistic image generation through large-scale models like FLUX and Stable Diffusion v3, the practical deployment of these architectures remains constrained by their inherent intractability to parameter…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhiwen Li , Zhongjie Duan , Die Chen , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Multimodal Large Language Models (MLLMs) excel at broad visual understanding but still struggle with fine-grained perception, where decisive evidence is small and easily overwhelmed by global context. Recent "Thinking-with-Images" methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lai Wei , Liangbo He , Jun Lan , Lingzhong Dong , Yutong Cai , Siyuan Li , Huijia Zhu , Weiqiang Wang , Linghe Kong , Yue Wang , Zhuosheng Zhang , Weiran Huang

Recently, text-to-image models based on diffusion have achieved remarkable success in generating high-quality images. However, the challenge of personalized, controllable generation of instances within these images remains an area in need…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Fan Deng , Yaguang Wu , Xinyang Yu , Xiangjun Huang , Jian Yang , Guangyu Yan , Qiang Xu

Recent advances in tuning-free personalized image generation based on diffusion models are impressive. However, to improve subject fidelity, existing methods either retrain the diffusion model or infuse it with dense visual embeddings, both…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhichao Wei , Qingkun Su , Long Qin , Weizhi Wang

Facial attribute editing and style manipulation are crucial for applications like virtual avatars and photo editing. However, achieving precise control over facial attributes without altering unrelated features is challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wenmin Huang , Weiqi Luo , Xiaochun Cao , Jiwu Huang

Preference-conditioned image generation seeks to adapt generative models to individual users, producing outputs that reflect personal aesthetic choices beyond the given textual prompt. Despite recent progress, existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenyi Mo , Tianyu Zhang , Yalong Bai , Ligong Han , Ying Ba , Dimitris N. Metaxas

Large language models (LLMs) have been effectively used for many computer vision tasks, including image classification. In this paper, we present a simple yet effective approach for zero-shot image classification using multimodal LLMs.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Abdelrahman Abdelhamed , Mahmoud Afifi , Alec Go

We present Omni-Video 2, a scalable and computationally efficient model that connects pretrained multimodal large-language models (MLLMs) with video diffusion models for unified video generation and editing. Our key idea is to exploit the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hao Yang , Zhiyu Tan , Jia Gong , Luozheng Qin , Hesen Chen , Xiaomeng Yang , Yuqing Sun , Yuetan Lin , Mengping Yang , Hao Li

Existing unified methods typically treat multi-degradation image restoration as a multi-task learning problem. Despite performing effectively compared to single degradation restoration methods, they overlook the utilization of commonalities…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Cheng Zhang , Dong Gong , Jiumei He , Yu Zhu , Jinqiu Sun , Yanning Zhang