中文
相关论文

相关论文: Mod-Adapter: Tuning-Free and Versatile Multi-conce…

200 篇论文

Recent advances in diffusion-based text-to-video models, particularly those built on the diffusion transformer architecture, have achieved remarkable progress in generating high-quality and temporally coherent videos. However, transferring…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Zhexin Zhang , Yangyang Xu , Yifeng Zhu , Long Chen , Yong Du , Shengfeng He , Jun Yu

Custom diffusion models (CDMs) have attracted widespread attention due to their astonishing generative ability for personalized concepts. However, most existing CDMs unreasonably assume that personalized concepts are fixed and cannot change…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Jiahua Dong , Wenqi Liang , Hongliu Li , Duzhen Zhang , Meng Cao , Henghui Ding , Salman Khan , Fahad Shahbaz Khan

This paper proposes a novel framework for multi-label image recognition without any training data, called data-free framework, which uses knowledge of pre-trained Large Language Model (LLM) to learn prompts to adapt pretrained…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Shuo Yang , Zirui Shang , Yongqi Wang , Derong Deng , Hongwei Chen , Qiyuan Cheng , Xinxiao Wu

Recent advances in text-to-image models have enabled high-quality personalized image synthesis of user-provided concepts with flexible textual control. In this work, we analyze the limitations of two primary techniques in text-to-image…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Lianyu Pang , Jian Yin , Baoquan Zhao , Feize Wu , Fu Lee Wang , Qing Li , Xudong Mao

Recent text-to-image customization works have proven successful in generating images of given concepts by fine-tuning diffusion models on a few examples. However, tuning-based methods inherently tend to overfit the concepts, resulting in…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jiannan Huang , Jun Hao Liew , Hanshu Yan , Yuyang Yin , Yao Zhao , Humphrey Shi , Yunchao Wei

Subject-driven image generation plays a crucial role in applications such as virtual try-on and poster design. Existing approaches typically fine-tune pretrained generative models or apply LoRA-based adaptations for individual subjects.…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Peng Zheng , Ye Wang , Rui Ma , Zuxuan Wu

Going beyond mere fine-tuning of vision-language models (VLMs), learnable prompt tuning has emerged as a promising, resource-efficient alternative. Despite their potential, effectively learning prompts faces the following challenges: (i)…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Hari Chandana Kuchibhotla , Sai Srinivas Kancheti , Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

Content creators often aim to create personalized images using personal subjects that go beyond the capabilities of conventional text-to-image models. Additionally, they may want the resulting image to encompass a specific location, style,…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Moab Arar , Andrey Voynov , Amir Hertz , Omri Avrahami , Shlomi Fruchter , Yael Pritch , Daniel Cohen-Or , Ariel Shamir

Recent text-to-image generation models have demonstrated impressive capability of generating text-aligned images with high fidelity. However, generating images of novel concept provided by the user input image is still a challenging task.…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Yufan Zhou , Ruiyi Zhang , Tong Sun , Jinhui Xu

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

Personalized image generation aims to produce images of user-specified concepts while enabling flexible editing. Recent training-free approaches, while exhibit higher computational efficiency than training-based methods, struggle with…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Haoran Feng , Zehuan Huang , Lin Li , Hairong Lv , Lu Sheng

Large pre-trained vision-language models have shown great prominence in transferring pre-acquired knowledge to various domains and downstream tasks with appropriate prompting or tuning. Existing prevalent tuning methods can be generally…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Huahui Yi , Ziyuan Qin , Wei Xu , Miaotian Guo , Kun Wang , Shaoting Zhang , Kang Li , Qicheng Lao

Recent thrilling progress in large-scale text-to-image (T2I) models has unlocked unprecedented synthesis quality of AI-generated content (AIGC) including image generation, 3D and video composition. Further, personalized techniques enable…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Yanbing Zhang , Mengping Yang , Qin Zhou , Zhe Wang

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

Text-to-image diffusion models often face a severe trilemma in human portrait generation: text-image alignment, photorealism, and human-perceived aesthetics inherently inhibit one another. Supervised Fine-Tuning (SFT) is an effective method…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Yunlong Wang , Jinjin Shi , Wenbin Gao , Xuran Xu , Runyu Shi , Ying Huang

Large models have demonstrated exceptional generalization capabilities in computer vision and natural language processing. Recent efforts have focused on enhancing these models with multimodal processing abilities. However, addressing the…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Hao Sun , Yu Song

Significant progress has been made on visual captioning, largely relying on pre-trained features and later fixed object detectors that serve as rich inputs to auto-regressive models. A key limitation of such methods, however, is that the…

计算机视觉与模式识别 · 计算机科学 2022-06-09 Chia-Wen Kuo , Zsolt Kira

Multi-modal reasoning systems rely on a pre-trained object detector to extract regions of interest from the image. However, this crucial module is typically used as a black box, trained independently of the downstream task and on a fixed…

计算机视觉与模式识别 · 计算机科学 2021-10-13 Aishwarya Kamath , Mannat Singh , Yann LeCun , Gabriel Synnaeve , Ishan Misra , Nicolas Carion

Content creators often draw inspiration from multiple visual sources, combining distinct elements to craft new compositions. Modern computational approaches now aim to emulate this fundamental creative process. Although recent diffusion…

计算机视觉与模式识别 · 计算机科学 2025-02-20 Sara Dorfman , Dana Cohen-Bar , Rinon Gal , Daniel Cohen-Or