English
Related papers

Related papers: EraseLoRA: MLLM-Driven Foreground Exclusion and Ba…

200 papers

Recently, adversarial erasing for weakly-supervised object attention has been deeply studied due to its capability in localizing integral object regions. However, such a strategy raises one key problem that attention regions will gradually…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Qibin Hou , Peng-Tao Jiang , Yunchao Wei , Ming-Ming Cheng

Removing undesired concepts from large-scale text-to-image (T2I) and text-to-video (T2V) diffusion models while preserving overall generative quality remains a major challenge, particularly as modern models such as Stable Diffusion v3,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaoxin Fan , Nanxiang Jiang , Daiheng Gao , Shiji Zhou , Wenjun Wu

We introduce ProLoRA, enabling zero-shot adaptation of parameter-efficient fine-tuning in text-to-image diffusion models. ProLoRA transfers pre-trained low-rank adjustments (e.g., LoRA) from a source to a target model without additional…

Artificial Intelligence · Computer Science 2025-06-06 Farzad Farhadzadeh , Debasmit Das , Shubhankar Borse , Fatih Porikli

Erasing harmful or proprietary concepts from powerful text to image generators is an emerging safety requirement, yet current "concept erasure" techniques either collapse image quality, rely on brittle adversarial losses, or demand…

Machine Learning · Computer Science 2025-11-11 Abhiram Kusumba , Maitreya Patel , Kyle Min , Changhoon Kim , Chitta Baral , Yezhou Yang

Adapting Large Language Models (LLMs) to new tasks through fine-tuning has been made more efficient by the introduction of Parameter-Efficient Fine-Tuning (PEFT) techniques, such as LoRA. However, these methods often underperform compared…

Computation and Language · Computer Science 2024-05-24 Chunlin Tian , Zhan Shi , Zhijiang Guo , Li Li , Chengzhong Xu

Low-Rank Adaptation (LoRA) has become a widely used mechanism for customizing diffusion models, enabling users to inject new visual concepts or styles through lightweight parameter updates. However, LoRAs can memorize training images,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yu Zhe , Yang Jiayan , Wei Junhao , Yu-Lin Tsai , Wang Chen

While diffusion models excel at generating high-quality images, they often struggle with accurate counting, attributes, and spatial relationships in complex multi-object scenes. One potential solution involves employing Multimodal Large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiayang Sun , Hongbo Wang , Jie Cao , Huaibo Huang , Ran He

Many open-world applications require the detection of novel objects, yet state-of-the-art object detection and instance segmentation networks do not excel at this task. The key issue lies in their assumption that regions without any…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Kuniaki Saito , Ping Hu , Trevor Darrell , Kate Saenko

Video restoration for noise removal, deblurring or super-resolution is attracting more and more attention in the fields of image processing and computer vision. Works on video restoration with data-driven approaches for fog removal are rare…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Alexandra Duminil , Jean-Philippe Tarel , Roland Brémond

Open set recognition (OSR) requires models to classify known samples while detecting unknown samples for real-world applications. Existing studies show impressive progress using unknown samples from auxiliary datasets to regularize OSR…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yu Wang , Junxian Mu , Hongzhi Huang , Qilong Wang , Pengfei Zhu , Qinghua Hu

Referring Expression Comprehension (REC) is a foundational cross-modal task that evaluates the interplay of language understanding, image comprehension, and language-to-image grounding. It serves as an essential testing ground for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Xuzheng Yang , Junzhuo Liu , Peng Wang , Guoqing Wang , Yang Yang , Heng Tao Shen

Video camouflaged object detection (VCOD) is challenging due to dynamic environments. Existing methods face two main issues: (1) SAM-based methods struggle to separate camouflaged object edges due to model freezing, and (2) MLLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Hua Zhang , Changjiang Luo , Ruoyu Chen

Large Language Models (LLMs) such as ChatGPT demonstrate strong few-shot adaptability without requiring fine-tuning, positioning them ideal for data-limited and real-time applications. However, this adaptability has not yet been replicated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zixuan Hu , Yongxian Wei , Li Shen , Chun Yuan , Dacheng Tao

Text-to-image diffusion models (DMs) inadvertently reproduce copyrighted styles and protected visual concepts, raising legal and ethical concerns. Concept erasure has emerged as a safeguard, aiming to selectively suppress such concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jiaqi Liu , Lan Zhang , Xiaoyong Yuan

Diffusion Language Models (DLMs) enable globally coherent, bidirectional, and controllable text generation, offering advantages over traditional autoregressive LLMs, while scaling to ultra-long sequences remains costly. Many existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Wenhu Zhang , Yiming Wu , Huanyu Wang , Yaoyang Liu , Huanzhang Dou , Senqiao Yang , Sitong Wu , Hanbin Zhao , Jiaya Jia

Traditional parameter-efficient fine-tuning (PEFT) methods such as LoRA are tightly coupled with the base model architecture, which constrains their applicability across heterogeneous pretrained large language models (LLMs). To address this…

Machine Learning · Computer Science 2025-08-08 Feifan Xia , Mingyang Liao , Yuyang Fang , Defang Li , Yantong Xie , Weikang Li , Yang Li , Deguo Xia , Jizhou Huang

For privacy and security concerns, the need to erase unwanted information from pre-trained vision models is becoming evident nowadays. In real-world scenarios, erasure requests originate at any time from both users and model owners, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Hongbo Zhao , Fei Zhu , Bolin Ni , Feng Zhu , Gaofeng Meng , Zhaoxiang Zhang

Surface reconstruction with preservation of geometric features is a challenging computer vision task. Despite significant progress in implicit shape reconstruction, state-of-the-art mesh extraction methods often produce aliased,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Natalia Soboleva , Olga Gorbunova , Maria Ivanova , Evgeny Burnaev , Matthias Nießner , Denis Zorin , Alexey Artemov

Significant achievements in personalization of diffusion models have been witnessed. Conventional tuning-free methods mostly encode multiple reference images by averaging their image embeddings as the injection condition, but such an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhuofan Zong , Dongzhi Jiang , Bingqi Ma , Guanglu Song , Hao Shao , Dazhong Shen , Yu Liu , Hongsheng Li

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang