English
Related papers

Related papers: FreeFuse: Multi-Subject LoRA Fusion via Adaptive T…

200 papers

Large language models (LLMs) combined with instruction tuning have shown significant progress in information extraction (IE) tasks, exhibiting strong generalization capabilities to unseen datasets by following annotation guidelines.…

Computation and Language · Computer Science 2024-06-21 Yang Chen , Vedaant Shah , Alan Ritter

Text-to-image models such as Stable Diffusion have achieved unprecedented levels of high-fidelity visual synthesis. As these models advance, personalization of generative models -- commonly facilitated through Low-Rank Adaptation (LoRA)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Junyoung Koh , Hoyeon Moon , Dongha Kim , Seungmin Lee , Sanghyun Park , Min Song

Multimodal Large Language Models (MLLMs) often struggle to accurately perceive fine-grained visual details, especially when targets are tiny or visually subtle. This challenge can be addressed through semantic-visual information fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuxiang Shen , Hailong Huang , Zhenkun Gao , Xueheng Li , Man Zhou , Chengjun Xie , Haoxuan Che , Xuanhua He , Jie Zhang

Multi-focus noisy image fusion represents an important task in the field of image fusion which generates a single, clear and focused image from all source images. In this paper, we propose a novel multi-focus noisy image fusion method based…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Hui Li , Xiao-Jun Wu , Tariq Durrani

Parameter-Efficient Fine-Tuning of Diffusion Transformers (DiTs) for diverse, multi-conditional tasks often suffers from task interference when using monolithic adapters like LoRA. The Mixture of Low-rank Experts (MoLE) architecture offers…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jinqi Xiao , Qing Yan , Liming Jiang , Zichuan Liu , Hao Kang , Shen Sang , Tiancheng Zhi , Jing Liu , Cheng Yang , Xin Lu , Bo Yuan

Federated LoRA has emerged as a promising technique for efficiently fine-tuning large language models (LLMs) on distributed devices by reducing the number of trainable parameters. However, existing approaches often inadequately overlook the…

Machine Learning · Computer Science 2025-07-15 Yanzhao Hou , Jiaxiang Geng , Boyu Li , Xiaofeng Tao , Juncheng Wang , Xiaodong Xu , Bing Luo

Recent advances in text-to-image generation have been remarkable, but generating multilingual design logos that harmoniously integrate visual and textual elements remains a challenging task. Existing methods often distort character geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mingyu Kang , Hyein Seo , Yuna Jeong , Junhyeong Park , Yong Suk Choi

Scene text editing seeks to modify textual content in natural images while maintaining visual realism and semantic consistency. Existing methods often require task-specific training or paired data, limiting their scalability and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yubo Li , Xugong Qin , Peng Zhang , Hailun Lin , Gangyan Zeng , Kexin Zhang

In this paper, we present MoMA: an open-vocabulary, training-free personalized image model that boasts flexible zero-shot capabilities. As foundational text-to-image models rapidly evolve, the demand for robust image-to-image translation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Kunpeng Song , Yizhe Zhu , Bingchen Liu , Qing Yan , Ahmed Elgammal , Xiao Yang

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

We present TALE, a novel training-free framework harnessing the generative capabilities of text-to-image diffusion models to address the cross-domain image composition task that focuses on flawlessly incorporating user-specified objects…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Kien T. Pham , Jingye Chen , Qifeng Chen

Federated Learning (FL) has recently emerged as a possible way to tackle the domain shift in real-world Semantic Segmentation (SS) without compromising the private nature of the collected data. However, most of the existing works on FL…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Donald Shenaj , Eros Fanì , Marco Toldo , Debora Caldarola , Antonio Tavera , Umberto Michieli , Marco Ciccone , Pietro Zanuttigh , Barbara Caputo

Recommender Systems (RS) play a pivotal role in boosting user satisfaction by providing personalized product suggestions in domains such as e-commerce and entertainment. This study examines the integration of multimodal data text and audio…

Information Retrieval · Computer Science 2024-09-16 Zezheng Qin

The advent of Large Language Models (LLMs) has ushered in a new era of artificial intelligence, with the potential to transform various sectors through automation and insightful analysis. The Mixture of Experts (MoE) architecture has been…

Machine Learning · Computer Science 2024-10-22 Xurui Li , Juanjuan Yao

As the large language models (LLMs) grow in size each day, efficient training and fine-tuning has never been as important as nowadays. This resulted in the great interest in parameter efficient fine-tuning (PEFT), and effective methods…

Machine Learning · Computer Science 2025-11-04 Dhananjaya Gowda , Seoha Song , Junhyun Lee , Harshith Goka

Underlying data distributions of natural language, programming code, and mathematical symbols vary vastly, presenting a complex challenge for large language models (LLMs) that strive to achieve high performance across all three domains…

Computation and Language · Computer Science 2024-03-27 Ning Ding , Yulin Chen , Ganqu Cui , Xingtai Lv , Weilin Zhao , Ruobing Xie , Bowen Zhou , Zhiyuan Liu , Maosong Sun

Fine-tuning large language models (LLMs) on resource-constrained clients remains a challenging problem. Recent works have fused low-rank adaptation (LoRA) techniques with federated fine-tuning to mitigate challenges associated with client…

Machine Learning · Computer Science 2026-05-26 Wenzhi Fang , Dong-Jun Han , Liangqi Yuan , Seyyedali Hosseinalipour , Christopher G. Brinton

We introduce StyleFusion-TTS, a prompt and/or audio referenced, style and speaker-controllable, zero-shot text-to-speech (TTS) synthesis system designed to enhance the editability and naturalness of current research literature. We propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Zhiyong Chen , Xinnuo Li , Zhiqi Ai , Shugong Xu

Current multimodal medical image fusion typically assumes that source images are of high quality and perfectly aligned at the pixel level. Its effectiveness heavily relies on these conditions and often deteriorates when handling misaligned…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dayong Su , Yafei Zhang , Huafeng Li , Jinxing Li , Yu Liu

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard