English
Related papers

Related papers: ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Data…

200 papers

Recent advancements in text-to-image generative models, particularly latent diffusion models (LDMs), have demonstrated remarkable capabilities in synthesizing high-quality images from textual prompts. However, achieving identity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Barış Batuhan Topal , Umut Özyurt , Zafer Doğan Budak , Ramazan Gokberk Cinbis

Low-Rank Adaptation (LoRA) is extensively utilized in text-to-image models for the accurate rendition of specific elements like distinct characters or unique styles in generated images. Nonetheless, existing methods face challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Zhong , Yelong Shen , Shuohang Wang , Yadong Lu , Yizhu Jiao , Siru Ouyang , Donghan Yu , Jiawei Han , Weizhu Chen

The rising popularity of large foundation models has led to a heightened demand for parameter-efficient fine-tuning methods, such as Low-Rank Adaptation (LoRA), which offer performance comparable to full model fine-tuning while requiring…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Farzad Farhadzadeh , Debasmit Das , Shubhankar Borse , Fatih Porikli

Long-tailed imbalance distribution is a common issue in practical computer vision applications. Previous works proposed methods to address this problem, which can be categorized into several classes: re-sampling, re-weighting, transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Pengxiao Han , Changkun Ye , Jieming Zhou , Jing Zhang , Jie Hong , Xuesong Li

The scarcity of training data presents a fundamental challenge in applying deep learning to archaeological artifact classification, particularly for the rare types of Chinese porcelain. This study investigates whether synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziyao Ling , Silvia Mirri , Paola Salomoni , Giovanni Delnevo

Diffusion Models enable realistic image generation, raising the risk of misinformation and eroding public trust. Currently, detecting images generated by unseen diffusion models remains challenging due to the limited generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yingjian Chen , Lei Zhang , Yakun Niu , Lei Tan , Pei Chen

In fine-tuning large language models (LLMs), conserving computational resources while maintaining effectiveness and improving outcomes within the same computational constraints is crucial. The Low-Rank Adaptation (LoRA) strategy balances…

Machine Learning · Computer Science 2024-09-05 Xiaojun Xiao , Sen Shen , Qiming Bao , Hongfei Rong , Kairui Liu , Zhongsheng Wang , Jiamou Liu

The acquisition of large-scale, high-quality data is a resource-intensive and time-consuming endeavor. Compared to conventional Data Augmentation (DA) techniques (e.g. cropping and rotation), exploiting prevailing diffusion models for data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yunxiang Fu , Chaoqi Chen , Yu Qiao , Yizhou Yu

Diffusion-based text-to-image models have achieved remarkable results in synthesizing diverse images from text prompts and can capture specific artistic styles via style personalization. However, their entangled latent space and lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jaehyun Lee , Wonhark Park , Wonsik Shin , Hyunho Lee , Hyoung Min Na , Nojun Kwak

The persistent challenge of medical image synthesis posed by the scarcity of annotated data and the need to synthesize `missing modalities' for multi-modal analysis, underscored the imperative development of effective synthesis methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yuchen Mao , Hongwei Li , Wei Pang , Giorgos Papanastasiou , Guang Yang , Chengjia Wang

Customization generation techniques have significantly advanced the synthesis of specific concepts across varied contexts. Multi-concept customization emerges as the challenging task within this domain. Existing approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yang Yang , Wen Wang , Liang Peng , Chaotian Song , Yao Chen , Hengjia Li , Xiaolong Yang , Qinglin Lu , Deng Cai , Boxi Wu , Wei Liu

In this paper, we introduce a subspace-inspired Low-Rank Adaptation (LoRA) method, which is computationally efficient, easy to implement, and readily applicable to large language, multimodal, and diffusion models. Initially, we equivalently…

Machine Learning · Computer Science 2025-03-04 Taiqiang Wu , Jiahao Wang , Zhe Zhao , Ngai Wong

Few-shot image classification remains challenging due to the scarcity of labeled training examples. Augmenting them with synthetic data has emerged as a promising way to alleviate this issue, but models trained on synthetic samples often…

Machine Learning · Computer Science 2025-06-26 Lan-Cuong Nguyen , Quan Nguyen-Tri , Bang Tran Khanh , Dung D. Le , Long Tran-Thanh , Khoat Than

Video editing using diffusion models has achieved remarkable results in generating high-quality edits for videos. However, current methods often rely on large-scale pretraining, limiting flexibility for specific edits. First-frame-guided…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Chenjian Gao , Lihe Ding , Xin Cai , Zhanpeng Huang , Zibin Wang , Tianfan Xue

Among the widely used parameter-efficient fine-tuning (PEFT) methods, LoRA and its variants have gained considerable popularity because of avoiding additional inference costs. However, there still often exists an accuracy gap between these…

Computation and Language · Computer Science 2024-07-10 Shih-Yang Liu , Chien-Yi Wang , Hongxu Yin , Pavlo Molchanov , Yu-Chiang Frank Wang , Kwang-Ting Cheng , Min-Hung Chen

Early detection of lung cancer in chest radiographs (CXRs) is crucial for improving patient outcomes, yet nodule detection remains challenging due to their subtle appearance and variability in radiological characteristics like size,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Aryan Goyal , Shreshtha Singh , Ashish Mittal , Manoj Tadepalli , Piyush Kumar , Preetham Putha

Deep diffusion models excel at realistic image synthesis but demand large training sets-an obstacle in data-scarce domains like transesophageal echocardiography (TEE). While synthetic augmentation has boosted performance in transthoracic…

Image and Video Processing · Electrical Eng. & Systems 2025-08-19 Emmanuel Oladokun , Yuxuan Ou , Anna Novikova , Daria Kulikova , Sarina Thomas , Jurica Šprem , Vicente Grau

It is a challenging problem to reproduce rich spatial details while maintaining temporal consistency in real-world video super-resolution (Real-VSR), especially when we leverage pre-trained generative models such as stable diffusion (SD)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yujing Sun , Lingchen Sun , Shuaizheng Liu , Rongyuan Wu , Zhengqiang Zhang , Lei Zhang

In order to streamline the fine-tuning of foundation models, Low-Rank Adapters (LoRAs) have been substantially adopted across various fields, including instruction tuning and domain adaptation. The underlying concept of LoRA involves…

Machine Learning · Computer Science 2025-02-25 Mengyang Sun , Yihao Wang , Tao Feng , Dan Zhang , Yifan Zhu , Jie Tang

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

Computation and Language · Computer Science 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang