中文
相关论文

相关论文: LoRA-Enhanced Vision Transformer for Single Image …

200 篇论文

Self-supervised learning can be used for mitigating the greedy needs of Vision Transformer networks for very large fully-annotated datasets. Different classes of self-supervised learning offer representations with either good contextual…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Spyros Gidaris , Andrei Bursuc , Oriane Simeoni , Antonin Vobecky , Nikos Komodakis , Matthieu Cord , Patrick Pérez

Although a substantial amount of studies is dedicated to morph detection, most of them fail to generalize for morph faces outside of their training paradigm. Moreover, recent morph detection methods are highly vulnerable to adversarial…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Hossein Kashiani , Shoaib Meraj Sami , Sobhan Soleymani , Nasser M. Nasrabadi

Low-Rank Adaptation (LoRA) has emerged as one of the most effective, computationally tractable fine-tuning approaches for training Vision-Language Models (VLMs) and Large Language Models (LLMs). LoRA accomplishes this by freezing the…

Transformer-based deep models for single image super-resolution (SISR) have greatly improved the performance of lightweight SISR tasks in recent years. However, they often suffer from heavy computational burden and slow inference due to the…

图像与视频处理 · 电气工程与系统科学 2024-08-09 Xiaole Zhao , Linze Li , Chengxing Xie , Xiaoming Zhang , Ting Jiang , Wenjie Lin , Shuaicheng Liu , Tianrui Li

Continual learning (CL) in the context of Generative Adversarial Networks (GANs) remains a challenging problem, particularly when it comes to learn from a few-shot (FS) samples without catastrophic forgetting. Current most effective…

机器学习 · 计算机科学 2025-10-17 Munsif Ali , Leonardo Rossi , Massimo Bertozzi

Among the widely used parameter-efficient fine-tuning (PEFT) methods, LoRA and its variants have gained considerable popularity because of avoiding additional inference costs. However, there still often exists an accuracy gap between these…

Fine-tuning large vision models (LVMs) and large language models (LLMs) under differentially private federated learning (DPFL) is hindered by a fundamental privacy-utility trade-off. Low-Rank Adaptation (LoRA), a promising…

机器学习 · 计算机科学 2026-04-21 Jin Liu , Yinbin Miao , Ning Xi , Junkang Liu

Parameter-Efficient Fine-Tuning (PEFT) methods like LoRA have transformed vision model adaptation, enabling the rapid deployment of customized models. However, the compactness of LoRA adaptations introduces new safety concerns, particularly…

密码学与安全 · 计算机科学 2025-09-30 Yixu Wang , Yan Teng , Yingchun Wang , Xingjun Ma

Foundation models for vision are predominantly trained on RGB data, while many safety-critical applications rely on non-visible modalities such as infrared (IR) and synthetic aperture radar (SAR). We study whether a single flow-matching…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Maxim Clouser , Kia Khezeli , John Kalantari

Low-rank adaptation (LoRA) is a natural method for finetuning in communication-constrained machine learning settings such as cross-device federated learning. Prior work that has studied LoRA in the context of federated learning has focused…

机器学习 · 计算机科学 2024-06-11 Kevin Kuo , Arian Raje , Kousik Rajesh , Virginia Smith

Parameter-efficient fine-tuning methods, such as LoRA, reduces the number of trainable parameters. However, they often suffer from scalability issues and differences between their learning pattern and full fine-tuning. To overcome these…

机器学习 · 计算机科学 2025-01-22 Hamid Nasiri , Peter Garraghan

Face recognition has evolved as a widely used biometric modality. However, its vulnerability against presentation attacks poses a significant security threat. Though presentation attack detection (PAD) methods try to address this issue,…

计算机视觉与模式识别 · 计算机科学 2020-07-23 Anjith George , Sebastien Marcel

This paper presents a summary of the Competition on Face Morphing Attack Detection Based on Privacy-aware Synthetic Training Data (SYN-MAD) held at the 2022 International Joint Conference on Biometrics (IJCB 2022). The competition attracted…

Fine-tuning large language models (LLMs) is computationally expensive, and Low-Rank Adaptation (LoRA) provides a cost-effective solution by approximating weight updates through low-rank matrices. In real-world scenarios, LLMs are fine-tuned…

机器学习 · 计算机科学 2025-06-03 Jinda Liu , Yi Chang , Yuan Wu

Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a federated framework using alternating optimization to…

机器学习 · 计算机科学 2025-11-06 Shuangyi Chen , Yuanxin Guo , Yue Ju , Harik Dalal , Zhongwen Zhu , Ashish Khisti

Fine-tuning has become a popular approach to adapting large foundational models to specific tasks. As the size of models and datasets grows, parameter-efficient fine-tuning techniques are increasingly important. One of the most widely used…

Micro-expression recognition (MER) has achieved impressive accuracy in controlled laboratory settings. However, its real-world applicability faces a significant generalization cliff, severely hindering practical deployment due to poor…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Linquan Wu , Tianxiang Jiang , Haoyu Yang , Wenhao Duan , Shaochao Lin , Zixuan Wang , Yini Fang , Jacky Keung

Face manipulation attacks have drawn the attention of biometric researchers because of their vulnerability to Face Recognition Systems (FRS). This paper proposes a novel scheme to generate Composite Face Image Attacks (CFIA) based on facial…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Jag Mohan Singh , Raghavendra Ramachandra

Fine-tuning has proven to be highly effective in adapting pre-trained models to perform better on new desired tasks with minimal data samples. Among the most widely used approaches are reparameterization methods, which update a target…

机器学习 · 计算机科学 2025-10-27 Aymane El Firdoussi , El Mahdi Chayti , Mohamed El Amine Seddik , Martin Jaggi

In most interactive image generation tasks, given regions of interest (ROI) by users, the generated results are expected to have adequate diversities in appearance while maintaining correct and reasonable structures in original images. Such…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Jinshu Chen , Qihui Xu , Qi Kang , MengChu Zhou