English
Related papers

Related papers: LoRA-Enhanced Vision Transformer for Single Image …

200 papers

Supervised fine-tuning (SFT) is a milestone in aligning large language models with human instructions and adapting them to downstream tasks. In particular, Low-Rank Adaptation (LoRA) has gained widespread attention due to its parameter…

Computation and Language · Computer Science 2025-11-05 Jia-Chen Zhang , Yu-Jie Xiong , Xi-He Qiu , Chun-Ming Xia , Fei Dai , Zheng Zhou

Face forgery detection is raising ever-increasing interest in computer vision since facial manipulation technologies cause serious worries. Though recent works have reached sound achievements, there are still unignorable problems: a)…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jiaming Li , Hongtao Xie , Jiahong Li , Zhongyuan Wang , Yongdong Zhang

Multi-modal pre-trained models efficiently extract and fuse features from different modalities with low memory requirements for fine-tuning. Despite this efficiency, their application in disease diagnosis is under-explored. A significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Zhiyi Shi , Junsik Kim , Wanhua Li , Yicong Li , Hanspeter Pfister

Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) face inherent challenges in image matting, particularly in preserving fine structural details. ViTs, with their global receptive field enabled by the self-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Jingru Yang , Chengzhi Cao , Chentianye Xu , Zhongwei Xie , Kaixiang Huang , Yang Zhou , Shengfeng He

Human Activity Recognition (HAR) such as fall detection has become increasingly critical due to the aging population, necessitating effective monitoring systems to prevent serious injuries and fatalities associated with falls. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Yijun Wang , Yong Wang , Chendong xu , Shuai Yao , Qisong Wu

On-device fine-tuning of CNNs is essential to withstand domain shift in edge applications such as Human Activity Recognition (HAR), yet full fine-tuning is infeasible under strict memory, compute, and energy budgets. We present LoRA-Edge, a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Hyunseok Kwak , Kyeongwon Lee , Jae-Jin Lee , Woojoo Lee

A facial morph is a synthetically created image of a face that looks similar to two different individuals and can even trick biometric facial recognition systems into recognizing both individuals. This attack is known as face morphing…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Clemens Seibold , Anna Hilsmann , Peter Eisert

Face recognition has been widely studied due to its importance in different applications; however, most of the proposed methods fail when face images are occluded or captured under illumination and pose variations. Recently several low-rank…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Homa Foroughi , Moein Shakeri , Nilanjan Ray , Hong Zhang

In this paper, we introduce Symmetric Low-Rank Adapters, an optimized variant of LoRA with even fewer weights. This method utilizes Low-Rank Symmetric Weight Matrices to learn downstream tasks more efficiently. Traditional LoRA accumulates…

Machine Learning · Computer Science 2025-04-17 Tales Panoutsos , Rodrygo L. T. Santos , Flavio Figueiredo

Traditional range-instantaneous Doppler (RID) methods for rigid-body target imaging often suffer from low resolution due to the limitations of time-frequency analysis (TFA). To address this challenge, our primary focus is on obtaining high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Boan Zhang , Hang Dong , Jiongge Zhang , Long Tian , Rongrong Wang , Zhenhua Wu , Xiyang Liu , Hongwei Liu

The proliferation of edge devices has created an urgent need for security solutions capable of detecting malware in real time while operating under strict computational and memory constraints. Recently, Large Language Models (LLMs) have…

Cryptography and Security · Computer Science 2026-02-13 Christian Rondanini , Barbara Carminati , Elena Ferrari , Niccolò Lardo , Ashish Kundu

The rapid advancement of generative technologies has made synthetic images nearly indistinguishable from real ones, thereby creating an urgent need for robust detectors to counter misinformation. However, existing methods mainly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yutong Xiao , Ran Ran , Jiwei Wei , Shuchang Zhou , Ke Liu , Zheng Ziqiang , Caiyan Qin

The demonstrated success of sparsely-gated Mixture-of-Experts (MoE) architectures, exemplified by models such as DeepSeek and Grok, has motivated researchers to investigate their adaptation to diverse domains. In real-world image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Xiao He , Zhijun Tu , Kun Cheng , Mingrui Zhu , Jie Hu , Nannan Wang , Xinbo Gao

In recent years face recognition systems have been brought to the mainstream due to development in hardware and software. Consistent efforts are being made to make them better and more secure. This has also brought developments in 3D face…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Sanjeet Vardam , Luuk Spreeuwers

Morphing is the process of combining two or more subjects in an image in order to create a new identity which contains features of both individuals. Morphed images can fool Facial Recognition Systems (FRS) into falsely accepting multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Kelsey O'Haire , Sobhan Soleymani , Baaria Chaudhary , Poorya Aghdaie , Jeremy Dawson , Nasser M. Nasrabadi

Fine-tuning text-to-image diffusion models is widely used for personalization and adaptation for new domains. In this paper, we identify a critical vulnerability of fine-tuning: safety alignment methods designed to filter harmful content…

Artificial Intelligence · Computer Science 2024-12-03 Sanghyun Kim , Moonseok Choi , Jinwoo Shin , Juho Lee

With the development of deep learning, the field of face anti-spoofing (FAS) has witnessed great progress. FAS is usually considered a classification problem, where each class is assumed to contain a single cluster optimized by softmax…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Qinghong Sun , Zhenfei Yin , Yichao Wu , Yuanhan Zhang , Jing Shao

RGB-D salient object detection (SOD) aims to identify the most conspicuous objects in a scene with the incorporation of depth cues. Existing methods mainly rely on CNNs, limited by the local receptive fields, or Vision Transformers that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Lanhu Wu , Zilin Gao , Hao Fei , Mong-Li Lee , Wynne Hsu

Existing unified methods typically treat multi-degradation image restoration as a multi-task learning problem. Despite performing effectively compared to single degradation restoration methods, they overlook the utilization of commonalities…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Cheng Zhang , Dong Gong , Jiumei He , Yu Zhu , Jinqiu Sun , Yanning Zhang

Low-rank adaptation (LoRA) and its variants are widely employed in fine-tuning large models, including large language models for natural language processing and diffusion models for computer vision. This paper proposes a generalized…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiangyu Chen , Jing Liu , Ye Wang , Pu Perry Wang , Matthew Brand , Guanghui Wang , Toshiaki Koike-Akino