English
Related papers

Related papers: RVAFM: Re-parameterizing Vertical Attention Fusion…

200 papers

In-memory computing is becoming a popular architecture for deep-learning hardware accelerators recently due to its highly parallel computing, low power, and low area cost. However, in-RRAM computing (IRC) suffered from large device…

Hardware Architecture · Computer Science 2022-05-10 Yu-Hsiang Chiang , Cheng En Ni , Yun Sung , Tuo-Hung Hou , Tian-Sheuan Chang , Shyh Jye Jou

Training large foundation models using self-supervised objectives on unlabeled data, followed by fine-tuning on downstream tasks, has emerged as a standard procedure. Unfortunately, the efficacy of this approach is often constrained by both…

The audio-visual speech fusion strategy AV Align has shown significant performance improvements in audio-visual speech recognition (AVSR) on the challenging LRS2 dataset. Performance improvements range between 7% and 30% depending on the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 George Sterpu , Christian Saam , Naomi Harte

Multi-head self-attention (MHSA) is a key component of Transformers, a widely popular architecture in both language and vision. Multiple heads intuitively enable different parallel processes over the same input. Yet, they also obscure the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Pooyan Rahmanzadehgervi , Hung Huy Nguyen , Rosanne Liu , Long Mai , Anh Totti Nguyen

Concurrent processing of multiple autonomous driving 3D perception tasks within the same spatiotemporal scene poses a significant challenge, in particular due to the computational inefficiencies and feature competition between tasks when…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Chunliang Li , Wencheng Han , Junbo Yin , Sanyuan Zhao , Jianbing Shen

Lip Reading, or Visual Automatic Speech Recognition (V-ASR), is a complex task requiring the interpretation of spoken language exclusively from visual cues, primarily lip movements and facial expressions. This task is especially challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Marshall Thomas , Edward Fish , Richard Bowden

Multimodal learning has been lacking principled ways of combining information from different modalities and learning a low-dimensional manifold of meaningful representations. We study multimodal learning and sensor fusion from a latent…

Machine Learning · Computer Science 2019-04-24 Lijiang Guo

Khmer is a low-resource language characterized by a complex script, presenting significant challenges for optical character recognition (OCR). While document printed text recognition has advanced because of available datasets, performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Marry Kong , Rina Buoy , Sovisal Chenda , Nguonly Taing , Masakazu Iwamura , Koichi Kise

Human action recognition in long-term videos, characterized by complex backgrounds and subtle action differences, poses significant challenges for traditional deep learning models due to computational overhead, difficulty in capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Kaining Li , Shuwei He , Zihan Xu

Referring Atomic Video Action Recognition (RAVAR) aims to recognize fine-grained, atomic-level actions of a specific person of interest conditioned on natural language descriptions. Distinct from conventional action recognition and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Kunyu Peng , Di Wen , Jia Fu , Jiamin Wu , Kailun Yang , Junwei Zheng , Ruiping Liu , Yufan Chen , Yuqian Fu , Danda Pani Paudel , Luc Van Gool , Rainer Stiefelhagen

This paper considers a realistic problem in person re-identification (re-ID) task, i.e., partial re-ID. Under partial re-ID scenario, the images may contain a partial observation of a pedestrian. If we directly compare a partial pedestrian…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yifan Sun , Qin Xu , Yali Li , Chi Zhang , Yikang Li , Shengjin Wang , Jian Sun

Vision-Language Models (VLMs) have shown strong capabilities on diverse multimodal tasks. However, the large number of visual tokens output by the vision encoder severely hinders inference efficiency, and prior studies have shown that many…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Jingqi Xu , Jingxi Lu , Chenghao Li , Sreetama Sarkar , Peter A. Beerel

Large Vision-Language Models (VLMs) have achieved remarkable success in multi-modal reasoning, but their inference time efficiency remains a significant challenge due to the memory overhead during decoding, especially when the query and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Fatih Ilhan , Gaowen Liu , Ramana Rao Kompella , Selim Furkan Tekin , Tiansheng Huang , Zachary Yahn , Yichang Xu , Ling Liu

Image segmentation is a crucial task in computer vision, with wide-ranging applications in industry. The Segment Anything Model (SAM) has recently attracted intensive attention; however, its application in industrial inspection,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zheming Zuo , Joseph Smith , Jonathan Stonehouse , Boguslaw Obara

This work proposes an attention-based sequence-to-sequence model for handwritten word recognition and explores transfer learning for data-efficient training of HTR systems. To overcome training data scarcity, this work leverages models…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Dmitrijs Kass , Ekta Vats

The core for tackling the fine-grained visual categorization (FGVC) is to learn subtle yet discriminative features. Most previous works achieve this by explicitly selecting the discriminative parts or integrating the attention mechanism via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Jun Wang , Xiaohan Yu , Yongsheng Gao

Linearization of attention using various kernel approximation and kernel learning techniques has shown promise. Past methods used a subset of combinations of component functions and weight matrices within the random feature paradigm. We…

Machine Learning · Computer Science 2025-09-24 Duke Nguyen , Du Yin , Aditya Joshi , Flora Salim

Detecting objects across varying scales is still a challenge in computer vision, particularly in agricultural applications like Rice Leaf Disease (RLD) detection, where objects exhibit significant scale variations (SV). Conventional object…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yunusa Haruna , Shiyin Qin , Abdulrahman Hamman Adama Chukkol , Isah Bello , Adamu Lawan

Aerial object detection using unmanned aerial vehicles (UAVs) faces critical challenges including sub-10px targets, dense occlusions, and stringent computational constraints. Existing detectors struggle to balance accuracy and efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Liu Wenbin

When autonomous agents observe different domains of a shared environment, each signal they exchange mixes relevant and irrelevant dimensions. No existing mechanism lets the receiver evaluate which dimensions to absorb. We introduce…

Multiagent Systems · Computer Science 2026-04-07 Hongwei Xu