English
Related papers

Related papers: CoLoRSMamba: Conditional LoRA-Steered Mamba for Su…

200 papers

With the prevalence of Multimodal Large Language Models(MLLMs), autonomous driving has encountered new opportunities and challenges. In particular, multi-modal video understanding is critical to interactively analyze what will happen in the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Siran Chen , Yuxiao Luo , Yue Ma , Yu Qiao , Yali Wang

The deployment of multimodal large language models (MLLMs) has demonstrated remarkable success in engaging in conversations involving visual inputs, thanks to the superior power of large language models (LLMs). Those MLLMs are typically…

Computation and Language · Computer Science 2024-10-10 Jiahui Gao , Renjie Pi , Tianyang Han , Han Wu , Lanqing Hong , Lingpeng Kong , Xin Jiang , Zhenguo Li

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

Mamba, with its advantages of global perception and linear complexity, has been widely applied to identify changes of the target regions within the remote sensing (RS) images captured under complex scenarios and varied conditions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhenkai Wu , Xiaowen Ma , Rongrong Lian , Kai Zheng , Mengting Ma , Wei Zhang , Siyang Song

In recent years, the application of multimodal large language models (MLLM) in various fields has achieved remarkable success. However, as the foundation model for many downstream tasks, current MLLMs are composed of the well-known…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Zhao , Min Zhang , Wei Zhao , Pengxiang Ding , Siteng Huang , Donglin Wang

Token reduction is an effective way to accelerate long-video vision-language models (VLMs), but most existing methods are designed for dense Transformers and do not directly account for hybrid architectures that interleave attention with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jindong Jiang , Amala Sanjay Deshmukh , Kateryna Chumachenko , Karan Sapra , Zhiding Yu , Guilin Liu , Andrew Tao , Pavlo Molchanov , Jan Kautz , Wonmin Byeon

This study demonstrates that a Multimodal Large Language Model (MLLM) adapted via Low-Rank Adaptation (LoRA) can perform both Automatic Pronunciation Assessment (APA) and Mispronunciation Detection and Diagnosis (MDD) simultaneously.…

Computation and Language · Computer Science 2025-09-04 Taekyung Ahn , Hosung Nam

We introduce CoCo-LoRA, a multimodal, uncertainty-aware parameter-efficient fine-tuning method for text prediction tasks accompanied by audio context. Existing PEFT approaches such as LoRA are efficient but typically deterministic, while…

Machine Learning · Computer Science 2026-04-21 Habibeh Naderi , Behrouz Haji Soleimani , Stan Matwin

The rapid proliferation of surveillance cameras has increased the demand for automated violence detection. While CNNs and Transformers have shown success in extracting spatio-temporal features, they struggle with long-term dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Damith Chamalke Senadeera , Xiaoyun Yang , Shibo Li , Muhammad Awais , Dimitrios Kollias , Gregory Slabaugh

Infrared Image Super-Resolution (IRSR) is challenged by the low contrast and sparse textures of infrared data, requiring robust long-range modeling to maintain global coherence. While State-Space Models like Mamba offer proficiency in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yongsong Huang , Tomo Miyazaki , Xiaofeng Liu , Shinichiro Omachi

Multilingual automatic speech recognition (ASR) remains a challenging task, especially when balancing performance across high- and low-resource languages. Recent advances in sequence modeling suggest that architectures beyond Transformers…

Computation and Language · Computer Science 2025-10-24 Mohamed Nabih Ali , Daniele Falavigna , Alessio Brutti

Video anomaly detection (VAD) has been extensively researched due to its potential for intelligent video systems. However, most existing methods based on CNNs and transformers still suffer from substantial computational burdens and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhangxun Li , Mengyang Zhao , Xuan Yang , Yang Liu , Jiamu Sheng , Xinhua Zeng , Tian Wang , Kewei Wu , Yu-Gang Jiang

Audio-Visual Speech Recognition (AVSR) leverages both acoustic and visual cues to improve speech recognition under noisy conditions. A central question is how to design a fusion mechanism that allows the model to effectively exploit visual…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-10 Seaone Ok , Min Jun Choi , Eungbeom Kim , Seungu Han , Kyogu Lee

The weakly-supervised audio-visual video parsing (AVVP) aims to predict all modality-specific events and locate their temporal boundaries. Despite significant progress, due to the limitations of the weakly-supervised and the deficiencies of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Langyu Wang , Bingke Zhu , Yingying Chen , Yiyuan Zhang , Ming Tang , Jinqiao Wang

A fundamental objective in robot manipulation is to enable models to comprehend visual scenes and execute actions. Although existing Vision-Language-Action (VLA) models for robots can handle a range of basic tasks, they still face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiaming Liu , Mengzhen Liu , Zhenyu Wang , Pengju An , Xiaoqi Li , Kaichen Zhou , Senqiao Yang , Renrui Zhang , Yandong Guo , Shanghang Zhang

Audio super-resolution aims to enhance low-resolution signals by creating high-frequency content. In this work, we modify the architecture of AERO (a state-of-the-art system for this task) for music super-resolution. SPecifically, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-13 Wallace Abreu , Luiz Wagner Pereira Biscainho

Transformers and their variants have achieved great success in speech processing. However, their multi-head self-attention mechanism is computationally expensive. Therefore, one novel selective state space model, Mamba, has been proposed as…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-04 Yang Xiao , Rohan Kumar Das

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu

Existing video camouflaged object detection (VCOD) methods primarily rely on spatial appearances for motion perception. However, the high foreground-background similarity in VCOD limits the discriminability of such features (e.g. color and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xin Li , Keren Fu , Qijun Zhao

Text-driven video moment retrieval (VMR) remains challenging due to limited capture of hidden temporal dynamics in untrimmed videos, leading to imprecise grounding in long sequences. Traditional methods rely on natural language queries…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yunzhuo Sun , Xinyue Liu , Yanyang Li , Nanding Wu , Yifang Xu , Linlin Zong , Xianchao Zhang , Wenxin Liang