English
Related papers

Related papers: Selecting and Pruning: A Differentiable Causal Seq…

200 papers

Current automatic speech recognition systems struggle with modeling long speech sequences due to high quadratic complexity of Transformer-based models. Selective state space models such as Mamba has performed well on long-sequence modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Xiaoxue Gao , Nancy F. Chen

Modeling daily hand interactions often struggles with severe occlusions, such as when two hands overlap, which highlights the need for robust feature learning in 3D hand pose estimation (HPE). To handle such occluded hand images, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifan Zhou , Takehiko Ohkawa , Guwenxiao Zhou , Kanoko Goto , Takumi Hirose , Yusuke Sekikawa , Nakamasa Inoue

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 JunYao Kaung , HongWei Ge

The topic of speech separation involves separating mixed speech with multiple overlapping speakers into several streams, with each stream containing speech from only one speaker. Many highly effective models have emerged and proliferated…

Sound · Computer Science 2024-12-25 Shaoxiang Dang , Tetsuya Matsumoto , Yoshinori Takeuchi , Hiroaki Kudo

Transformers are the cornerstone of modern large language models, but their quadratic computational complexity limits efficiency in long-sequence processing. Recent advancements in Mamba, a state space model (SSM) with linear complexity,…

Machine Learning · Computer Science 2026-01-08 Yixing Li , Ruobing Xie , Zhen Yang , Xingwu Sun , Shuaipeng Li , Weidong Han , Zhanhui Kang , Yu Cheng , Chengzhong Xu , Di Wang , Jie Jiang

Facial Expression Recognition (FER) plays a pivotal role in understanding human emotional cues. However, traditional FER methods based on visual information have some limitations, such as preprocessing, feature extraction, and multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Hui Ma , Sen Lei , Turgay Celik , Heng-Chao Li

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Mimicking the real interaction trajectory in the inference of the world model has been shown to improve the sample efficiency of model-based reinforcement learning (MBRL) algorithms. Many methods directly use known state sequences for…

Machine Learning · Computer Science 2025-01-22 Qian He , Wenqi Liang , Chunhui Hao , Gan Sun , Jiandong Tian

Semantic Change Detection (SCD) from remote sensing imagery requires models balancing extensive spatial context, computational efficiency, and sensitivity to class-imbalanced land-cover transitions. While Convolutional Neural Networks excel…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Buddhi Wijenayake , Athulya Ratnayake , Praveen Sumanasekara , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath , Nichula Wasalathilaka

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Puskal Khadka , KC Santosh

Mesh saliency enhances the adaptability of 3D vision by identifying and emphasizing regions that naturally attract visual attention. To investigate the interaction between geometric structure and texture in shaping visual attention, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Kaiwei Zhang , Dandan Zhu , Xiongkuo Min , Guangtao Zhai

Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Qinfeng Zhu , Yuan Fang , Yuanzhi Cai , Cheng Chen , Lei Fan

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

Recent Mamba-based image restoration methods have achieved promising results but remain limited by fixed scanning patterns and inefficient feature utilization. Conventional Mamba architectures rely on predetermined paths that cannot adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Han Hu , Zhuoran Zheng , Liang Li , Chen Lyu

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Yang Liu , Li Wan , Yiteng Huang , Ming Sun , Yangyang Shi , Florian Metze

Change detection in remote sensing images is an essential tool for analyzing a region at different times. It finds varied applications in monitoring environmental changes, man-made changes as well as corresponding decision-making and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Jay N. Paranjape , Celso de Melo , Vishal M. Patel

Enhancing and preserving the readability of document images, particularly historical ones, is crucial for effective document image analysis. Numerous models have been proposed for this task, including convolutional-based, transformer-based,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Mohd. Azfar , Siddhant Bharadwaj , Ashwin Sasikumar

Recently, state space model (SSM) has gained great attention due to its promising performance, linear complexity, and long sequence modeling ability in both language and image domains. However, it is non-trivial to extend SSM to the point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Jiuming Liu , Ruiji Yu , Yian Wang , Yu Zheng , Tianchen Deng , Weicai Ye , Hesheng Wang