English
Related papers

Related papers: RSGMamba: Reliability-Aware Self-Gated State Space…

200 papers

Multimodal remote sensing semantic segmentation enhances scene interpretation by exploiting complementary physical cues from heterogeneous data. Although pretrained Vision Foundation Models (VFMs) provide strong general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Haocheng Li , Juepeng Zheng , Shuangxi Miao , Ruibo Lu , Guosheng Cai , Haohuan Fu , Jianxi Huang

Heart rate (HR) estimation via remote photoplethysmography (rPPG) offers a non-invasive solution for health monitoring. However, traditional single-modality approaches (RGB or Radio Frequency (RF)) face challenges in balancing robustness…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Zheng Wu , Yiping Xie , Bo Zhao , Jiguang He , Fei Luo , Ning Deng , Zitong Yu

Mamba, a State Space Model (SSM) that accelerates training by recasting recurrence as a parallel scan, has recently emerged as a linearly-scaling alternative to self-attention. Because of its unidirectional nature, each state in Mamba only…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jingwei Zhang , Xi Han , Hong Qin , Mahdi S. Hosseini , Dimitris Samaras

Linear State Space Models (SSMs) offer remarkable performance gains in efficient sequence modeling, with constant inference-time computation and memory complexity. Recent advances, such as Mamba, further enhance SSMs with input-dependent…

Machine Learning · Computer Science 2025-06-24 Zheng Zhan , Liliang Ren , Shuohang Wang , Liyuan Liu , Yang Liu , Yeyun Gong , Yanzhi Wang , Yelong Shen

Recent advancements in sRGB-to-RAW de-rendering have increasingly emphasized metadata-driven approaches to reconstruct RAW data from sRGB images, supplemented by partial RAW information. In image-based de-rendering, metadata is commonly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Hongjun Chen , Wencheng Han , Huan Zheng , Jianbing Shen

Multimodal sentiment analysis is an important research task to predict the sentiment score based on the different modality data from a specific opinion video. Many previous pieces of research have proved the significance of utilizing the…

Computation and Language · Computer Science 2022-08-26 Ming Jiang , Shaoxiong Ji

Inter-frame modeling is pivotal in generating intermediate frames for video frame interpolation (VFI). Current approaches predominantly rely on convolution or attention-based models, which often either lack sufficient receptive fields or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Guozhen Zhang , Chunxu Liu , Yutao Cui , Xiaotong Zhao , Kai Ma , Limin Wang

Text-guided multispectral object detection uses text semantics to guide semantic-aware cross-modal interaction between RGB and IR for more robust perception. However, notable limitations remain: (1) existing methods often use text only as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiaqi Wu , Zhen Wang , Enhao Huang , Kangqing Shen , Yulin Wang , Yang Yue , Yifan Pu , Gao Huang

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Skin lesion segmentation is a crucial method for identifying early skin cancer. In recent years, both convolutional neural network (CNN) and Transformer-based methods have been widely applied. Moreover, combining CNN and Transformer…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Shun Zou , Mingya Zhang , Bingjian Fan , Zhengyi Zhou , Xiuguo Zou

Global effective receptive field plays a crucial role for image style transfer (ST) to obtain high-quality stylized results. However, existing ST backbones (e.g., CNNs and Transformers) suffer huge computational complexity to achieve global…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Hongda Liu , Longguang Wang , Ye Zhang , Ziru Yu , Yulan Guo

With the increasing popularity of video sharing websites such as YouTube and Facebook, multimodal sentiment analysis has received increasing attention from the scientific community. Contrary to previous works in multimodal sentiment…

Machine Learning · Computer Science 2018-02-06 Minghai Chen , Sen Wang , Paul Pu Liang , Tadas Baltrušaitis , Amir Zadeh , Louis-Philippe Morency

Depth information has proven to be a useful cue in the semantic segmentation of RGB-D images for providing a geometric counterpart to the RGB representation. Most existing works simply assume that depth measurements are accurate and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xiaokang Chen , Kwan-Yee Lin , Jingbo Wang , Wayne Wu , Chen Qian , Hongsheng Li , Gang Zeng

In this paper, we introduce an Adaptive Graph Signal Processing with Dynamic Semantic Alignment (AGSP DSA) framework to perform robust multimodal data fusion over heterogeneous sources, including text, audio, and images. The requested…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 KV Karthikeya , Ashok Kumar Das , Shantanu Pal , Vivekananda Bhat K , Arun Sekar Rajasekaran

The precise segmentation of geological linear features, spanning from planetary lineaments to terrestrial fractures, demands capturing long-range dependencies across complex anisotropic topologies. Although State Space Models (SSMs) offer…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jin Bai , Huiyao Zhang , Qi Wen , Shengyang Li , Xiaolin Tian , Atta ur Rahman

Mamba, with its advantages of global perception and linear complexity, has been widely applied to identify changes of the target regions within the remote sensing (RS) images captured under complex scenarios and varied conditions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhenkai Wu , Xiaowen Ma , Rongrong Lian , Kai Zheng , Mengting Ma , Wei Zhang , Siyang Song

Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hanjun Tao , Hua Wang , Fan Zhang

Over-smoothing remains a fundamental challenge in deep Graph Neural Networks (GNNs), where repeated message passing causes node representations to become indistinguishable. While existing solutions, such as residual connections and skip…

Machine Learning · Computer Science 2026-04-13 Xin He , Yili Wang , Yiwei Dai , Xin Wang

RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions by fusing visible and thermal infrared modalities. However, existing RGBT trackers rely solely on initial-frame visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hao Li , Yuhao Wang , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

Understanding indoor scenes is crucial for urban studies. Considering the dynamic nature of indoor environments, effective semantic segmentation requires both real-time operation and high accuracy.To address this, we propose AsymFormer, a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Siqi Du , Weixi Wang , Renzhong Guo , Ruisheng Wang , Yibin Tian , Shengjun Tang