English
Related papers

Related papers: M$^3$amba: CLIP-driven Mamba Model for Multi-modal…

200 papers

Multimodal semantic segmentation is a pivotal component of computer vision and typically surpasses unimodal methods by utilizing rich information set from various sources.Current models frequently adopt modality-specific frameworks that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Bingyu Li , Da Zhang , Zhiyuan Zhao , Junyu Gao , Xuelong Li

Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zifu Wan , Pingping Zhang , Yuhao Wang , Silong Yong , Simon Stepputtis , Katia Sycara , Yaqi Xie

Existing Transformer-based models for point cloud analysis suffer from quadratic complexity, leading to compromised point cloud resolution and information loss. In contrast, the newly proposed Mamba model, based on state space models (SSM),…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xu Han , Yuan Tang , Zhaoxuan Wang , Xianzhi Li

Multimodal Sentiment Analysis (MSA) with missing modalities has recently attracted increasing attention. Although existing research mainly focuses on designing complex model architectures to handle incomplete data, it still faces…

Multimedia · Computer Science 2025-08-01 Xiang Li , Xianfu Cheng , Xiaoming Zhang , Zhoujun Li

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Recently, Mamba-based methods have demonstrated impressive performance in point cloud representation learning by leveraging State Space Model (SSM) with the efficient context modeling ability and linear complexity. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Chuxin Wang , Yixin Zha , Wenfei Yang , Tianzhu Zhang

In recent years, robust matching methods using deep learning-based approaches have been actively studied and improved in computer vision tasks. However, there remains a persistent demand for both robust and fast matching techniques. To…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Kihwan Ryoo , Hyungtae Lim , Hyun Myung

General networks for 3D medical image segmentation have recently undergone extensive exploration. Behind the exceptional performance of these networks lies a significant demand for a large volume of pixel-level annotated data, which is…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Hualiang Wang , Yiqun Lin , Xinpeng Ding , Xiaomeng Li

As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yice Cao , Chenchen Liu , Zhenhua Wu , Wenxin Yao , Liu Xiong , Jie Chen , Zhixiang Huang

Recently, Mamba-based methods have become popular in medical image segmentation due to their lightweight design and long-range dependency modeling capabilities. However, current segmentation methods frequently encounter challenges in fetal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Caixu Xu , Junming Wei , Huizhen Chen , Pengchen Liang , Bocheng Liang , Ying Tan , Xintong Wei

In the domain of 3D biomedical image segmentation, Mamba exhibits the superior performance for it addresses the limitations in modeling long-range dependencies inherent to CNNs and mitigates the abundant computational overhead associated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Weitong Wu , Zhaohu Xing , Jing Gong , Qin Peng , Lei Zhu

Modern Web systems such as social media and e-commerce contain rich contents expressed in images and text. Leveraging information from multi-modalities can improve the performance of machine learning tasks such as classification and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Huidong Liu , Shaoyuan Xu , Jinmiao Fu , Yang Liu , Ning Xie , Chien-Chih Wang , Bryan Wang , Yi Sun

Despite impressive advancements in recent multimodal reasoning approaches, they are still limited in flexibility and efficiency, as these models typically process only a few fixed modality inputs and require updates to numerous parameters.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shoubin Yu , Jaehong Yoon , Mohit Bansal

Autonomous driving systems face significant challenges in perceiving complex environments and making real-time decisions. Traditional modular approaches, while offering interpretability, suffer from error propagation and coordination…

Artificial Intelligence · Computer Science 2025-08-11 Siyi Lu , Run Liu , Dongsheng Yang , Lei He

Semantic Change Detection (SCD) from remote sensing imagery requires models balancing extensive spatial context, computational efficiency, and sensitivity to class-imbalanced land-cover transitions. While Convolutional Neural Networks excel…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Buddhi Wijenayake , Athulya Ratnayake , Praveen Sumanasekara , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath , Nichula Wasalathilaka

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Recent advancements in transformer-based monocular 3D object detection techniques have exhibited exceptional performance in inferring 3D attributes from single 2D images. However, most existing methods rely on resource-intensive transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Youjia Fu , Zihao Xu , Junsong Fu , Huixia Xue , Shuqiu Tan , Lei Li

Recent advancements in reinforcement learning (RL) for analog circuit optimization have demonstrated significant potential for improving sample efficiency and generalization across diverse circuit topologies and target specifications.…

Machine Learning · Computer Science 2024-11-26 Youngmin Oh , Jinje Park , Seunggeun Kim , Taejin Paik , David Pan , Bosun Hwang

In recent years, the application of multimodal large language models (MLLM) in various fields has achieved remarkable success. However, as the foundation model for many downstream tasks, current MLLMs are composed of the well-known…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Zhao , Min Zhang , Wei Zhao , Pengxiang Ding , Siteng Huang , Donglin Wang

While machine-learned models are now routinely employed to facilitate astronomical inquiry, model inputs tend to be limited to a primary data source (namely images or time series) and, in the more advanced approaches, some metadata. Yet…

Instrumentation and Methods for Astrophysics · Physics 2024-11-14 Mariia Rizhko , Joshua S. Bloom