English
Related papers

Related papers: Attention-based Multi-modal Fusion Network for Sem…

200 papers

In recent years, how to strike a good trade-off between accuracy and inference speed has become the core issue for real-time semantic segmentation applications, which plays a vital role in real-world scenarios such as autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Guangwei Gao , Guoan Xu , Yi Yu , Jin Xie , Jian Yang , Dong Yue

Accurately segmenting blood vessels in retinal fundus images is crucial in the early screening, diagnosing, and evaluating some ocular diseases, yet it poses a nontrivial uncertainty for the segmentation task due to various factors such as…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Yuanyuan Peng , Pengpeng Luan , Zixu Zhang

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

The low-level spatial detail information and high-level semantic abstract information are both essential to the semantic segmentation task. The features extracted by the deep network can obtain rich semantic information, while a lot of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Xiaojie Fang , Xingguo Song , Xiangyin Meng , Xu Fang , Sheng Jin

RGB and thermal image fusion have great potential to exhibit improved semantic segmentation in low-illumination conditions. Existing methods typically employ a two-branch encoder framework for multimodal feature extraction and design…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhengwen Shen , Yulian Li , Han Zhang , Yuchen Weng , Jun Wang

Euclidean representation learning methods have achieved promising results in image fusion tasks, which can be attributed to their clear advantages in handling with linear space. However, data collected from a realistic scene usually has a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Huan Kang , Hui Li , Tianyang Xu , Xiao-Jun Wu , Rui Wang , Chunyang Cheng , Josef Kittler

Modern high-performance semantic segmentation methods employ a heavy backbone and dilated convolution to extract the relevant feature. Although extracting features with both contextual and semantic information is critical for the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Mohammed A. M. Elhassan , Chenhui Yang , Chenxi Huang , Tewodros Legesse Munea , Xin Hong , Abuzar B. M. Adam , Amina Benabid

Due to the over-fitting problem caused by imbalance samples, there is still room to improve the performance of data-driven automatic modulation classification (AMC) in noisy scenarios. By fully considering the signal characteristics, an AMC…

Signal Processing · Electrical Eng. & Systems 2022-03-08 Hao Shi , Qi Peng , Yiqi Zhuang

We propose a novel Synergistic Attention Network (SA-Net) to address the light field salient object detection by establishing a synergistic effect between multi-modal features with advanced attention mechanisms. Our SA-Net exploits the rich…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Yi Zhang , Geng Chen , Qian Chen , Yujia Sun , Yong Xia , Olivier Deforges , Wassim Hamidouche , Lu Zhang

Neural networks for visual content understanding have recently evolved from convolutional ones (CNNs) to transformers. The prior (CNN) relies on small-windowed kernels to capture the regional clues, demonstrating solid local expressiveness.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zixuan Su , Hao Zhang , Jingjing Chen , Lei Pang , Chong-Wah Ngo , Yu-Gang Jiang

Monocular Semantic Scene Completion (MSSC) aims to predict the voxel-wise occupancy and semantic category from a single-view RGB image. Existing methods adopt a single-stage framework that aims to simultaneously achieve visible region…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuzhi Wang , Xinran Wu , Song Wang , Lingdong Kong , Ziping Zhao

Semantic Scene Completion (SSC) aims to jointly infer semantics and occupancies of 3D scenes. Truncated Signed Distance Function (TSDF), a 3D encoding of depth, has been a common input for SSC. Furthermore, RGB-TSDF fusion, seems promising…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Laiyan Ding , Panwen Hu , Jie Li , Rui Huang

The goal of the Semantic Scene Completion (SSC) task is to simultaneously predict a completed 3D voxel representation of volumetric occupancy and semantic labels of objects in the scene from a single-view observation. Since the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Xiaokang Chen , Kwan-Yee Lin , Chen Qian , Gang Zeng , Hongsheng Li

This paper addresses the challenge of perceiving complete object shapes through visual perception. While prior studies have demonstrated encouraging outcomes in segmenting the visible parts of objects within a scene, amodal segmentation, in…

Robotics · Computer Science 2024-08-07 Jinyu Zhang , Yongchong Gu , Jianxiong Gao , Haitao Lin , Qiang Sun , Xinwei Sun , Xiangyang Xue , Yanwei Fu

Monocular Semantic Scene Completion (SSC) aims to reconstruct complete 3D semantic scenes from a single RGB image, offering a cost-effective solution for autonomous driving and robotics. However, the inherently imbalanced nature of voxel…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yu Xue , Longjun Gao , Yuanqi Su , HaoAng Lu , Xiaoning Zhang

3D to 2D retinal vessel segmentation is a challenging problem in Optical Coherence Tomography Angiography (OCTA) images. Accurate retinal vessel segmentation is important for the diagnosis and prevention of ophthalmic diseases. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-12-17 Zhuojie Wu , Zijian Wang , Wenxuan Zou , Fan Ji , Hao Dang , Wanting Zhou , Muyi Sun

Independent indoor mobility remains a critical challenge for individuals with visual impairments, largely due to the limited capability of existing assistive systems in detecting fine-grained hazardous objects such as chairs, tables, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Qi He , XiangXiang Wang , Jingtao Zhang , Yongbin Yu , Hongxiang Chu , Manping Fan , JingYe Cai , Zhenglin Yang

Fusion of 2D images and 3D point clouds is important because information from dense images can enhance sparse point clouds. However, fusion is challenging because 2D and 3D data live in different spaces. In this work, we propose MVPNet…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Maximilian Jaritz , Jiayuan Gu , Hao Su

Semantic segmentation of multi-modal remote sensing imagery plays a pivotal role in land use/land cover (LULC) mapping, environmental monitoring, and precision earth observation. Current multi-modal approaches mainly focus on integrating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jinkun Dai , Yuanxin Ye , Peng Tang , Tengfeng Tang , Xianping Ma , Jing Xiao , Mi Wang

In this paper, we introduce the Selective Image Guided Network (SigNet), a novel degradation-aware framework that transforms depth completion into depth enhancement for the first time. Moving beyond direct completion using convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zhiqiang Yan , Zhengxue Wang , Kun Wang , Jun Li , Jian Yang