English
Related papers

Related papers: Multimodal Graph Representation Learning for Robus…

200 papers

Deformable registration is one of the most challenging task in the field of medical image analysis, especially for the alignment between different sequences and modalities. In this paper, a non-rigid registration method is proposed for 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xiaoyue Zhang , Weijian Jian , Yu Chen , Shihting Yang

The classification of indoor scenes is a critical component in various applications, such as intelligent robotics for assistive living. While deep learning has significantly advanced this field, models often suffer from reduced performance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Willams de Lima Costa , Raul Ismayilov , Nicola Strisciuglio , Estefania Talavera Martinez

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

With the development of deep convolutional neural networks, medical image segmentation has achieved a series of breakthroughs in recent years. However, the high-performance convolutional neural networks always mean numerous parameters and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Wenxuan Zou , Muyi Sun

The crucial components of a conventional image registration method are the choice of the right feature representations and similarity measures. These two components, although elaborately designed, are somewhat handcrafted using human…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Shanhui Sun , Jing Hu , Mingqing Yao , Jinrong Hu , Xiaodong Yang , Qi Song , Xi Wu

Reconstructing the 3D shape of a deformable environment from the information captured by a moving depth camera is highly relevant to surgery. The underlying challenge is the fact that simultaneously estimating camera motion and tissue…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Guido Caccianiga , Julian Nubert , Cesar Cadena , Marco Hutter , Katherine J. Kuchenbecker

Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Hongruixuan Chen , Naoto Yokoya , Chen Wu , Bo Du

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

Accurate temporal segmentation of human actions is critical for intelligent robots in collaborative settings, where a precise understanding of sub-activity labels and their temporal structure is essential. However, the inherent noise in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Hao Xing , Kai Zhe Boey , Yuankai Wu , Darius Burschka , Gordon Cheng

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

In multimodal graph learning, graph structures that integrate information from multiple sources, such as vision and text, can more comprehensively model complex entity relationships. However, the continuous growth of their data scale poses…

Machine Learning · Computer Science 2026-02-10 Lian Shen , Zhendan Chen , Meijia Song , Yinhui jiang , Ziming Su , Juan Liu , Xiangrong Liu

Benefiting from the powerful expressive capability of graphs, graph-based approaches have been popularly applied to handle multi-modal medical data and achieved impressive performance in various biomedical applications. For disease…

Machine Learning · Computer Science 2022-03-14 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yuchen Yang , Yao Zhao

Disentangling complex causal relationships is important for accurate detection of anomalies. In multivariate time series analysis, dynamic interactions among data variables over time complicate the interpretation of causal relationships.…

Machine Learning · Computer Science 2025-10-14 Wonah Kim , Jeonghyeon Park , Dongsan Jun , Jungkyu Han , Sejin Chun

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman

Motion artifacts caused by prolonged acquisition time are a significant challenge in Magnetic Resonance Imaging (MRI), hindering accurate tissue segmentation. These artifacts appear as blurred images that mimic tissue-like appearances,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Sunyoung Jung , Yoonseok Choi , Mohammed A. Al-masni , Minyoung Jung , Dong-Hyun Kim

Deep learning-based computer-aided diagnosis is gradually deployed to review and analyze medical images. However, this paradigm is restricted in real-world clinical applications due to the poor robustness and generalization. The issue is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yurong Chen

Multi-domain data are widely leveraged in vision applications taking advantage of complementary information from different modalities, e.g., brain tumor segmentation from multi-parametric magnetic resonance imaging (MRI). However, due to…

Automated medical report generation has demonstrated the potential to significantly reduce the workload associated with time-consuming medical reporting. Recent generative representation learning methods have shown promise in integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shuchang Ye , Mingyuan Meng , Mingjian Li , Dagan Feng , Usman Naseem , Jinman Kim

Graph anomaly detection (GAD) is increasingly crucial in various applications, ranging from financial fraud detection to fake news detection. However, current GAD methods largely overlook the fairness problem, which might result in…

Machine Learning · Computer Science 2025-03-04 Wenjing Chang , Kay Liu , Philip S. Yu , Jianjun Yu

Learning to infer graph representations and performing spatial reasoning in a complex surgical environment can play a vital role in surgical scene understanding in robotic surgery. For this purpose, we develop an approach to generate the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Mobarakol Islam , Lalithkumar Seenivasan , Lim Chwee Ming , Hongliang Ren