English
Related papers

Related papers: multimodars: A Rust-powered toolkit for multi-moda…

200 papers

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

In this paper, we propose a robust 3D detector, named Cross Modal Transformer (CMT), for end-to-end 3D multi-modal detection. Without explicit view transformation, CMT takes the image and point clouds tokens as inputs and directly outputs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Junjie Yan , Yingfei Liu , Jianjian Sun , Fan Jia , Shuailin Li , Tiancai Wang , Xiangyu Zhang

Contemporary cardiovascular management involves complex consideration and integration of multimodal cardiac datasets, where each modality provides distinct but complementary physiological characteristics. While the effective integration of…

Coherent multi-transducer ultrasound (CoMTUS) creates an extended effective aperture through the coherent combination of multiple arrays, which results in images with enhanced resolution, extended field-of-view, and higher sensitivity. The…

Multi-modal fusion of sensors is a commonly used approach to enhance the performance of odometry estimation, which is also a fundamental module for mobile robots. However, the question of \textit{how to perform fusion among different…

Robotics · Computer Science 2025-03-20 Leyuan Sun , Guanqun Ding , Yue Qiu , Yusuke Yoshiyasu , Fumio Kanehiro

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

mmid (Multi-Modal Integration and Downstream analyses for healthcare analytics) is a Python package that offers multi-modal fusion and imputation, classification, time-to-event prediction and clustering functionalities under a single…

Computer-Assisted Interventions enable clinicians to perform precise, minimally invasive procedures, often relying on advanced imaging methods. Cone-beam computed tomography (CBCT) can be used to facilitate computer-assisted interventions,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-04 Maximilian E. Tschuchnig , Philipp Steininger , Michael Gadermayr

Multimodal image matching is an important prerequisite for multisource image information fusion. Compared with the traditional matching problem, multimodal feature matching is more challenging due to the severe nonlinear radiation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Jiayuan Li , Pengcheng Shi , Qingwu Hu , Yongjun Zhang

X-ray Computed Tomography (CT) is used to recover the true surfaces of fluid channels and fed to simulation tool (ANSYS) to create accurate cyber environment. The simulation tool also receives CT-assisted multiphase fluid profiles…

Fluid Dynamics · Physics 2024-08-06 Vaishali Sharma , Arpit Kumar , Snehlata Shakya , Mayank Goswami

Coronary artery calcium (CAC) scoring plays a crucial role in the early detection and risk stratification of coronary artery disease (CAD). In this study, we focus on non-contrast coronary computed tomography angiography (CCTA) scans, which…

Medical image fusion is the process of registering and combining multiple images from single or multiple imaging modalities to improve the imaging quality and reduce randomness and redundancy in order to increase the clinical applicability…

Computer Vision and Pattern Recognition · Computer Science 2014-01-03 A. P. James , B. V. Dasarathy

Cardiac image segmentation is essential for automated cardiac function assessment and monitoring of changes in cardiac structures over time. Inspired by coarse-to-fine approaches in image analysis, we propose a novel multitask compositional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Abbas Khan , Muhammad Asad , Martin Benning , Caroline Roney , Gregory Slabaugh

Many state-of-the-art RGB-T trackers have achieved remarkable results through modality fusion. However, these trackers often either overlook temporal information or fail to fully utilize it, resulting in an ineffective balance between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Zhirong Zeng , Xiaotao Liu , Meng Sun , Hongyu Wang , Jing Liu

Conventional cardiovascular magnetic resonance (CMR) cine imaging relies on binning multiple heartbeats into a single cardiac cycle, which fails in arrhythmic patients where beat-to-beat variability causes motion artifacts and loss of…

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Infrared-visible image fusion aims to integrate infrared and visible information into a single fused image. Existing 2D fusion methods focus on fusing images from fixed camera viewpoints, neglecting a comprehensive understanding of complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Chao Yang , Deshui Miao , Chao Tian , Guoqing Zhu , Yameng Gu , Zhenyu He

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He