English
Related papers

Related papers: Multimodal registration of the face for computer-a…

200 papers

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

The application of machine learning in medicine and healthcare has led to the creation of numerous diagnostic and prognostic models. However, despite their success, current approaches generally issue predictions using data from a single…

Machine Learning · Computer Science 2025-05-13 Fergus Imrie , Stefan Denner , Lucas S. Brunschwig , Klaus Maier-Hein , Mihaela van der Schaar

Deformable image registration is a fundamental problem in the field of medical image analysis. During the last years, we have witnessed the advent of deep learning-based image registration methods which achieve state-of-the-art performance,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-03 Lucas Mansilla , Diego H. Milone , Enzo Ferrante

In the health domain, decisions are often based on different data modalities. Thus, when creating prediction models, multimodal fusion approaches that can extract and combine relevant features from different data modalities, can be highly…

Artificial Intelligence · Computer Science 2024-02-20 Mafalda Malafaia , Thalea Schlender , Peter A. N. Bosman , Tanja Alderliesten

Building a joint face-skull morphable model holds great potential for applications such as remote diagnostics, surgical planning, medical education, and physically based facial simulation. However, realizing this vision is constrained by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zidu Wang , Meng Xu , Miao Xu , Hengyuan Ma , Jiankuo Zhao , Xutao Li , Xiangyu Zhu , Zhen Lei

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

A second-order face-centred finite volume strategy on general meshes is proposed. The method uses a mixed formulation in which a constant approximation of the unknown is computed on the faces of the mesh. Such information is then used to…

Numerical Analysis · Mathematics 2020-12-01 Matteo Giacomini , Ruben Sevilla

This paper presents a partition-based surface registration for 3D morphable model(3DMM). In the 3DMM, it often requires to warp a handcrafted template model into different captured models. The proposed method first utilizes the landmarks to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Yuping Ye , Zhan Song , Juan Zhao

We propose a federated algorithm for reconstructing images using multimodal tomographic data sourced from dispersed locations, addressing the challenges of traditional unimodal approaches that are prone to noise and reduced image quality.…

Optimization and Control · Mathematics 2025-01-13 Geunyeong Byeon , Minseok Ryu , Zichao Wendy Di , Kibaek Kim

To develop intelligent speech assistants and integrate them seamlessly with intra-operative decision-support frameworks, accurate and efficient surgical phase recognition is a prerequisite. In this study, we propose a multimodal framework…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Kubilay Can Demir , Belen Lojo Rodriguez , Tobias Weise , Andreas Maier , Seung Hee Yang

In this paper, we present a short description of the method proposed to ANHIR challenge organized jointly with the IEEE ISBI 2019 conference. We propose a method consisting of preprocessing, initial alignment, nonrigid registration…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Marek Wodzinski , Andrzej Skalski

Diffeomorphic deformable multi-modal image registration is a challenging task which aims to bring images acquired by different modalities to the same coordinate space and at the same time to preserve the topology and the invertibility of…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Vasiliki Sideri-Lampretsa , Georgios Kaissis , Daniel Rueckert

Registration is a fundamental task in medical robotics and is often a crucial step for many downstream tasks such as motion analysis, intra-operative tracking and image segmentation. Popular registration methods such as ANTs and NiftyReg…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wentao Zhu , Yufang Huang , Daguang Xu , Zhen Qian , Wei Fan , Xiaohui Xie

This paper gives a review of the experience provided by our group in terms of computer aided maxillo-facial surgery.

A robust and efficient optimization-based 2D/3D registration framework is crucial for the navigation system of orthopedic surgical robots. It can provide precise position information of surgical instruments and implants during surgery.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-20 Minheng Chen , Tonglong Li , Zhirun Zhang , Youyong Kong

Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Yexing Hu , Berkan Lafci , Artur Luzgin , Hao Wang , Jan Klohs , Xose Luis Dean-Ben , Ruiqing Ni , Daniel Razansky , Wuwei Ren

An automatic elastic registration method suited for vascularized organs is proposed. The vasculature in both the preoperative and intra-operative images is represented as a graph. A typical application of this method is the fusion of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Jaime Garcia Guevara , Igor Peterlik , Marie-Odile Berger , Stéphane Cotin

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

The growing scope, scale, and number of biometric deployments around the world emphasise the need for research into technologies facilitating efficient and reliable biometric identification queries. This work presents a method of indexing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Pawel Drozdowski , Fabian Stockhardt , Christian Rathgeb , Christoph Busch

We present a robust method to correct for motion in volumetric in-utero MRI time series. Time-course analysis for in-utero volumetric MRI time series often suffers from substantial and unpredictable fetal motion. Registration provides voxel…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ruizhi Liao , Esra A. Turk , Miaomiao Zhang , Jie Luo , Elfar Adalsteinsson , P. Ellen Grant , Polina Golland