English
Related papers

Related papers: DF-DM: A foundational process model for multimodal…

200 papers

Modern deep learning methods have achieved impressive results across tasks from disease classification, estimating continuous biomarkers, to generating realistic medical images. Most of these approaches are trained to model conditional…

Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are…

Machine Learning · Computer Science 2024-12-13 Ricardo Augusto Borsoi , Konstantin Usevich , David Brie , Tülay Adali

Image-text matching is a key multimodal task that aims to model the semantic association between images and text as a matching relationship. With the advent of the multimedia information age, image, and text data show explosive growth, and…

Machine Learning · Computer Science 2024-06-24 Jinyin Wang , Haijing Zhang , Yihao Zhong , Yingbin Liang , Rongwei Ji , Yiru Cang

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Pouria Rouzrokh , Bardia Khosravi , Shahriar Faghani , Mana Moassefi , Sanaz Vahdati , Bradley J. Erickson

Tensor decomposition is an important tool for multiway data analysis. In practice, the data is often sparse yet associated with rich temporal information. Existing methods, however, often under-use the time information and ignore the…

Machine Learning · Computer Science 2023-10-31 Zheng Wang , Shikai Fang , Shibo Li , Shandian Zhe

While deep learning holds great promise for disease diagnosis and prognosis in cardiac magnetic resonance imaging, its progress is often constrained by highly imbalanced and biased training datasets. To address this issue, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Grzegorz Skorupko , Richard Osuala , Zuzanna Szafranowska , Kaisar Kushibar , Vien Ngoc Dang , Nay Aung , Steffen E Petersen , Karim Lekadir , Polyxeni Gkontra

Focus based methods have shown promising results for the task of depth estimation. However, most existing focus based depth estimation approaches depend on maximal sharpness of the focal stack. Out of focus information in the focal stack…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Yongri Piao , Yukun Zhang , Miao Zhang , Xinxin Ji

In recent years, data-driven machine learning (ML) methods have revolutionized the computer vision community by providing novel efficient solutions to many unsolved (medical) image analysis problems. However, due to the increasing privacy…

Image and Video Processing · Electrical Eng. & Systems 2021-03-08 Cosmin I. Bercea , Benedikt Wiestler , Daniel Rueckert , Shadi Albarqouni

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Deep learning is quickly becoming the leading methodology for medical image analysis. Given a large medical archive, where each image is associated with a diagnosis, efficient pathology detectors or classifiers can be trained with virtually…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 Gwenolé Quellec , Katia Charrière , Yassine Boudi , Béatrice Cochener , Mathieu Lamard

Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets…

Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients) without sharing the local data of the clients. Most of the existing FL methods assume that the data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Drug-drug interactions (DDIs) are a leading cause of preventable adverse events, often complicating treatment and increasing healthcare costs. At the same time, knowing which drugs do not interact is equally important, as such knowledge…

Machine Learning · Computer Science 2026-01-08 Maryam Abdollahi Shamami , Babak Teimourpour , Farshad Sharifi

Human Activity Recognition is an important task in many human-computer collaborative scenarios, whilst having various practical applications. Although uni-modal approaches have been extensively studied, they suffer from data quality and…

Human-Computer Interaction · Computer Science 2023-05-09 Jingcheng Li , Lina Yao , Binghao Li , Claude Sammut

In the rapidly evolving landscape of medical imaging diagnostics, achieving high accuracy while preserving computational efficiency remains a formidable challenge. This work presents \texttt{DeepMediX}, a groundbreaking, resource-efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Kishore Babu Nampalle , Pradeep Singh , Uppala Vivek Narayan , Balasubramanian Raman

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

Multi-modal depth estimation is one of the key challenges for endowing autonomous machines with robust robotic perception capabilities. There have been outstanding advances in the development of uni-modal depth estimation techniques based…

Robotics · Computer Science 2023-07-21 Johan S. Obando-Ceron , Victor Romero-Cano , Sildomar Monteiro

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

Diffusion models have demonstrated significant potential in producing high-quality images in medical image translation to aid disease diagnosis, localization, and treatment. Nevertheless, current diffusion models have limited success in…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yunxiang Li , Hua-Chieh Shao , Xiaoxue Qian , You Zhang

Deep learning has proven to be a highly effective tool for a wide range of applications, significantly when leveraging the power of multi-loss functions to optimize performance on multiple criteria simultaneously. However, optimal selection…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Amin Golnari , Mostafa Diba