English
Related papers

Related papers: AMM-Diff: Adaptive Multi-Modality Diffusion Networ…

200 papers

Motion artifacts remain a significant challenge in Magnetic Resonance Imaging (MRI), compromising diagnostic quality and potentially leading to misdiagnosis or repeated scans. Existing deep learning approaches for motion artifact correction…

Image and Video Processing · Electrical Eng. & Systems 2025-11-24 Paolo Angella , Luca Balbi , Fabrizio Ferrando , Paolo Traverso , Rosario Varriale , Vito Paolo Pastore , Matteo Santacesaria

Semantic segmentation in remote sensing (RS) has advanced significantly with the incorporation of multi-modal data, particularly the integration of RGB imagery and the Digital Surface Model (DSM), which provides complementary contextual and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Hui Ye , Haodong Chen , Zeke Zexi Hu , Xiaoming Chen , Yuk Ying Chung

In recent years, multimodal medical data-based survival analysis has attracted much attention. However, real-world datasets often suffer from the problem of incomplete modality, where some patient modality information is missing due to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yi Yin , Yuntao Shou , Zao Dai , Yun Peng , Tao Meng , Wei Ai , Keqin Li

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

In the digital age, advanced image editing tools pose a serious threat to the integrity of visual content, making image forgery detection and localization a key research focus. Most existing Image Manipulation Localization (IML) methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yachun Mi , Xingyang He , Shixin Sun , Yu Li , Yanting Li , Zhixuan Li , Jian Jin , Chen Hui , Shaohui Liu

Diffusion models excel at creating visually-convincing images, but they often struggle to meet subtle constraints inherent in the training data. Such constraints could be physics-based (e.g., satisfying a PDE), geometric (e.g., respecting…

Machine Learning · Computer Science 2025-04-11 Berthy T. Feng , Ricardo Baptista , Katherine L. Bouman

In this article, we present a Latent Diffusion Model (LDM) for the generation of brain Magnetic Resonance Imaging (MRI), conditioning its generation based on pathology (Healthy, Glioblastoma, Sclerosis, Dementia) and acquisition modality…

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Diffusion models (DMs) have emerged as powerful generative models for solving inverse problems, offering a good approximation of prior distributions of real-world image data. Typically, diffusion models rely on large-scale clean signals to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yifei Wang , Weimin Bai , Weijian Luo , Wenzheng Chen , He Sun

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

The performance of anomaly inspection in industrial manufacturing is constrained by the scarcity of anomaly data. To overcome this challenge, researchers have started employing anomaly generation approaches to augment the anomaly dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Ying Jin , Jinlong Peng , Qingdong He , Teng Hu , Jiafu Wu , Hao Chen , Haoxuan Wang , Wenbing Zhu , Mingmin Chi , Jun Liu , Yabiao Wang

Unsupervised Out-of-Distribution (OOD) detection consists in identifying anomalous regions in images leveraging only models trained on images of healthy anatomy. An established approach is to tokenize images and model the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Sergio Naval Marimont , Vasilis Siomos , Giacomo Tarroni

Magnetic resonance imaging (MRI) is a vital diagnostic tool, but its inherently long acquisition times reduce clinical efficiency and patient comfort. Recent advancements in deep learning, particularly diffusion models, have improved…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Yuxuan Zhang , Jinkui Hao , Bo Zhou

Medical image segmentation has been significantly advanced with the rapid development of deep learning (DL) techniques. Existing DL-based segmentation models are typically discriminative; i.e., they aim to learn a mapping from the input…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Tao Chen , Chenhui Wang , Zhihao Chen , Yiming Lei , Hongming Shan

Anomaly detection in multivariate time series data is of paramount importance for ensuring the efficient operation of large-scale systems across diverse domains. However, accurately detecting anomalies in such data poses significant…

Machine Learning · Computer Science 2023-11-15 Yuhang Chen , Chaoyun Zhang , Minghua Ma , Yudong Liu , Ruomeng Ding , Bowen Li , Shilin He , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

The segmentation of substantial brain lesions is a significant and challenging task in the field of medical image segmentation. Substantial brain lesions in brain imaging exhibit high heterogeneity, with indistinct boundaries between lesion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Hongming Wang , Yifeng Wu , Huimin Huang , Hongtao Wu , Jia-Xuan Jiang , Xiaodong Zhang , Hao Zheng , Xian Wu , Yefeng Zheng , Jinping Xu , Jing Cheng

Neural networks have achieved remarkable performance across a wide range of tasks, yet they remain susceptible to adversarial perturbations, which pose significant risks in safety-critical applications. With the rise of multimodality,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Xinxin Liu , Zhongliang Guo , Siyuan Huang , Chun Pong Lau

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

In medical real-world study (RWS), how to fully utilize the fragmentary and scarce information in model training to generate the solid diagnosis results is a challenging task. In this work, we introduce a novel multi-instance neural…

Machine Learning · Computer Science 2019-07-04 Zeyuan Wang , Josiah Poon , Simon Poon

Multimodal federated learning holds immense potential for collaboratively training models from multiple sources without sharing raw data, addressing both data scarcity and privacy concerns, two key challenges in healthcare. A major…

Machine Learning · Computer Science 2025-05-27 Pranav Poudel , Aavash Chhetri , Prashnna Gyawali , Georgios Leontidis , Binod Bhattarai