English
Related papers

Related papers: DAMM-Diffusion: Learning Divergence-Aware Multi-Mo…

200 papers

Neural networks have achieved remarkable performance across a wide range of tasks, yet they remain susceptible to adversarial perturbations, which pose significant risks in safety-critical applications. With the rise of multimodality,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Xinxin Liu , Zhongliang Guo , Siyuan Huang , Chun Pong Lau

Deep learning-based techniques for the analysis of multimodal remote sensing data have become popular due to their ability to effectively integrate complementary spatial, spectral, and structural information from different sensors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hao Liu , Yongjie Zheng , Yuhan Kang , Mingyang Zhang , Maoguo Gong , Lorenzo Bruzzone

Refractory multi-principal element alloys (RMPEAs) represent a novel class of alloys characterized by an extensive compositional design space and the potential for exceptional mechanical performance under extreme conditions. While accurate…

Materials Science · Physics 2026-04-21 A. K. Shargh , C. D. Stiles , J. A. El-Awady

In recent years, computational pathology has seen tremendous progress driven by deep learning methods in segmentation and classification tasks aiding prognostic and diagnostic settings. Nuclei segmentation, for instance, is an important…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Aman Shrivastava , P. Thomas Fletcher

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Multimodal probability distributions are common in both quantum and classical systems, yet modeling them remains challenging when the number of modes is large or unknown. Classical methods such as mixture-density networks (MDNs) scale…

Quantum Physics · Physics 2026-01-28 Jaemin Seo

Scientific machine learning (SciML) increasingly requires models that capture multimodal conditional uncertainty arising from ill-posed inverse problems, multistability, and chaotic dynamics. While recent work has favored highly expressive…

Machine Learning · Computer Science 2026-02-03 Leonardo Ferreira Guilhoto , Akshat Kaushal , Paris Perdikaris

With the widespread adoption of millimeter-wave (mmWave) massive multi-input-multi-output (MIMO) in vehicular networks, accurate beam prediction and alignment have become critical for high-speed data transmission and reliable access. While…

Information Theory · Computer Science 2026-03-27 Chenyiming Wen , Binpu Shi , Min Li , Ming-Min Zhao , Min-Jian Zhao , Jiangzhou Wang

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chunxiao Li , Xiaoxiao Wang , Boming Miao , Chuanlong Xie , Zizhe Wang , Yao Zhu

Q-distribution prediction is a crucial research direction in controlled nuclear fusion, with deep learning emerging as a key approach to solving prediction challenges. In this paper, we leverage deep learning techniques to tackle the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Shiao Wang , Yifeng Wang , Qingchuan Ma , Xiao Wang , Ning Yan , Qingquan Yang , Guosheng Xu , Jin Tang

Accurate brain tumor diagnosis relies on the assessment of multiple Magnetic Resonance Imaging (MRI) sequences. However, in clinical practice, the acquisition of certain sequences may be affected by factors like motion artifacts or contrast…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Moinak Bhattacharya , Saumya Gupta , Annie Singh , Chao Chen , Gagandeep Singh , Prateek Prasanna

Achieving global optimality in nonlinear model predictive control (NMPC) is challenging due to the non-convex nature of the underlying optimization problem. Since commonly employed local optimization techniques depend on carefully chosen…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Tzu-Yuan Huang , Armin Lederer , Nicolas Hoischen , Jan Brüdigam , Xuehua Xiao , Stefan Sosnowski , Sandra Hirche

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

This paper proposes a unified diffusion framework (dubbed UniDiffuser) to fit all distributions relevant to a set of multi-modal data in one model. Our key insight is -- learning diffusion models for marginal, conditional, and joint…

Machine Learning · Computer Science 2023-05-31 Fan Bao , Shen Nie , Kaiwen Xue , Chongxuan Li , Shi Pu , Yaole Wang , Gang Yue , Yue Cao , Hang Su , Jun Zhu

Diffuse gliomas are malignant brain tumors that grow widespread through the brain. The complex interactions between neoplastic cells and normal tissue, as well as the treatment-induced changes often encountered, make glioma tumor growth…

Data scarcity hinders deep learning for medical imaging. We propose a framework for breast cancer classification in thermograms that addresses this using a Diffusion Probabilistic Model (DPM) for data augmentation. Our DPM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sepehr Salem , M. Moein Esfahani , Jingyu Liu , Vince Calhoun

Trajectory prediction is an essential component in autonomous driving, particularly for collision avoidance systems. Considering the inherent uncertainty of the task, numerous studies have utilized generative models to produce multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chen Liu , Shibo He , Haoyu Liu , Jiming Chen

Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these…

Automated diagnosis with artificial intelligence has emerged as a promising area in the realm of medical imaging, while the interpretability of the introduced deep neural networks still remains an urgent concern. Although contemporary…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Binghua Li , Jie Mao , Zhe Sun , Chao Li , Qibin Zhao , Toshihisa Tanaka