English
Related papers

Related papers: Balanced Diffusion-Guided Fusion for Multimodal Re…

200 papers

Multimodal MRIs play a crucial role in clinical diagnosis and treatment. Feature disentanglement (FD)-based methods, aiming at learning superior feature representations for multimodal data analysis, have achieved significant success in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Salient object detection (SOD) requires modeling both long-range contextual dependencies and fine-grained structural details, which remains challenging for convolutional, transformer-based, and Mamba-based state space models. While recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Suklav Ghosh , Arijit Sur , Pinaki Mitra

Accurate multivariate time series forecasting hinges on inter-series correlations, which often evolve in complex ways across different temporal scales. Existing methods are limited in modeling these multi-scale dependencies and struggle to…

Machine Learning · Computer Science 2026-01-27 Shaoxun Wang , Xingjun Zhang , Qianyang Li , Jiawei Cao , Zhendong Tan

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Saurabh Agarwal , K. V. Arya , Yogesh Kumar Meena

Recently, denoising diffusion probabilistic models (DDPM) have been applied to image segmentation by generating segmentation masks conditioned on images, while the applications were mainly limited to 2D networks without exploiting potential…

Image and Video Processing · Electrical Eng. & Systems 2023-08-21 Yunguan Fu , Yiwen Li , Shaheer U. Saeed , Matthew J. Clarkson , Yipeng Hu

Text-to-image generation models have achieved remarkable capabilities in synthesizing images, but often struggle to provide fine-grained control over the output. Existing guidance approaches, such as segmentation maps and depth maps,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Sangmin Jung , Utkarsh Nath , Yezhou Yang , Giulia Pedrielli , Joydeep Biswas , Amy Zhang , Hassan Ghasemzadeh , Pavan Turaga

Multi-modality (MM) image fusion aims to render fused images that maintain the merits of different modalities, e.g., functional highlight and detailed textures. To tackle the challenge in modeling cross-modality features and decomposing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Shuang Xu , Zudi Lin , Radu Timofte , Luc Van Gool

Diffusion models have achieved significant success in both natural image and medical image domains, encompassing a wide range of applications. Previous investigations in medical images have often been constrained to specific anatomical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yongrui Yu , Yannian Gu , Shaoting Zhang , Xiaofan Zhang

Beamforming (BF) is essential for enhancing system capacity in fifth generation (5G) and beyond wireless networks, yet exhaustive beam training in ultra-massive multiple-input multiple-output (MIMO) systems incurs substantial overhead. To…

Signal Processing · Electrical Eng. & Systems 2026-02-11 Yanliang Jin , Yunfan Li , Jiang Jun , Yuan Gao , Shengli Liu , Jianbo Du , Zhaohui Yang , Shugong Xu

Multispectral oriented object detection faces challenges due to both inter-modal and intra-modal discrepancies. Recent studies often rely on transformer-based models to address these issues and achieve cross-modal fusion detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Minghang Zhou , Tianyu Li , Chaofan Qiao , Dongyu Xie , Guoqing Wang , Ningjuan Ruan , Lin Mei , Yang Yang

Diverse human motion prediction (HMP) aims to predict multiple plausible future motions given an observed human motion sequence. It is a challenging task due to the diversity of potential human motions while ensuring an accurate description…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Hua Yu , Yaqing Hou , Wenbin Pei , Qiang Zhang

Realistic synthetic tabular data generation encounters significant challenges in preserving privacy, especially when dealing with sensitive information in domains like finance and healthcare. In this paper, we introduce \textit{Federated…

Machine Learning · Computer Science 2024-01-15 Timur Sattarov , Marco Schreyer , Damian Borth

Diffusion probabilistic model (DPM) recently becomes one of the hottest topic in computer vision. Its image generation application such as Imagen, Latent Diffusion Models and Stable Diffusion have shown impressive generation capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Junde Wu , Rao Fu , Huihui Fang , Yu Zhang , Yehui Yang , Haoyi Xiong , Huiying Liu , Yanwu Xu

Real-world data often has a long-tailed distribution, where the scarcity of tail samples significantly limits the model's generalization ability. Denoising Diffusion Probabilistic Models (DDPM) are generative models based on stochastic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Jingyu Kong , Yuan Guo , Yu Wang , Yuping Duan

Diffusion Probabilistic Field (DPF) models the distribution of continuous functions defined over metric spaces. While DPF shows great potential for unifying data generation of various modalities including images, videos, and 3D geometry, it…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Kangfu Mei , Mo Zhou , Vishal M. Patel

Integrating grayscale and depth data in road inspection robots could enhance the accuracy, reliability, and comprehensiveness of road condition assessments, leading to improved maintenance strategies and safer infrastructure. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiaoyan Jiang , Licheng Jiang , Anjie Wang , Kaiying Zhu , Yongbin Gao

Computational fluid dynamics (CFD) is a powerful tool for modeling turbulent flow and is commonly used for urban microclimate simulations. However, traditional CFD methods are computationally intensive, requiring substantial hardware…

Recent advancements in diffusion models have demonstrated significant success in unsupervised anomaly segmentation. For anomaly segmentation, these models are first trained on normal data; then, an anomalous image is noised to an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Mehrdad Moradi , Kamran Paynabar

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo