English
Related papers

Related papers: Multiscale Structure-Guided Latent Diffusion for M…

200 papers

Style transfer in DCE-MRI is a challenging task due to large variations in contrast enhancements across different tissues and time. Current unsupervised methods fail due to the wide variety of contrast enhancement and motion between the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Adam G. Tattersall , Keith A. Goatman , Lucy E. Kershaw , Scott I. K. Semple , Sonia Dahdouh

Recent advances in image editing leverage latent diffusion models (LDMs) for versatile, text-prompt-driven edits across diverse tasks. Yet, maintaining pixel-level edge structures-crucial for tasks such as photorealistic style transfer or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Minsu Gong , Nuri Ryu , Jungseul Ok , Sunghyun Cho

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

Computation and Language · Computer Science 2026-05-11 Jiaxiu Jiang , Jingjing Ren , Wenbo Li , Bo Wang , Haoze Sun , Yijun Yang , Jianhui Liu , Yanbing Zhang , Shenghe Zheng , Yuan Zhang , Haoyang Huang , Nan Duan , Wangmeng Zuo

Diffusion models have shown promising results in cross-modal generation tasks involving audio and music, such as text-to-sound and text-to-music generation. These text-controlled music generation models typically focus on generating music…

Sound · Computer Science 2024-10-24 Tornike Karchkhadze , Mohammad Rasool Izadi , Ke Chen , Gerard Assayag , Shlomo Dubnov

Image-to-image translation (I2I), and particularly its subfield of appearance transfer, which seeks to alter the visual appearance between images while maintaining structural coherence, presents formidable challenges. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yuteng Ye , Guanwen Li , Hang Zhou , Cai Jiale , Junqing Yu , Yawei Luo , Zikai Song , Qilong Xing , Youjia Zhang , Wei Yang

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

Current deep learning approaches for diffusion MRI modeling circumvent the need for densely-sampled diffusion-weighted images (DWIs) by directly predicting microstructural indices from sparsely-sampled DWIs. However, they implicitly make…

Image and Video Processing · Electrical Eng. & Systems 2021-06-25 Mengwei Ren , Heejong Kim , Neel Dey , Guido Gerig

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

Biomolecules · Quantitative Biology 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

Histological artifacts pose challenges for both pathologists and Computer-Aided Diagnosis (CAD) systems, leading to errors in analysis. Current approaches for histological artifact restoration, based on Generative Adversarial Networks…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Zhenqi He , Wenrui Liu , Minghao Yin , Kai Han

Accelerated MRI reconstruction plays a vital role in reducing scan time while preserving image quality. While most existing methods rely on complex-valued image-space or k-space data, these formats are often inaccessible in clinical…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Tao Song , Yicheng Wu , Minhao Hu , Xiangde Luo , Guoting Luo , Guotai Wang , Yi Guo , Feng Xu , Shaoting Zhang

Despite recent advancements in latent diffusion models that generate high-dimensional image data and perform various downstream tasks, there has been little exploration into perceptual consistency within these models on the task of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Shreshth Saini , Ru-Ling Liao , Yan Ye , Alan C. Bovik

Latent Diffusion Models (LDMs) inherently follow a coarse-to-fine generation process, where high-level semantic structure is generated slightly earlier than fine-grained texture. This indicates the preceding semantics potentially benefit…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yueming Pan , Ruoyu Feng , Qi Dai , Yuqi Wang , Wenfeng Lin , Mingyu Guo , Chong Luo , Nanning Zheng

We present a latent diffusion-based differentiable inversion method (LD-DIM) for PDE-constrained inverse problems involving high-dimensional spatially distributed coefficients. LD-DIM couples a pretrained latent diffusion prior with an…

Numerical Analysis · Mathematics 2025-12-30 Zihan Lin , QiZhi He

Salient object detection (SOD) requires modeling both long-range contextual dependencies and fine-grained structural details, which remains challenging for convolutional, transformer-based, and Mamba-based state space models. While recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Suklav Ghosh , Arijit Sur , Pinaki Mitra

This paper presents a novel theoretical framework for understanding how diffusion models can learn disentangled representations. Within this framework, we establish identifiability conditions for general disentangled latent variable models,…

Recent generative-prior-based methods have shown promising blind face restoration performance. They usually project the degraded images to the latent space and then decode high-quality faces either by single-stage latent optimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Maitreya Suin , Rama Chellappa

Session-based recommendation (SBR) predicts the next item based on anonymous sessions. Traditional SBR explores user intents based on ID collaborations or auxiliary content. To further alleviate data sparsity and cold-start issues, recent…

Information Retrieval · Computer Science 2025-04-16 Jiajie Su , Qiyong Zhong , Yunshan Ma , Weiming Liu , Chaochao Chen , Xiaolin Zheng , Jianwei Yin , Tat-Seng Chua

Diffusion models (DMs) have emerged as the new state-of-the-art family of deep generative models. To gain deeper insights into the limitations of diffusion models in recommender systems, we investigate the fundamental structural disparities…

Information Retrieval · Computer Science 2025-04-11 Meng Yuan , Yutian Xiao , Wei Chen , Chu Zhao , Deqing Wang , Fuzhen Zhuang

Face recognition systems are increasingly vulnerable to morphing attacks, where a composite image is crafted to match multiple identities, enabling unauthorized access and identity fraud. Existing detection methods identify morphed images…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Nitish Shukla , Arun Ross

Understanding the morphological structure of medical images and precisely segmenting the region of interest or abnormality is an important task that can assist in diagnosis. However, the unique properties of medical imaging make clear…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sungmin Kang , Jaeha Song , Jihie Kim