English
Related papers

Related papers: Physics-Informed Latent Diffusion for Multimodal B…

200 papers

High-quality 3D assets for traffic participants are critical for multi-sensor simulation, which is essential for the safe end-to-end development of autonomy. Building assets from in-the-wild data is key for diversity and realism, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Ze Yang , Jingkang Wang , Haowei Zhang , Sivabalan Manivasagam , Yun Chen , Raquel Urtasun

Over the past decade, there has been tremendous progress in the domain of synthetic media generation. This is mainly due to the powerful methods based on generative adversarial networks (GANs). Very recently, diffusion probabilistic models,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Dwij Mehta , Aditya Mehta , Pratik Narang

Physics-inspired Generative Models (GMs), in particular Diffusion Models (DMs) and Poisson Flow Models (PFMs), enhance Bayesian methods and promise great utility in medical imaging. This review examines the transformative role of such…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Dennis Hein , Afshin Bozorgpour , Dorit Merhof , Ge Wang

Diffusion models arise as a powerful generative tool recently. Despite the great progress, existing diffusion models mainly focus on uni-modal control, i.e., the diffusion process is driven by only one modality of condition. To further…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziqi Huang , Kelvin C. K. Chan , Yuming Jiang , Ziwei Liu

Diffusion models for image generation have been a subject of increasing interest due to their ability to generate diverse, high-quality images. Image generation has immense potential in medical imaging because open-source medical images are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Benoit Freiche , Anthony El-Khoury , Ali Nasiri-Sarvi , Mahdi S. Hosseini , Damien Garcia , Adrian Basarab , Mathieu Boily , Hassan Rivaz

Magnetic resonance imaging (MRI) exam protocols consist of multiple contrast-weighted images of the same anatomy to emphasize different tissue properties. Due to the long acquisition times required to collect fully sampled k-space…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Brett Levac , Ajil Jalal , Kannan Ramchandran , Jonathan I. Tamir

Magnetic resonance imaging (MRI) is being increasingly utilized to assess, diagnose, and plan treatment for a variety of diseases. The ability to visualize tissue in varied contrasts in the form of MR pulse sequences in a single scan…

Image and Video Processing · Electrical Eng. & Systems 2019-10-03 Anmol Sharma , Ghassan Hamarneh

Due to the three-dimensional nature of CT- or MR-scans, generative modeling of medical images is a particularly challenging task. Existing approaches mostly apply patch-wise, slice-wise, or cascaded generation techniques to fit the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Paul Friedrich , Julia Wolleb , Florentin Bieder , Alicia Durrer , Philippe C. Cattin

Multi-modality image fusion aims to combine different modalities to produce fused images that retain the complementary features of each modality, such as functional highlights and texture details. To leverage strong generative priors and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zixiang Zhao , Haowen Bai , Yuanzhi Zhu , Jiangshe Zhang , Shuang Xu , Yulun Zhang , Kai Zhang , Deyu Meng , Radu Timofte , Luc Van Gool

Finding an appropriate representation of dynamic activities in the brain is crucial for many downstream applications. Due to its highly dynamic nature, temporally averaged fMRI (functional magnetic resonance imaging) can only provide a…

Machine Learning · Computer Science 2022-08-18 Sikun Lin , Shuyun Tang , Scott Grafton , Ambuj Singh

To the best of our knowledge, all existing methods that can generate synthetic brain magnetic resonance imaging (MRI) scans for a specific individual require detailed structural or volumetric information about the individual's brain.…

Neurons and Cognition · Quantitative Biology 2025-04-25 Ruijie Wang , Luca Rossetto , Susan Mérillat , Christina Röcke , Mike Martin , Abraham Bernstein

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

Scaling by training on large datasets has been shown to enhance the quality and fidelity of image generation and manipulation with diffusion models; however, such large datasets are not always accessible in medical imaging due to cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yousef Yeganeh , Azade Farshad , Ioannis Charisiadis , Marta Hasny , Martin Hartenberger , Björn Ommer , Nassir Navab , Ehsan Adeli

Accurately identifying oocytes that progress to the blastocyst stage is crucial in reproductive medicine, but the limited availability of annotated high-quality embryo images presents challenges for developing automated diagnostic tools. To…

Quantitative Methods · Quantitative Biology 2025-06-18 Alejandro Golfe , Natalia P. García-de-la-puente , Adrián Colomer , Valery Naranjo

Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmentation validation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Maham Nazir , Muhammad Aqeel , Francesco Setti

Generative AI models have revolutionized various fields by enabling the creation of realistic and diverse data samples. Among these models, diffusion models have emerged as a powerful approach for generating high-quality images, text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Gaurav Raut , Apoorv Singh

In image generation, Multiple Latent Variable Generative Models (MLVGMs) employ multiple latent variables to gradually shape the final images, from global characteristics to finer and local details (e.g., StyleGAN, NVAE), emerging as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Dario Serez , Marco Cristani , Alessio Del Bue , Vittorio Murino , Pietro Morerio

A deep latent variable model is a powerful method for capturing complex distributions. These models assume that underlying structures, but unobserved, are present within the data. In this dissertation, we explore high-dimensional problems…

Machine Learning · Computer Science 2024-06-13 Khuong Vo

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

The rapid advancement of Artificial Intelligence (AI) in biomedical imaging and radiotherapy is hindered by the limited availability of large imaging data repositories. With recent research and improvements in denoising diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Rowan Bradbury , Katherine A. Vallis , Bartlomiej W. Papiez