English
Related papers

Related papers: The Learnability Gap in Medical Latent Diffusion

200 papers

Medical imaging plays a vital role in modern diagnostics and treatment. The temporal nature of disease or treatment progression often results in longitudinal data. Due to the cost and potential harm, acquiring large medical datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Julian Schön , Raghavendra Selvan , Lotte Nygård , Ivan Richter Vogelius , Jens Petersen

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

Diffusion language models (DLMs) promise parallel, order-agnostic generation, but on standard benchmarks they have historically lagged behind autoregressive models in sample quality and diversity. Recent continuous flow and diffusion…

Computation and Language · Computer Science 2026-05-11 Georgios Batzolis , Mark Girolami , Luca Ambrogioni

Accurate and efficient 3D medical image segmentation is essential for clinical AI, where models must remain reliable under stringent memory, latency, and data availability constraints. Transformer-based methods achieve strong accuracy but…

Machine Learning · Computer Science 2026-03-10 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

Machine Learning · Computer Science 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

Denoising diffusion probabilistic models have recently demonstrated state-of-the-art generative performance and have been used as strong pixel-level representation learners. This paper decomposes the interrelation between the generative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zixuan Pan , Jianxu Chen , Yiyu Shi

End-to-end optimization has achieved state-of-the-art performance on many specific problems, but there is no straight-forward way to combine pretrained models for new problems. Here, we explore improving modularity by learning a post-hoc…

Machine Learning · Computer Science 2019-02-25 Yingtao Tian , Jesse Engel

As latent diffusion models (LDMs) democratize image generation capabilities, there is a growing need to detect fake images. A good detector should focus on the generative models fingerprints while ignoring image properties such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Anirudh Sundara Rajan , Utkarsh Ojha , Jedidiah Schloesser , Yong Jae Lee

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Recent multi-modal contrastive learning models have demonstrated the ability to learn an embedding space suitable for building strong vision classifiers, by leveraging the rich information in large-scale image-caption datasets. Our work…

Machine Learning · Computer Science 2023-02-09 Yuhui Zhang , Jeff Z. HaoChen , Shih-Cheng Huang , Kuan-Chieh Wang , James Zou , Serena Yeung

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong

Identifying new disease-related patterns in medical imaging data with the help of machine learning enlarges the vocabulary of recognizable findings. This supports diagnostic and prognostic assessment. However, image appearance varies not…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jeanny Pan , Philipp Seeböck , Christoph Fürböck , Svitlana Pochepnia , Jennifer Straub , Lucian Beer , Helmut Prosch , Georg Langs

While Diffusion Models (DM) exhibit remarkable performance across various image generative tasks, they nonetheless reflect the inherent bias presented in the training set. As DMs are now widely used in real-world applications, these biases…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yilei Jiang , Weihong Li , Yiyuan Zhang , Minghong Cai , Xiangyu Yue

Instead of performing text-conditioned denoising in the image domain, latent diffusion models (LDMs) operate in latent space of a variational autoencoder (VAE), enabling more efficient processing at reduced computational costs. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jason Becker , Chris Wendler , Peter Baylies , Robert West , Christian Wressnegger

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Deep learning for medical imaging suffers from temporal and privacy-related restrictions on data availability. To still obtain viable models, continual learning aims to train in sequential order, as and when data is available. The main…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Marius Memmel , Camila Gonzalez , Anirban Mukhopadhyay

Deep neural networks (DNNs) have achieved great success in a wide variety of medical image analysis tasks. However, these achievements indispensably rely on the accurately-annotated datasets. If with the noisy-labeled images, the training…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Cheng Xue , Qi Dou , Xueying Shi , Hao Chen , Pheng Ann Heng

Deep learning models for medical data are typically trained using task specific objectives that encourage representations to collapse onto a small number of discriminative directions. While effective for individual prediction problems, this…

Machine Learning · Computer Science 2026-02-10 Yuanyun Zhang , Mingxuan Zhang , Siyuan Li , Zihan Wang , Haoran Chen , Wenbo Zhou , Shi Li

Unsupervised discovery of latent representations, in addition to being useful for density modeling, visualisation and exploratory data analysis, is also increasingly important for learning features relevant to discriminative tasks.…

Machine Learning · Statistics 2011-10-27 Jasper Snoek , Ryan Prescott Adams , Hugo Larochelle