English
Related papers

Related papers: Deep Generative Models Unveil Patterns in Medical …

200 papers

Multimodal models trained on large natural image-text pair datasets have exhibited astounding abilities in generating high-quality images. Medical imaging data is fundamentally different to natural images, and the language used to…

Medical image-language pre-training aims to align medical images with clinically relevant text to improve model performance on various downstream tasks. However, existing models often struggle with the variability and ambiguity inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shreyank N Gowda , Ruichi Zhang , Xiao Gu , Ying Weng , Lu Yang

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sarah Cechnicka , Matthew Baugh , Weitong Zhang , Mischa Dombrowski , Zhe Li , Johannes C. Paetzold , Candice Roufosse , Bernhard Kainz

Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marvin Seyfarth , Salman Ul Hassan Dar , Isabelle Ayx , Matthias Alexander Fink , Stefan O. Schoenberg , Hans-Ulrich Kauczor , Sandy Engelhardt

Identifying subtle phenotypic variations in cellular images is critical for advancing biological research and accelerating drug discovery. These variations are often masked by the inherent cellular heterogeneity, making it challenging to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Anis Bourou , Biel Castaño Segade , Thomas Boyer , Valérie Mezger , Auguste Genovesio

Diffusion MRI (dMRI) is an advanced imaging technique characterizing tissue microstructure and white matter structural connectivity of the human brain. The demand for high-quality dMRI data is growing, driven by the need for better…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Xi Zhu , Wei Zhang , Yijie Li , Lauren J. O'Donnell , Fan Zhang

In this paper, we explore the feasibility of using generative models, specifically Progressive Growing GANs (PG-GANs) and Stable Diffusion fine-tuning, to generate synthetic chest X-ray images for medical diagnosis purposes. Due to ethical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Muhammad Danyal Malik , Danish Humair

Acquiring large quantities of data and annotations is known to be effective for developing high-performing deep learning models, but is difficult and expensive to do in the healthcare context. Adding synthetic training data using generative…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Menghan Yu , Sourabh Kulhare , Courosh Mehanian , Charles B Delahunt , Daniel E Shea , Zohreh Laverriere , Ishan Shah , Matthew P Horning

Datasets in engineering domains are often small, sparsely labeled, and contain numerical as well as categorical conditions. Additionally. computational resources are typically limited in practical applications which hinders the adoption of…

Machine Learning · Computer Science 2025-05-23 Phillip Mueller , Jannik Wiese , Sebastian Mueller , Lars Mikelsons

Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for…

Vision-language foundation models (VLMs) have shown impressive performance in guiding image generation through text, with emerging applications in medical imaging. In this work, we are the first to investigate the question: 'Can fine-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Amar Kumar , Anita Kriz , Barak Pertzov , Tal Arbel

The perceptual-based grouping process produces a hierarchical and compositional image representation that helps both human and machine vision systems recognize heterogeneous visual concepts. Examples can be found in the classical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Zhiheng Li , Wenxuan Bao , Jiayang Zheng , Chenliang Xu

In medical imaging, generative models are increasingly relied upon for two distinct but equally critical tasks: reconstruction, where the goal is to restore medical imaging (usually inverse problems like inpainting or superresolution), and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Niklas Bubeck , Yundi Zhang , Suprosanna Shit , Daniel Rueckert , Jiazhen Pan

This work exploits translation data as a source of semantically relevant learning signal for models of word representation. In particular, we exploit equivalence through translation as a form of distributed context and jointly learn how to…

Computation and Language · Computer Science 2018-04-24 Miguel Rios , Wilker Aziz , Khalil Sima'an

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task, instead of relying on hand-engineered representations. Our framework is modular and consists of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Benjamin Gutierrez Becker , Ignacio Sarasua , Christian Wachinger

We introduce a new framework for manipulating and interacting with deep generative models that we call network bending. We present a comprehensive set of deterministic transformations that can be inserted as distinct layers into the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Terence Broad , Frederic Fol Leymarie , Mick Grierson

As the amount of textual data has been rapidly increasing over the past decade, efficient similarity search methods have become a crucial component of large-scale information retrieval systems. A popular strategy is to represent original…

Information Retrieval · Computer Science 2017-08-14 Suthee Chaidaroon , Yi Fang

Histopathology image classification is crucial for the accurate identification and diagnosis of various diseases but requires large and diverse datasets. Obtaining such datasets, however, is often costly and time-consuming due to the need…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Leire Benito-Del-Valle , Aitor Alvarez-Gila , Itziar Eguskiza , Cristina L. Saratxaga

The limited availability of 3D medical image datasets, due to privacy concerns and high collection or annotation costs, poses significant challenges in the field of medical imaging. While a promising alternative is the use of synthesized…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Lingting Zhu , Noel Codella , Dongdong Chen , Zhenchao Jin , Lu Yuan , Lequan Yu