English
Related papers

Related papers: Navigating the Synthetic Realm: Harnessing Diffusi…

200 papers

Diffusion-based video generation models have made significant strides, producing outputs with improved visual fidelity, temporal coherence, and user control. These advancements hold great promise for improving surgical education by enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Joseph Cho , Samuel Schmidgall , Cyril Zakka , Mrudang Mathur , Dhamanpreet Kaur , Rohan Shad , William Hiesinger

There has been tremendous progress in large-scale text-to-image synthesis driven by diffusion models enabling versatile downstream applications such as 3D object synthesis from texts, image editing, and customized generation. We present a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ting-Hsuan Liao , Songwei Ge , Yiran Xu , Yao-Chih Lee , Badour AlBahar , Jia-Bin Huang

Deep neural networks have brought remarkable breakthroughs in medical image analysis. However, due to their data-hungry nature, the modest dataset sizes in medical imaging projects might be hindering their full potential. Generating…

Computer-assisted surgical (CAS) systems enhance surgical execution and outcomes by providing advanced support to surgeons. These systems often rely on deep learning models trained on complex, challenging-to-annotate data. While synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Sabina Martyniak , Joanna Kaleta , Diego Dall'Alba , Michał Naskręt , Szymon Płotka , Przemysław Korzeniowski

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

The generation of realistic medical images from text descriptions has significant potential to address data scarcity challenges in healthcare AI while preserving patient privacy. This paper presents a comprehensive study of text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mikhail Chaichuk , Sushant Gautam , Steven Hicks , Elena Tutubalina

Histopathology image classification is crucial for the accurate identification and diagnosis of various diseases but requires large and diverse datasets. Obtaining such datasets, however, is often costly and time-consuming due to the need…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Leire Benito-Del-Valle , Aitor Alvarez-Gila , Itziar Eguskiza , Cristina L. Saratxaga

Diffusion models for text-to-image generation, known for their efficiency, accessibility, and quality, have gained popularity. While inference with these systems on consumer-grade GPUs is increasingly feasible, training from scratch…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bram de Wilde , Anindo Saha , Maarten de Rooij , Henkjan Huisman , Geert Litjens

Medical image segmentation suffers from data scarcity, particularly in polyp detection where annotation requires specialized expertise. We present SynDiff, a framework combining text-guided synthetic data generation with efficient…

Image and Video Processing · Electrical Eng. & Systems 2025-07-22 Muhammad Aqeel , Maham Nazir , Zanxi Ruan , Francesco Setti

Machine learning has significantly advanced healthcare by aiding in disease prevention and treatment identification. However, accessing patient data can be challenging due to privacy concerns and strict regulations. Generating synthetic,…

Computer vision technologies markedly enhance the automation capabilities of robotic-assisted minimally invasive surgery (RAMIS) through advanced tool tracking, detection, and localization. However, the limited availability of comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Tianle Zeng , Gerardo Loza Galindo , Junlei Hu , Pietro Valdastri , Dominic Jones

Generative models are used as an alternative data augmentation technique to alleviate the data scarcity problem faced in the medical imaging field. Diffusion models have gathered special attention due to their innovative generation…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Ricardo Montoya-del-Angel , Karla Sam-Millan , Joan C Vilanova , Robert Martí

Recent text-to-image generation models have shown promising results in generating high-fidelity photo-realistic images. Though the results are astonishing to human eyes, how applicable these generated images are for recognition tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Ruifei He , Shuyang Sun , Xin Yu , Chuhui Xue , Wenqing Zhang , Philip Torr , Song Bai , Xiaojuan Qi

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

Generative models capable of capturing nuanced clinical features in medical images hold great promise for facilitating clinical data sharing, enhancing rare disease datasets, and efficiently synthesizing annotated medical images at scale.…

Image and Video Processing · Electrical Eng. & Systems 2023-06-23 Shenghuan Sun , Gregory M. Goldgof , Atul Butte , Ahmed M. Alaa

Recent breakthroughs in text-to-image diffusion models have significantly advanced the generation of high-fidelity, photo-realistic images from textual descriptions. Yet, these models often struggle with interpreting spatial arrangements…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jiaqi Liu , Tao Huang , Chang Xu

Scene text detection techniques have garnered significant attention due to their wide-ranging applications. However, existing methods have a high demand for training data, and obtaining accurate human annotations is labor-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Ling Fu , Zijie Wu , Yingying Zhu , Yuliang Liu , Xiang Bai

Recent text-to-image generative models have exhibited remarkable abilities in generating high-fidelity and photo-realistic images. However, despite the visually impressive results, these models often struggle to preserve plausible human…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenzhen Weng , Laura Bravo-Sánchez , Serena Yeung-Levy

In computer-assisted surgery, automatically recognizing anatomical organs is crucial for understanding the surgical scene and providing intraoperative assistance. While machine learning models can identify such structures, their deployment…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Danush Kumar Venkatesh , Dominik Rivoir , Micha Pfeiffer , Fiona Kolbinger , Stefanie Speidel

To synthesize high-fidelity samples, diffusion models typically require auxiliary data to guide the generation process. However, it is impractical to procure the painstaking patch-level annotation effort required in specialized domains like…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Alexandros Graikos , Srikar Yellapragada , Minh-Quan Le , Saarthak Kapse , Prateek Prasanna , Joel Saltz , Dimitris Samaras