English
Related papers

Related papers: PathLDM: Text conditioned Latent Diffusion Model f…

200 papers

The development of robust artificial intelligence models for histopathology diagnosis is severely constrained by the scarcity of expert-annotated lesion data, particularly for rare pathologies and underrepresented disease subtypes. While…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Mohamad Koohi-Moghadam , Mohammad-Ali Nikouei Mahani , Kyongtae Tyler Bae

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

The immense scale of the recent large language models (LLM) allows many interesting properties, such as, instruction- and chain-of-thought-based fine-tuning, that has significantly improved zero- and few-shot performance in many natural…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Deepanway Ghosal , Navonil Majumder , Ambuj Mehrish , Soujanya Poria

Latent Diffusion Models (LDMs) can generate high-fidelity images from noise, offering a promising approach for augmenting histopathology images for training cancer grading models. While previous works successfully generated high-fidelity…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Man M. Ho , Elham Ghelichkhan , Yosep Chong , Yufei Zhou , Beatrice Knudsen , Tolga Tasdizen

Histopathological image segmentation is a laborious and time-intensive task, often requiring analysis from experienced pathologists for accurate examinations. To reduce this burden, supervised machine-learning approaches have been adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Vishnuvardhan Purma , Suhas Srinath , Seshan Srirangarajan , Aanchal Kakkar , Prathosh A. P

Diffusion models achieve state-of-the-art image generation but remain computationally costly due to iterative denoising. Latent-space models like Stable Diffusion reduce overhead yet lose fine detail, while retrieval-augmented methods…

Machine Learning · Computer Science 2025-12-23 Bilal Faye , Hanane Azzag , Mustapha Lebbah

Automatic histopathology image segmentation is crucial to disease analysis. Limited available labeled data hinders the generalizability of trained models under the fully supervised setting. Semi-supervised learning (SSL) based on generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Hongxiao Wang , Hao Zheng , Jianxu Chen , Lin Yang , Yizhe Zhang , Danny Z. Chen

Accurately modeling multi-class cell topology is crucial in digital pathology, as it provides critical insights into tissue structure and pathology. The synthetic generation of cell topology enables realistic simulations of complex tissue…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Meilong Xu , Saumya Gupta , Xiaoling Hu , Chen Li , Shahira Abousamra , Dimitris Samaras , Prateek Prasanna , Chao Chen

Lidar point cloud synthesis based on generative models offers a promising solution to augment deep learning pipelines, particularly when real-world data is scarce or lacks diversity. By enabling flexible object manipulation, this synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhengkang Xiang , Zizhao Li , Amir Khodabandeh , Kourosh Khoshelham

In recent years, computational pathology has seen tremendous progress driven by deep learning methods in segmentation and classification tasks aiding prognostic and diagnostic settings. Nuclei segmentation, for instance, is an important…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Aman Shrivastava , P. Thomas Fletcher

Language diffusion models aim to improve sampling speed and coherence over autoregressive LLMs. We introduce Neural Flow Diffusion Models for language generation, an extension of NFDM that enables the straightforward application of…

Computation and Language · Computer Science 2026-01-26 Nesta Midavaine , Christian A. Naesseth , Grigory Bartosh

This paper introduces diffusion protein language model (DPLM), a versatile protein language model that demonstrates strong generative and predictive capabilities for protein sequences. We first pre-train scalable DPLMs from…

Machine Learning · Computer Science 2024-10-17 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

Text-to-image generative models have achieved remarkable breakthroughs in recent years. However, their application in medical image generation still faces significant challenges, including small dataset sizes, and scarcity of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Changlu Guo , Anders Nymark Christensen , Morten Rieger Hannemose

The segmentation of mass lesions in digital breast tomosynthesis (DBT) images is very significant for the early screening of breast cancer. However, the high-density breast tissue often leads to high concealment of the mass lesions, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haoxuan Zhang , Wenju Cui , Yuzhu Cao , Tao Tan , Jie Liu , Yunsong Peng , Jian Zheng

Histopathology serves as the gold standard in cancer diagnosis, with clinical reports being vital in interpreting and understanding this process, guiding cancer treatment and patient care. The automation of histopathology report generation…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhengrui Guo , Jiabo Ma , Yingxue Xu , Yihui Wang , Liansheng Wang , Hao Chen

Novel diffusion models can synthesize photo-realistic images with integrated high-quality text. Surprisingly, we demonstrate through attention activation patching that only less than $1$% of diffusion models' parameters, all contained in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Łukasz Staniszewski , Bartosz Cywiński , Franziska Boenisch , Kamil Deja , Adam Dziedzic

Continuous Conditional Diffusion Model (CCDM) is a diffusion-based framework designed to generate high-quality images conditioned on continuous regression labels. Although CCDM has demonstrated clear advantages over prior approaches across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Ding , Yun Chen , Sen Zhang , Kao Zhang , Nenglun Chen , Peibei Cao , Yongwei Wang , Fei Wu

Conditional diffusion models serve as the foundation of modern image synthesis and find extensive application in fields like computational biology and reinforcement learning. In these applications, conditional diffusion models incorporate…

Machine Learning · Computer Science 2024-03-19 Hengyu Fu , Zhuoran Yang , Mengdi Wang , Minshuo Chen

Diffusion models excel at generating high-quality outputs but face challenges in data-scarce domains, where exhaustive retraining or costly paired data are often required. To address these limitations, we propose Latent Aligned Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xuqin Wang , Tao Wu , Yanfeng Zhang , Lu Liu , Dong Wang , Mingwei Sun , Yongliang Wang , Niclas Zeller , Daniel Cremers

Despite their success, unsupervised domain adaptation methods for semantic segmentation primarily focus on adaptation between image domains and do not utilize other abundant visual modalities like depth, infrared and event. This limitation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Ruihao Xia , Yu Liang , Peng-Tao Jiang , Hao Zhang , Bo Li , Yang Tang , Pan Zhou