English
Related papers

Related papers: TextDiffSeg: Text-guided Latent Diffusion Model fo…

200 papers

Weakly supervised medical image segmentation (MIS) using generative models is crucial for clinical diagnosis. However, the accuracy of the segmentation results is often limited by insufficient supervision and the complex nature of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhihao Shuai , Yinan Chen , Shunqiang Mao , Yihan Zho , Xiaohong Zhang

The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with complex customizations…

Machine Learning · Computer Science 2024-10-08 Yanchen Luo , Junfeng Fang , Sihang Li , Zhiyuan Liu , Jiancan Wu , An Zhang , Wenjie Du , Xiang Wang

The generation of medical images presents significant challenges due to their high-resolution and three-dimensional nature. Existing methods often yield suboptimal performance in generating high-quality 3D medical images, and there is…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Haoshen Wang , Zhentao Liu , Kaicong Sun , Xiaodong Wang , Dinggang Shen , Zhiming Cui

In recent years, Denoising Diffusion Models have demonstrated remarkable success in generating semantically valuable pixel-wise representations for image generative modeling. In this study, we propose a novel end-to-end framework, called…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Zhaohu Xing , Liang Wan , Huazhu Fu , Guang Yang , Lei Zhu

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

Low-dose Positron Emission Tomography (PET) imaging presents a significant challenge due to increased noise and reduced image quality, which can compromise its diagnostic accuracy and clinical utility. Denoising diffusion probabilistic…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Boxiao Yu , Savas Ozdemir , Jiong Wu , Yizhou Chen , Ruogu Fang , Kuangyu Shi , Kuang Gong

Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Xutao Guo , Yanwu Yang , Chenfei Ye , Shang Lu , Yang Xiang , Ting Ma

Image segmentation is crucial in many computational pathology pipelines, including accurate disease diagnosis, subtyping, outcome, and survivability prediction. The common approach for training a segmentation model relies on a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Sachin Kumar Danisetty , Alexandros Graikos , Srikar Yellapragada , Dimitris Samaras

Probabilistic denoising diffusion models (DDMs) have set a new standard for 2D image generation. Extending DDMs for 3D content creation is an active field of research. Here, we propose TetraDiffusion, a diffusion model that operates on a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Nikolai Kalischek , Torben Peters , Jan D. Wegner , Konrad Schindler

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe Valmaggia , Philippe C. Cattin

The goal of scene text image super-resolution is to reconstruct high-resolution text-line images from unrecognizable low-resolution inputs. The existing methods relying on the optimization of pixel-level loss tend to yield text edges that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Baolin Liu , Zongyuan Yang , Pengfei Wang , Junjie Zhou , Ziqi Liu , Ziyi Song , Yan Liu , Yongping Xiong

Three-dimensional (3D) medical image enhancement, including denoising and super-resolution, is critical for clinical diagnosis in CT, PET, and MRI. Although diffusion models have shown remarkable success in 2D medical imaging, scaling them…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hongxu Jiang , Fei Li , Boxiao Yu , Ying Zhang , Kaleb Smith , Kuang Gong , Wei Shao

Diffusion models have opened the path to a wide range of text-based image editing frameworks. However, these typically build on the multi-step nature of the diffusion backwards process, and adapting them to distilled, fast-sampling methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Gilad Deutch , Rinon Gal , Daniel Garibi , Or Patashnik , Daniel Cohen-Or

Medical image segmentation is critical for diagnosing and treating spinal disorders. However, the presence of high noise, ambiguity, and uncertainty makes this task highly challenging. Factors such as unclear anatomical boundaries,…

Image and Video Processing · Electrical Eng. & Systems 2023-09-13 Zhiqing Zhang , Guojia Fan , Tianyong Liu , Nan Li , Yuyang Liu , Ziyu Liu , Canwei Dong , Shoujun Zhou

Annotation variability remains a substantial challenge in medical image segmentation, stemming from ambiguous imaging boundaries and diverse clinical expertise. Traditional deep learning methods producing single deterministic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Han Zhang , Xiangde Luo , Yong Chen , Kang Li

Recovering degraded low-resolution text images is challenging, especially for Chinese text images with complex strokes and severe degradation in real-world scenarios. Ensuring both text fidelity and style realness is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuzhe Zhang , Jiawei Zhang , Hao Li , Zhouxia Wang , Luwei Hou , Dongqing Zou , Liheng Bian

Deep learning-based segmentation techniques have shown remarkable performance in brain segmentation, yet their success hinges on the availability of extensive labeled training data. Acquiring such vast datasets, however, poses a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jihoon Cho , Suhyun Ahn , Beomju Kim , Hyungjoon Bae , Xiaofeng Liu , Fangxu Xing , Kyungeun Lee , Georges Elfakhri , Van Wedeen , Jonghye Woo , Jinah Park

Accurate spatial correspondence between medical images is essential for longitudinal analysis, lesion tracking, and image-guided interventions. Medical image registration methods rely on local intensity-based similarity measures, which fail…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xingyu Zhang , Anna Reithmeir , Fryderyk Kögl , Rickmer Braren , Julia A. Schnabel , Daniel M. Lang

Fashion image editing is a crucial tool for designers to convey their creative ideas by visualizing design concepts interactively. Current fashion image editing techniques, though advanced with multimodal prompts and powerful diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xiaolong Wang , Zhi-Qi Cheng , Jue Wang , Xiaojiang Peng

Accurate medical image segmentation is fundamental to precision medicine, yet robust delineation remains challenging under heterogeneous appearances, ambiguous boundaries, and large anatomical variability. Similar intensity and texture…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhiquan Chen , Haitao Wang , Guowei Zou , Hejun Wu