English
Related papers

Related papers: StructDiff: Structure-aware Diffusion Model for 3D…

200 papers

Generating high-resolution images with generative models has recently been made widely accessible by leveraging diffusion models pre-trained on large-scale datasets. Various techniques, such as MultiDiffusion and SyncDiffusion, have further…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Stanislav Frolov , Brian B. Moser , Andreas Dengel

We present a novel 3D shape completion framework that unifies multimodal conditioning, leveraging both 2D images and 3D partial scans through a latent diffusion model. Shapes are represented as Truncated Signed Distance Functions (TSDFs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Simon Schaefer , Juan D. Galvis , Xingxing Zuo , Stefan Leutengger

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

Brain network analysis has emerged as pivotal method for gaining a deeper understanding of brain functions and disease mechanisms. Despite the existence of various network construction approaches, shortcomings persist in the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yongcheng Zong , Shuqiang Wang

We present DiffInfinite, a hierarchical diffusion model that generates arbitrarily large histological images while preserving long-range correlation structural information. Our approach first generates synthetic segmentation masks,…

Equivocal 3D lesion segmentation exhibits high inter-observer variability. Conventional deterministic models ignore this aleatoric uncertainty, producing over-confident masks that obscure clinical risks. Conversely, while generative methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chao Wu , Kangxian Xie , Mingchen Gao

Weakly supervised medical image segmentation (MIS) using generative models is crucial for clinical diagnosis. However, the accuracy of the segmentation results is often limited by insufficient supervision and the complex nature of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhihao Shuai , Yinan Chen , Shunqiang Mao , Yihan Zho , Xiaohong Zhang

Diffusion MRI (dMRI) is an advanced imaging technique characterizing tissue microstructure and white matter structural connectivity of the human brain. The demand for high-quality dMRI data is growing, driven by the need for better…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Xi Zhu , Wei Zhang , Yijie Li , Lauren J. O'Donnell , Fan Zhang

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe Valmaggia , Philippe C. Cattin

Magnetic resonance (MR) imaging, including cardiac MR, is prone to domain shift due to variations in imaging devices and acquisition protocols. This challenge limits the deployment of trained AI models in real-world scenarios, where…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Xin Ci Wong , Duygu Sarikaya , Kieran Zucker , Marc De Kamps , Nishant Ravikumar

We propose TaxaDiffusion, a taxonomy-informed training framework for diffusion models to generate fine-grained animal images with high morphological and identity accuracy. Unlike standard approaches that treat each species as an independent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Amin Karimi Monsefi , Mridul Khurana , Rajiv Ramnath , Anuj Karpatne , Wei-Lun Chao , Cheng Zhang

Inspired by recent findings that generative diffusion models learn semantically meaningful representations, we use them to discover the intrinsic hierarchical structure in biomedical 3D images using unsupervised segmentation. We show that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Nurislam Tursynbek , Marc Niethammer

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

The performance of single image super-resolution depends heavily on how to generate and complement high-frequency details to low-resolution images. Recently, diffusion-based DDPM models exhibit great potential in generating high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xingjian Wang , Li Chai , Jiming Chen

Generating desirable molecular structures in 3D is a fundamental problem for drug discovery. Despite the considerable progress we have achieved, existing methods usually generate molecules in atom resolution and ignore intrinsic local…

Biomolecules · Quantitative Biology 2023-05-29 Bo Qiang , Yuxuan Song , Minkai Xu , Jingjing Gong , Bowen Gao , Hao Zhou , Weiying Ma , Yanyan Lan

Recent advancements in diffusion techniques have propelled image and video generation to unprecedented levels of quality, significantly accelerating the deployment and application of generative AI. However, 3D shape generation technology…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yangguang Li , Zi-Xin Zou , Zexiang Liu , Dehu Wang , Yuan Liang , Zhipeng Yu , Xingchao Liu , Yuan-Chen Guo , Ding Liang , Wanli Ouyang , Yan-Pei Cao

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus either on 2D graph…

Machine Learning · Computer Science 2024-02-07 Chenqing Hua , Sitao Luan , Minkai Xu , Rex Ying , Jie Fu , Stefano Ermon , Doina Precup

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Designing protein-binding proteins with high affinity is critical in biomedical research and biotechnology. Despite recent advancements targeting specific proteins, the ability to create high-affinity binders for arbitrary protein targets…

Machine Learning · Computer Science 2025-11-03 Zhenqiao Song , Tiaoxiao Li , Lei Li , Martin Renqiang Min