English
Related papers

Related papers: Sketch2CT: Multimodal Diffusion for Structure-Awar…

200 papers

Recent advancements in 3D diffusion-based semantic scene generation have gained attention. However, existing methods rely on unconditional generation and require multiple resampling steps when editing scenes, which significantly limits…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haowen Zheng , Yanyan Liang

In computer-assisted surgery, automatically recognizing anatomical organs is crucial for understanding the surgical scene and providing intraoperative assistance. While machine learning models can identify such structures, their deployment…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Danush Kumar Venkatesh , Dominik Rivoir , Micha Pfeiffer , Fiona Kolbinger , Stefanie Speidel

Collective insights from a group of experts have always proven to outperform an individual's best diagnostic for clinical tasks. For the task of medical image segmentation, existing research on AI-based alternatives focuses more on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Aimon Rahman , Jeya Maria Jose Valanarasu , Ilker Hacihaliloglu , Vishal M Patel

3D textured face reconstruction from sketches applicable in many scenarios such as animation, 3D avatars, artistic design, missing people search, etc., is a highly promising but underdeveloped research topic. On the one hand, the stylistic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zidu Wang , Xiangyu Zhu , Jiang Yu , Tianshuo Zhang , Zhen Lei

Scarcity of annotated data, particularly for rare or atypical morphologies, present significant challenges for cell and nuclei segmentation in computational pathology. While manual annotation is labor-intensive and costly, synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Dominik Winter , Mai Bui , Monica Azqueta Gavaldon , Nicolas Triltsch , Marco Rosati , Nicolas Brieu

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

3D model reconstruction from a single image has achieved great progress with the recent deep generative models. However, the conventional reconstruction approaches with template mesh deformation and implicit fields have difficulty in…

Graphics · Computer Science 2023-03-02 Yi He , Haoran Xie , Kazunori Miyata

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models in particular have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen and Stable Diffusion.…

The recently emerging conditional diffusion models seem promising for mitigating the labor and expenses in building large 3D medical imaging datasets. However, previous studies on 3D CT generation primarily focus on specific organs…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Linrui Dai , Rongzhao Zhang , Yongrui Yu , Xiaofan Zhang

We present SketchDNN, a generative model for synthesizing CAD sketches that jointly models both continuous parameters and discrete class labels through a unified continuous-discrete diffusion process. Our core innovation is Gaussian-Softmax…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Sathvik Chereddy , John Femiani

The rapid advancement of Artificial Intelligence (AI) in biomedical imaging and radiotherapy is hindered by the limited availability of large imaging data repositories. With recent research and improvements in denoising diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Rowan Bradbury , Katherine A. Vallis , Bartlomiej W. Papiez

This paper introduces a pioneering 3D volumetric encoder designed for text-to-3D generation. To scale up the training data for the diffusion model, a lightweight network is developed to efficiently acquire feature volumes from multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zhicong Tang , Shuyang Gu , Chunyu Wang , Ting Zhang , Jianmin Bao , Dong Chen , Baining Guo

Reconstructing a 3D shape based on a single sketch image is challenging due to the large domain gap between a sparse, irregular sketch and a regular, dense 3D shape. Existing works try to employ the global feature extracted from sketch to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Chenjian Gao , Qian Yu , Lu Sheng , Yi-Zhe Song , Dong Xu

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Shin-I Cheng , Yu-Jie Chen , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

We present 3DeepCT, a deep neural network for computed tomography, which performs 3D reconstruction of scattering volumes from multi-view images. Our architecture is dictated by the stationary nature of atmospheric cloud fields. The task of…

Image and Video Processing · Electrical Eng. & Systems 2020-12-14 Yael Sde-Chen , Yoav Y. Schechner , Vadim Holodovsky , Eshkol Eytan

3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel deep-learning based approach for automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yongzhi Xu , Yonhon Ng , Yifu Wang , Inkyu Sa , Yunfei Duan , Zhenhong Sun , Yang Li , Pan Ji , Hongdong Li

Image-based personalized medicine has the potential to transform healthcare, particularly for diseases that exhibit heterogeneous progression such as Multiple Sclerosis (MS). In this work, we introduce the first treatment-aware…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Gian Mario Favero , Ge Ya Luo , Nima Fathi , Justin Szeto , Douglas L. Arnold , Brennan Nichyporuk , Chris Pal , Tal Arbel

We introduce Scan2Mesh, a novel data-driven generative approach which transforms an unstructured and potentially incomplete range scan into a structured 3D mesh representation. The main contribution of this work is a generative neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Angela Dai , Matthias Nießner

Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, to generate diverse,…

Machine Learning · Computer Science 2024-10-04 Huaisheng Zhu , Teng Xiao , Vasant G Honavar

Medical generative models, acknowledged for their high-quality sample generation ability, have accelerated the fast growth of medical applications. However, recent works concentrate on separate medical generation models for distinct medical…

Image and Video Processing · Electrical Eng. & Systems 2024-03-08 Chenlu Zhan , Yu Lin , Gaoang Wang , Hongwei Wang , Jian Wu