English
Related papers

Related papers: Sketch2CT: Multimodal Diffusion for Structure-Awar…

200 papers

The scarcity of high-quality segmentation masks remains a major bottleneck for medical image analysis, particularly in non-contrast CT (NCCT) neuroimaging, where manual annotation is costly and variable. To address this limitation, we…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Lucia Borrego , Vajira Thambawita , Marco Ciuffreda , Ines del Val , Alejandro Dominguez , Josep Munuera

Fully-supervised lesion recognition methods in medical imaging face challenges due to the reliance on large annotated datasets, which are expensive and difficult to collect. To address this, synthetic lesion generation has become a…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Wenhui Lei , Henrui Tian , Linrui Dai , Hanyu Chen , Xiaofan Zhang

Sketches serve as fundamental blueprints in artistic creation because sketch editing is easier and more intuitive than pixel-level RGB image editing for painting artists, yet sketch generation remains unexplored despite advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Ruohao Zhan , Yijin Li , Yisheng He , Shuo Chen , Yichen Shen , Xinyu Chen , Zilong Dong , Zhaoyang Huang , Guofeng Zhang

Pseudo-healthy image inpainting is an essential preprocessing step for analyzing pathological brain MRI scans. Most current inpainting methods favor slice-wise 2D models for their high in-plane fidelity, but their independence across slices…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Dou Hoon Kwark , Shirui Luo , Xiyue Zhu , Yudu Li , Zhi-Pei Liang , Volodymyr Kindratenko

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Geometry- and appearance-controlled full-body human image generation is an interesting but challenging task. Existing solutions are either unconditional or dependent on coarse conditions (e.g., pose, text), thus lacking explicit geometry…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Linzi Qu , Jiaxiang Shang , Hui Ye , Xiaoguang Han , Hongbo Fu

3D Gaussian representations have emerged as a powerful paradigm for digital head modeling, achieving photorealistic quality with real-time rendering. However, intuitive and interactive creation or editing of 3D Gaussian head models remains…

Graphics · Computer Science 2026-04-22 Bo Li , Jiahao Kang , Yubo Ma , Feng-Lin Liu , Bin Liu , Fang-Lue Zhang , Lin Gao

In the field of sketch generation, raster-format trained models often produce non-stroke artifacts, while vector-format trained models typically lack a holistic understanding of sketches, leading to compromised recognizability. Moreover,…

Graphics · Computer Science 2025-11-19 Jin Zhou , Yi Zhou , Hongliang Yang , Pengfei Xu , Hui Huang

Reconstructing 3D human shapes from 2D images has received increasing attention recently due to its fundamental support for many high-level 3D applications. Compared with natural images, freehand sketches are much more flexible to depict…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Fei Wang , Kongzhang Tang , Hefeng Wu , Baoquan Zhao , Hao Cai , Teng Zhou

Equivocal 3D lesion segmentation exhibits high inter-observer variability. Conventional deterministic models ignore this aleatoric uncertainty, producing over-confident masks that obscure clinical risks. Conversely, while generative methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chao Wu , Kangxian Xie , Mingchen Gao

Generating realistic sparse multi-category 3D voxel structures is difficult due to the cubic memory scaling of voxel structures and moreover the significant class imbalance caused by sparsity. We introduce Scaffold Diffusion, a generative…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Justin Jung

Accurately visualizing and editing tumor progression in medical imaging is crucial for diagnosis, treatment planning, and clinical communication. To address the challenges of subjectivity and limited precision in existing methods, we…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Gexin Huang , Ruinan Jin , Yucheng Tang , Can Zhao , Tatsuya Harada , Xiaoxiao Li , Gu Lin

In recent years, Denoising Diffusion Models have demonstrated remarkable success in generating semantically valuable pixel-wise representations for image generative modeling. In this study, we propose a novel end-to-end framework, called…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Zhaohu Xing , Liang Wan , Huazhu Fu , Guang Yang , Lei Zhu

Acquiring and annotating sufficient labeled data is crucial in developing accurate and robust learning-based models, but obtaining such data can be challenging in many medical image segmentation tasks. One promising solution is to…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Kun Han , Yifeng Xiong , Chenyu You , Pooya Khosravi , Shanlin Sun , Xiangyi Yan , James Duncan , Xiaohui Xie

Outdoor 3D semantic scene generation produces realistic and semantically rich environments for applications such as urban simulation and autonomous driving. However, advances in this direction are constrained by the absence of publicly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Li Liang , Bo Miao , Xinyu Wang , Naveed Akhtar , Jordan Vice , Ajmal Mian

Conditional medical image generation plays an important role in many clinically relevant imaging tasks. However, existing methods still face a fundamental challenge in balancing inference efficiency, patient-specific fidelity, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zirong Li , Siyuan Mei , Weiwen Wu , Andreas Maier , Lina Gölz , Yan Xia

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

Text to image latent diffusion models have recently advanced medical image synthesis, but applications to 3D CT generation remain limited. Existing approaches rely on simplified prompts, neglecting the rich semantic detail in full radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Sina Amirrajab , Zohaib Salahuddin , Sheng Kuang , Henry C. Woodruff , Philippe Lambin

Accurate spatial correspondence between medical images is essential for longitudinal analysis, lesion tracking, and image-guided interventions. Medical image registration methods rely on local intensity-based similarity measures, which fail…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xingyu Zhang , Anna Reithmeir , Fryderyk Kögl , Rickmer Braren , Julia A. Schnabel , Daniel M. Lang

Automated cell segmentation in microscopy images is essential for biomedical research, yet conventional methods are labor-intensive and prone to error. While deep learning-based approaches have proven effective, they often require large…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Rüveyda Yilmaz , Kaan Keven , Yuli Wu , Johannes Stegmaier