English
Related papers

Related papers: Sketch2CT: Multimodal Diffusion for Structure-Awar…

200 papers

Generating 3D CT volumes from descriptive free-text inputs presents a transformative opportunity in diagnostics and research. In this paper, we introduce Text2CT, a novel approach for synthesizing 3D CT volumes from textual descriptions…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Pengfei Guo , Can Zhao , Dong Yang , Yufan He , Vishwesh Nath , Ziyue Xu , Pedro R. A. S. Bassi , Zongwei Zhou , Benjamin D. Simon , Stephanie Anne Harmon , Baris Turkbey , Daguang Xu

The generation of medical images presents significant challenges due to their high-resolution and three-dimensional nature. Existing methods often yield suboptimal performance in generating high-quality 3D medical images, and there is…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Haoshen Wang , Zhentao Liu , Kaicong Sun , Xiaodong Wang , Dinggang Shen , Zhiming Cui

Animation of 2D hand-drawn sketches provides an effective medium for visual communication. However, these sketches pose challenges, particularly in handling occlusions and accurately mapping motion. While 3D animation naturally addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gaurav Rai , Ojaswa Sharma

Generating medical images from human-drawn free-hand sketches holds promise for various important medical imaging applications. Due to the extreme difficulty in collecting free-hand sketch data in the medical domain, most deep…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Quan Huu Cap , Atsushi Fukuda

Cross-modality medical image synthesis is a critical topic and has the potential to facilitate numerous applications in the medical imaging field. Despite recent successes in deep-learning-based generative models, most current medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Lingting Zhu , Zeyue Xue , Zhenchao Jin , Xian Liu , Jingzhen He , Ziwei Liu , Lequan Yu

Solving medical imaging data scarcity through semantic image generation has attracted growing attention in recent years. However, existing generative models mainly focus on synthesizing whole-organ or large-tissue structures, showing…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Jiahao Xia , Yutao Hu , Yaolei Qi , Zhenliang Li , Wenqi Shao , Junjun He , Ying Fu , Longjiang Zhang , Guanyu Yang

We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities…

Graphics · Computer Science 2020-09-11 Changjian Li , Hao Pan , Adrien Bousseau , Niloy J. Mitra

Recent advancements in large vision-language models have enabled highly expressive and diverse vector sketch generation. However, state-of-the-art methods rely on a time-consuming optimization process involving repeated feedback from a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ellie Arar , Yarden Frenkel , Daniel Cohen-Or , Ariel Shamir , Yael Vinker

We present Sketch2Colab, which turns storyboard-style 2D sketches into coherent, object-aware 3D multi-human motion with fine-grained control over agents, joints, timing, and contacts. Diffusion-based motion generators offer strong realism…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Divyanshu Daiya , Aniket Bera

Objective: While recent advances in text-conditioned generative models have enabled the synthesis of realistic medical images, progress has been largely confined to 2D modalities such as chest X-rays. Extending text-to-image generation to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Daniele Molino , Camillo Maria Caruso , Filippo Ruffini , Paolo Soda , Valerio Guarrasi

Despite the growing importance of dental CBCT scans for diagnosis and treatment planning, generating anatomically realistic scans with fine-grained control remains a challenge in medical image synthesis. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Said Djafar Said , Torkan Gholamalizadeh , Mostafa Mehdipour Ghazi

Anatomy shape modeling is a fundamental problem in medical data analysis. However, the geometric complexity and topological variability of anatomical structures pose significant challenges to accurate anatomical shape generation. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Guoqing Zhang , Jingyun Yang , Siqi Chen , Anping Zhang , Yang Li

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

We propose a cascaded 3D diffusion model framework to synthesize high-fidelity 3D PET/CT volumes directly from demographic variables, addressing the growing need for realistic digital twins in oncologic imaging, virtual trials, and…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Siyeop Yoon , Sifan Song , Pengfei Jin , Matthew Tivnan , Yujin Oh , Sekeun Kim , Dufan Wu , Xiang Li , Quanzheng Li

Diffusion Probabilistic Models (DPMs) have demonstrated significant potential in 3D medical image segmentation tasks. However, their high computational cost and inability to fully capture global 3D contextual information limit their…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Kangbo Ma

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo

Synthesizing face images from monochrome sketches is one of the most fundamental tasks in the field of image-to-image translation. However, it is still challenging to (1)~make models learn the high-dimensional face features such as geometry…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yichen Peng , Chunqi Zhao , Haoran Xie , Tsukasa Fukusato , Kazunori Miyata

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of interest (ROI). Leading…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Tingyi Lin , Pengju Lyu , Jie Zhang , Yuqing Wang , Cheng Wang , Jianjun Zhu

Diffusion probabilistic models have achieved remarkable success in text guided image generation. However, generating 3D shapes is still challenging due to the lack of sufficient data containing 3D models along with their descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zijie Wu , Yaonan Wang , Mingtao Feng , He Xie , Ajmal Mian

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski
‹ Prev 1 2 3 10 Next ›