English
Related papers

Related papers: Semantically Consistent Discrete Diffusion for 3D …

200 papers

Semantic Image Synthesis (SIS) is among the most popular and effective techniques in the field of face generation and editing, thanks to its good generation quality and the versatility is brings along. Recent works attempted to go beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Alex Ergasti , Claudio Ferrari , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Semantic correspondence, the task of determining relationships between different parts of images, underpins various applications including 3D reconstruction, image-to-image translation, object tracking, and visual place recognition. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Frank Fundel , Johannes Schusterbauer , Vincent Tao Hu , Björn Ommer

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

The Gaussian diffusion model, initially designed for image generation, has recently been adapted for 3D point cloud generation. However, these adaptations have not fully considered the intrinsic geometric characteristics of 3D shapes,…

Graphics · Computer Science 2024-08-01 Dengsheng Chen , Jie Hu , Xiaoming Wei , Enhua Wu

We introduce SceneDiffuser, a conditional generative model for 3D scene understanding. SceneDiffuser provides a unified model for solving scene-conditioned generation, optimization, and planning. In contrast to prior works, SceneDiffuser is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Siyuan Huang , Zan Wang , Puhao Li , Baoxiong Jia , Tengyu Liu , Yixin Zhu , Wei Liang , Song-Chun Zhu

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Boah Kim , Jong Chul Ye

This paper presents Text2Structure3D, a graph-based Machine Learning (ML) model that generates equilibrium structures from natural language prompts. Text2Structure3D is designed to support new intuitive ways of design exploration and…

Computational Engineering, Finance, and Science · Computer Science 2026-01-21 Lazlo Bleker , Zifeng Guo , Kaleb Smith , Kam-Ming Mark Tam , Karla Saldaña Ochoa , Pierluigi D'Acunto

Diffusion models are at the vanguard of generative AI research with renowned solutions such as ImageGen by Google Brain and DALL.E 3 by OpenAI. Nevertheless, the potential merits of diffusion models for communication engineering…

Information Theory · Computer Science 2023-11-17 Mehdi Letafati , Samad Ali , Matti Latva-aho

Urban wind flow modeling and simulation play an important role in air quality assessment and sustainable city planning. A key challenge for modeling and simulation is handling the complex geometries of the urban landscape. Low order models…

Machine Learning · Computer Science 2025-12-18 Francisco Giral , Álvaro Manzano , Ignacio Gómez , Petros Koumoutsakos , Soledad Le Clainche

We introduce a new diffusion-based approach for shape completion on 3D range scans. Compared with prior deterministic and probabilistic methods, we strike a balance between realism, multi-modality, and high fidelity. We propose DiffComplete…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ruihang Chu , Enze Xie , Shentong Mo , Zhenguo Li , Matthias Nießner , Chi-Wing Fu , Jiaya Jia

This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical…

Robotics · Computer Science 2025-10-15 Darshan Gadginmath , Fabio Pasqualetti

Diffusion models have become a new SOTA generative modeling method in various fields, for which there are multiple survey works that provide an overall survey. With the number of articles on diffusion models increasing exponentially in the…

Machine Learning · Computer Science 2023-04-05 Mengchun Zhang , Maryam Qamar , Taegoo Kang , Yuna Jung , Chenshuang Zhang , Sung-Ho Bae , Chaoning Zhang

Spatial profiling technologies in biology, such as imaging mass cytometry (IMC) and spatial transcriptomics (ST), generate high-dimensional, multi-channel data with strong spatial alignment and complex inter-channel relationships.…

Machine Learning · Computer Science 2025-07-08 Haoran Zhang , Mingyuan Zhou , Wesley Tansey

Text-conditioned image generation has made significant progress in recent years with generative adversarial networks and more recently, diffusion models. While diffusion models conditioned on text prompts have produced impressive and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Azade Farshad , Yousef Yeganeh , Yu Chi , Chengzhi Shen , Björn Ommer , Nassir Navab

Text-to-3D generation has shown rapid progress in recent days with the advent of score distillation, a methodology of using pretrained text-to-2D diffusion models to optimize neural radiance field (NeRF) in the zero-shot setting. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junyoung Seo , Wooseok Jang , Min-Seop Kwak , Hyeonsu Kim , Jaehoon Ko , Junho Kim , Jin-Hwa Kim , Jiyoung Lee , Seungryong Kim

Diffusion models have recently emerged as powerful generative models in medical imaging. However, it remains a major challenge to combine these data-driven models with domain knowledge to guide brain imaging problems. In neuroimaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ana Lawry Aguila , Dina Zemlyanker , You Cheng , Sudeshna Das , Daniel C. Alexander , Oula Puonti , Annabel Sorby-Adams , W. Taylor Kimberly , Juan Eugenio Iglesias

Realistic human geometry generation is an important yet challenging task, requiring both the preservation of fine clothing details and the accurate modeling of clothing-body interactions. To tackle this challenge, we build upon Geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xiangjun Tang , Biao Zhang , Peter Wonka

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Diffusion Probabilistic Models have recently shown remarkable performance in generative image modeling, attracting significant attention in the computer vision community. However, while a substantial amount of diffusion-based research has…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yijun Yang , Huazhu Fu , Angelica I. Aviles-Rivero , Carola-Bibiane Schönlieb , Lei Zhu

In recent years, mobile robots are becoming ambitious and deployed in large-scale scenarios. Serving as a high-level understanding of environments, a sparse skeleton graph is beneficial for more efficient global planning. Currently,…

Robotics · Computer Science 2022-08-09 Xinyi Chen , Boyu Zhou , Jiarong Lin , Yichen Zhang , Fu Zhang , Shaojie Shen