English
Related papers

Related papers: Conditional Diffusion-Flow models for generating 3…

200 papers

Diffusion models are a class of probabilistic generative models that have been widely used as a prior for image processing tasks like text conditional generation and inpainting. We demonstrate that these models can be adapted to make…

Machine Learning · Computer Science 2023-06-14 Marc Finzi , Anudhyan Boral , Andrew Gordon Wilson , Fei Sha , Leonardo Zepeda-Núñez

Adapting neural networks to new tasks typically requires task-specific fine-tuning, which is time-consuming and reliant on labeled data. We explore a generative alternative that produces task-specific parameters directly from task identity,…

Machine Learning · Computer Science 2025-06-24 Lijun Zhang , Xiao Liu , Hui Guan

Perceptual studies demonstrate that conditional diffusion models excel at reconstructing video content aligned with human visual perception. Building on this insight, we propose a video compression framework that leverages conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Fangqiu Yi , Jingyu Xu , Jiawei Shao , Chi Zhang , Xuelong Li

Diffusion models have been used in cosmological applications as a generative model for fast simulations and to reconstruct underlying cosmological fields or astrophysical images from noisy data. These two tasks are often treated as…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-07 Supranta S. Boruah , Michael Jacob , Bhuvnesh Jain

We construct a viable cosmological model based on velocity diffusion of matter particles. In order to ensure the conservation of the total energy-momentum tensor in the presence of diffusion, we include a cosmological scalar field $\phi$…

Cosmology and Nongalactic Astrophysics · Physics 2013-12-04 Simone Calogero , Hermano Velten

Most natural objects have inherent complexity and variability. While some simple objects can be modeled from first principles, many real-world phenomena, such as cloud formation, require computationally expensive simulations that limit…

Machine Learning · Computer Science 2025-06-13 Nadav Torem , Tamar Sde-Chen , Yoav Y. Schechner

Designing complex 3D scenes has been a tedious, manual process requiring domain expertise. Emerging text-to-3D generative models show great promise for making this task more intuitive, but existing approaches are limited to object-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ryan Po , Gordon Wetzstein

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

A grand challenge of the 21st century cosmology is to accurately estimate the cosmological parameters of our Universe. A major approach to estimating the cosmological parameters is to use the large-scale matter distribution of the Universe.…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-07 Siamak Ravanbakhsh , Junier Oliva , Sebastien Fromenteau , Layne C. Price , Shirley Ho , Jeff Schneider , Barnabas Poczos

The computational intensity of detector simulation and event reconstruction poses a significant difficulty for data analysis in collider experiments. This challenge inspires the continued development of machine learning techniques to serve…

High Energy Physics - Experiment · Physics 2024-11-22 Dmitrii Kobylianskii , Nathalie Soybelman , Nilotpal Kakati , Etienne Dreyer , Benjamin Nachman , Eilam Gross

Estimating physical properties of galaxies from wide-field surveys remains a central challenge in astrophysics. While spectroscopy provides precise measurements, it is observationally expensive, and photometry discards morphological…

Instrumentation and Methods for Astrophysics · Physics 2025-12-05 Mikaeel Yunus , John F. Wu , Benne W. Holwerda

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

We develop a novel statistical strong lensing approach to probe the cosmological parameters by exploiting multiple redshift image systems behind galaxies or galaxy clusters. The method relies on free-form mass inversion of strong lenses and…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-17 M. Lubini , M. Sereno , J. Coles , Ph. Jetzer , P. Saha

Semantic-driven 3D shape generation aims to generate 3D objects conditioned on text. Previous works face problems with single-category generation, low-frequency 3D details, and requiring a large number of paired datasets for training. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Bo Han , Yitong Fu , Yixuan Shen

Urban wind flow modeling and simulation play an important role in air quality assessment and sustainable city planning. A key challenge for modeling and simulation is handling the complex geometries of the urban landscape. Low order models…

Machine Learning · Computer Science 2025-12-18 Francisco Giral , Álvaro Manzano , Ignacio Gómez , Petros Koumoutsakos , Soledad Le Clainche

Deep generative models have shown impressive results in generating realistic images of faces. GANs managed to generate high-quality, high-fidelity images when conditioned on semantic masks, but they still lack the ability to diversify their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Nico Giambi , Giuseppe Lisanti

We consider the task of generating realistic 3D shapes, which is useful for a variety of applications such as automatic scene generation and physical simulation. Compared to other 3D representations like voxels and point clouds, meshes are…

Graphics · Computer Science 2023-04-18 Zhen Liu , Yao Feng , Michael J. Black , Derek Nowrouzezahrai , Liam Paull , Weiyang Liu

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

We introduce a new diffusion-based approach for shape completion on 3D range scans. Compared with prior deterministic and probabilistic methods, we strike a balance between realism, multi-modality, and high fidelity. We propose DiffComplete…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ruihang Chu , Enze Xie , Shentong Mo , Zhenguo Li , Matthias Nießner , Chi-Wing Fu , Jiaya Jia

Recent improvements in conditional generative modeling have made it possible to generate high-quality images from language descriptions alone. We investigate whether these methods can directly address the problem of sequential…

Machine Learning · Computer Science 2023-07-11 Anurag Ajay , Yilun Du , Abhi Gupta , Joshua Tenenbaum , Tommi Jaakkola , Pulkit Agrawal