English
Related papers

Related papers: Decoding Photons: Physics in the Latent Space of a…

200 papers

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

With the recent advance of geometric deep learning, neural networks have been extensively used for data in non-Euclidean domains. In particular, hyperbolic neural networks have proved successful in processing hierarchical information of…

Machine Learning · Computer Science 2023-01-24 Eric Qu , Dongmian Zou

We investigate how symmetries present in datasets affect the structure of the latent space learned by Variational Autoencoders (VAEs). By training VAEs on data originating from simple mechanical systems and particle collisions, we analyze…

Machine Learning · Computer Science 2025-04-08 Veronica Sanz

This paper studies the fundamental problem of learning multi-layer generator models. The multi-layer generator model builds multiple layers of latent variables as a prior model on top of the generator, which benefits learning complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Jiali Cui , Ying Nian Wu , Tian Han

LHCb is one of the major experiments operating at the Large Hadron Collider at CERN. The richness of the physics program and the increasing precision of the measurements in LHCb lead to the need of ever larger simulated samples. This need…

Instrumentation and Detectors · Physics 2021-02-03 Fedor Ratnikov

Generative adversarial networks (GANs) are a powerful framework for generative tasks. However, they are difficult to train and tend to miss modes of the true data generation process. Although GANs can learn a rich representation of the…

Machine Learning · Computer Science 2017-11-27 Robin Winter , Djork-Arné Clevert

We present an implementation of an explainable and physics-aware machine learning model capable of inferring the underlying physics of high-energy particle collisions using the information encoded in the energy-momentum four-vectors of the…

High Energy Physics - Phenomenology · Physics 2022-04-20 Yue Shi Lai , Duff Neill , Mateusz Płoskoń , Felix Ringer

We propose a new algorithm for training generative adversarial networks that jointly learns latent codes for both identities (e.g. individual humans) and observations (e.g. specific photographs). By fixing the identity portion of the latent…

Machine Learning · Computer Science 2018-02-26 Chris Donahue , Zachary C. Lipton , Akshay Balsubramani , Julian McAuley

The development of quantum-classical hybrid (QCH) algorithms is critical to achieve state-of-the-art computational models. A QCH variational autoencoder (QVAE) was introduced in Ref. [1] by some of the authors of this paper. QVAE consists…

Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used…

Machine Learning · Computer Science 2019-05-03 Maciej Zamorski , Maciej Zięba , Piotr Klukowski , Rafał Nowak , Karol Kurach , Wojciech Stokowiec , Tomasz Trzciński

Generative modeling frameworks have emerged as an effective approach to capture high-dimensional image distributions from large datasets without requiring domain-specific knowledge, a capability essential for longitudinal disease…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ayantika Das , Arunima Sarkar , Keerthi Ram , Mohanasankar Sivaprakasam

Detectors in next-generation high-energy physics experiments face several daunting requirements, such as high data rates, damaging radiation exposure, and stringent constraints on power, space, and latency. To address these challenges,…

Data Analysis, Statistics and Probability · Physics 2025-08-18 Alexander Yue , Haoyi Jia , Julia Gonski

By sampling from the latent space of an autoencoder and decoding the latent space samples to the original data space, any autoencoder can simply be turned into a generative model. For this to work, it is necessary to model the autoencoder's…

Machine Learning · Statistics 2023-09-19 Maximilian Coblenz , Oliver Grothe , Fabian Kächele

The use of Variational Autoencoders in different Machine Learning tasks has drastically increased in the last years. They have been developed as denoising, clustering and generative tools, highlighting a large potential in a wide range of…

Machine Learning · Computer Science 2019-07-12 Helena Andrés-Terré , Pietro Lió

Latent diffusion models have established a new state-of-the-art in high-resolution visual generation. Integrating Vision Foundation Model priors improves generative efficiency, yet existing latent designs remain largely heuristic. These…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hangyu Liu , Jianyong Wang , Yutao Sun

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Generative Adversarial Networks (GANs) play an increasingly important role in machine learning. However, there is one fundamental issue hindering their practical applications: the absence of capability for encoding real-world samples. The…

Machine Learning · Computer Science 2022-03-02 Jiapeng Zhu , Deli Zhao , Bo Zhang , Bolei Zhou

Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation…

Atmospheric and Oceanic Physics · Physics 2022-11-09 Lucy Harris , Andrew T. T. McRae , Matthew Chantry , Peter D. Dueben , Tim N. Palmer

In this paper, we explore the use of a variational autoencoder (VAE), a deep generative model, to compress and generate images of dark matter density fields from $\Lambda$CDM like cosmological simulations. The VAE learns a compact,…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-25 Jazhiel Chacón-Lavanderos , Isidro Gómez-Vargas , Ricardo Menchaca-Mendez , J. Alberto Vázquez

Most visual generative models compress images into a latent space before applying diffusion or autoregressive modelling. Yet, existing approaches such as VAEs and foundation model aligned encoders implicitly constrain the latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Sen Ye , Jianning Pei , Mengde Xu , Shuyang Gu , Chunyu Wang , Liwei Wang , Han Hu