English
Related papers

Related papers: Variational Autoencoding Neural Operators

200 papers

We introduce sparse autoencoder neural operators (SAE-NOs), a new class of sparse autoencoders that operate in function spaces rather than fixed-dimensional Euclidean representations. We formalize the functional representation hypothesis,…

Machine Learning · Computer Science 2026-05-11 Bahareh Tolooshams , Ailsa Shen , Anima Anandkumar

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

In recent years, machine learning models, chiefly deep neural networks, have revealed suited to learn accurate energy-density functionals from data. However, problematic instabilities have been shown to occur in the search of ground-state…

Computational Physics · Physics 2024-09-26 Emanuele Costa , Giuseppe Scriva , Sebastiano Pilati

Neural operators have been explored as surrogate models for simulating physical systems to overcome the limitations of traditional partial differential equation (PDE) solvers. However, most existing operator learning methods assume that the…

Machine Learning · Computer Science 2024-02-13 Rui Zhang , Qi Meng , Zhi-Ming Ma

Among other uses, neural networks are a powerful tool for solving deterministic and Bayesian inverse problems in real-time, where variational autoencoders, a specialized type of neural network, enable the Bayesian estimation of model…

Machine Learning · Computer Science 2025-09-25 Andrea Tonini , Luca Dede'

Variational Autoencoders are one of the most commonly used generative models, particularly for image data. A prominent difficulty in training VAEs is data that is supported on a lower-dimensional manifold. Recent work by Dai and Wipf (2020)…

Machine Learning · Computer Science 2022-05-19 Frederic Koehler , Viraj Mehta , Chenghui Zhou , Andrej Risteski

We propose a novel machine learning strategy for studying neuroanatomical shape variation. Our model works with volumetric binary segmentation images, and requires no pre-processing such as the extraction of surface points or a mesh. The…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Evan M. Yu , Mert R. Sabuncu

Neural operators have emerged as a powerful data-driven paradigm for solving partial differential equations (PDEs), while their accuracy and scalability are still limited, particularly on irregular domains where fluid flows exhibit rich…

Machine Learning · Computer Science 2026-02-26 Qinxuan Wang , Chuang Wang , Mingyu Zhang , Jingwei Sun , Peipei Yang , Shuo Tang , Shiming Xiang

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

Machine Learning · Computer Science 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

Neural operators have become an effective framework for learning mappings between function spaces, yet most existing architectures realize operators within a single representational domain, such as physical, spectral, or latent space. In…

Machine Learning · Computer Science 2026-05-14 Hanli Qiao , George Em Karniadakis , Muhammad Muniruzzaman

Variational autoencoders employ an encoding neural network to generate a probabilistic representation of a data set within a low-dimensional space of latent variables followed by a decoding stage that maps the latent variables back to the…

Statistical Mechanics · Physics 2022-04-13 David Yevick

Variational Autoencoders (VAEs) are a powerful framework for learning latent representations of reduced dimensionality, while Neural ODEs excel in learning transient system dynamics. This work combines the strengths of both to generate fast…

Machine Learning · Computer Science 2025-02-27 Julius Aka , Johannes Brunnemann , Jörg Eiden , Arne Speerforck , Lars Mikelsons

We investigate the problem of learning representations that are invariant to certain nuisance or sensitive factors of variation in the data while retaining as much of the remaining information as possible. Our model is based on a…

Machine Learning · Statistics 2017-08-11 Christos Louizos , Kevin Swersky , Yujia Li , Max Welling , Richard Zemel

Generative models able to synthesize layouts of different kinds (e.g. documents, user interfaces or furniture arrangements) are a useful tool to aid design processes and as a first step in the generation of synthetic data, among other…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Diego Martin Arroyo , Janis Postels , Federico Tombari

The high cost of acquiring labels is one of the main challenges in deploying supervised machine learning algorithms. Active learning is a promising approach to control the learning process and address the difficulties of data labeling by…

Machine Learning · Computer Science 2019-11-19 Farhad Pourkamali-Anaraki , Michael B. Wakin

Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of incomplete physics…

Machine Learning · Computer Science 2021-10-28 Naoya Takeishi , Alexandros Kalousis

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

Sound · Computer Science 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

The predictive accuracy of operator learning frameworks depends on the quality and quantity of available training data (input-output function pairs), often requiring substantial amounts of high-fidelity data, which can be challenging to…

Machine Learning · Computer Science 2025-10-29 Sumanta Roy , Bahador Bahmani , Ioannis G. Kevrekidis , Michael D. Shields

The variational auto-encoder (VAE) is a popular method for learning a generative model and embeddings of the data. Many real datasets are hierarchically structured. However, traditional VAEs map data in a Euclidean latent space which cannot…

Machine Learning · Statistics 2019-11-27 Emile Mathieu , Charline Le Lan , Chris J. Maddison , Ryota Tomioka , Yee Whye Teh

Often the analysis of time-dependent chemical and biophysical systems produces high-dimensional time-series data for which it can be difficult to interpret which individual features are most salient. While recent work from our group and…