中文
相关论文

相关论文: $\beta$-Variational autoencoders and transformers …

200 篇论文

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

机器学习 · 计算机科学 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Variational autoencoders (VAEs) are powerful deep generative models widely used to represent high-dimensional complex data through a low-dimensional latent space learned in an unsupervised manner. In the original VAE model, the input data…

机器学习 · 计算机科学 2022-07-05 Laurent Girin , Simon Leglaive , Xiaoyu Bie , Julien Diard , Thomas Hueber , Xavier Alameda-Pineda

We introduce a deep learning method to simulate the motion of particles trapped in a chaotic recirculating flame. The Lagrangian trajectories of particles, captured using a high-speed camera and subsequently reconstructed in 3-dimensional…

机器学习 · 统计学 2018-12-13 Pai Liu , Jingwei Gan , Rajan K. Chakrabarty

In many data analysis tasks, it is beneficial to learn representations where each dimension is statistically independent and thus disentangled from the others. If data generating factors are also statistically independent, disentangled…

机器学习 · 统计学 2019-12-12 Harshvardhan Sikka , Weishun Zhong , Jun Yin , Cengiz Pehlevan

We present an Auto-Encoded Reservoir-Computing (AE-RC) approach to learn the dynamics of a 2D turbulent flow. The AE-RC consists of an Autoencoder, which discovers an efficient manifold representation of the flow state, and an Echo State…

流体动力学 · 物理学 2021-03-25 Nguyen Anh Khoa Doan , Wolfgang Polifke , Luca Magri

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

计算机视觉与模式识别 · 计算机科学 2022-07-12 Dooseop Choi , KyoungWook Min

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

机器学习 · 计算机科学 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

Finding disentangled representation plays a predominant role in the success of modern deep learning applications, but the results lack a straightforward explanation. Here we apply the information bottleneck method and its $\beta$-VAE…

强关联电子 · 物理学 2022-07-01 Dongchen Huang , Danqing Hu , Yi-feng Yang

Variational autoencoder (VAE) neural networks can be trained to generate power system states that capture both marginal distribution and multivariate dependencies of historical data. The coordinates of the latent space codes of VAEs have…

系统与控制 · 电气工程与系统科学 2023-03-22 Chenguang Wang , Ensieh Sharifnia , Simon H. Tindemans , Peter Palensky

We present a simple neural rendering architecture that helps variational autoencoders (VAEs) learn disentangled representations. Instead of the deconvolutional network typically used in the decoder of VAEs, we tile (broadcast) the latent…

机器学习 · 计算机科学 2019-08-15 Nicholas Watters , Loic Matthey , Christopher P. Burgess , Alexander Lerchner

A variational autoencoder (VAE) derived from Tsallis statistics called q-VAE is proposed. In the proposed method, a standard VAE is employed to statistically extract latent space hidden in sampled data, and this latent space helps make…

机器学习 · 计算机科学 2021-08-27 Taisuke Kobayashi

We present a new data-driven model to reconstruct nonlinear flow from spatially sparse observations. The model is a version of a conditional variational auto-encoder (CVAE), which allows for probabilistic reconstruction and thus uncertainty…

机器学习 · 统计学 2021-02-24 Kristian Gundersen , Anna Oleynik , Nello Blaser , Guttorm Alendal

The combination of machine learning models with physical models is a recent research path to learn robust data representations. In this paper, we introduce p$^3$VAE, a variational autoencoder that integrates prior physical knowledge about…

计算机视觉与模式识别 · 计算机科学 2025-02-27 Romain Thoreau , Laurent Risser , Véronique Achard , Béatrice Berthelot , Xavier Briottet

We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders…

机器学习 · 计算机科学 2021-03-17 Ryan Lopez , Paul J. Atzberger

Variational autoencoders (VAEs) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their…

机器学习 · 计算机科学 2024-12-10 Hadi Vafaii , Dekel Galor , Jacob L. Yates

In end-to-end optimized learned image compression, it is standard practice to use a convolutional variational autoencoder with generalized divisive normalization (GDN) to transform images into a latent space. Recently, Operational Neural…

图像与视频处理 · 电气工程与系统科学 2021-05-31 M. Akın Yılmaz , Onur Keleş , Hilal Güven , A. Murat Tekalp , Junaid Malik , Serkan Kıranyaz

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

机器学习 · 计算机科学 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

The key idea of variational auto-encoders (VAEs) resembles that of traditional auto-encoder models in which spatial information is supposed to be explicitly encoded in the latent space. However, the latent variables in VAEs are vectors,…

机器学习 · 计算机科学 2019-01-23 Zhengyang Wang , Hao Yuan , Shuiwang Ji

Reconstruction and fast prediction of flow fields are important for the improvement of data center operations and energy savings. In this study, an artificial neural network (ANN) and variational autoencoder (VAE) composite model is…

流体动力学 · 物理学 2024-02-27 Gongyan Liu , Runze Li , Xiaozhou Zhou , Tianrui Sun , Yufei Zhang

A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other…

无序系统与神经网络 · 物理学 2021-04-22 Yongtao Liu , Rama K. Vasudevan , Kyle Kelley , Dohyung Kim , Yogesh Sharma , Mahshid Ahmadi , Sergei V. Kalinin , Maxim Ziatdinov