English
Related papers

Related papers: $\beta$-Variational autoencoders and transformers …

200 papers

The ability to recognize objects despite there being differences in appearance, known as Core Object Recognition, forms a critical part of human perception. While it is understood that the brain accomplishes Core Object Recognition through…

Machine Learning · Computer Science 2020-05-15 Harshvardhan Sikka

Computational fluid dynamics (CFD) simulations play an important role in engineering science and applications, however, it is not applicable for problems requiring a large number of repeated calculations. Accordingly, many reduced-order…

Fluid Dynamics · Physics 2026-05-28 Shan Ding , Yongfu Tian , Rui Yang

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

Machine Learning · Computer Science 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

Autoencoders and generative neural network models have recently gained popularity in fluid mechanics due to their spontaneity and low processing time instead of high fidelity CFD simulations. Auto encoders are used as model order reduction…

Fluid Dynamics · Physics 2022-03-04 Kanishk , Tanishk Nandal , Prince Tyagi , Raj Kumar Singh

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned representations. We…

Machine Learning · Computer Science 2020-05-29 Andriy Serdega , Dae-Shik Kim

Structural Health Monitoring of Floating Offshore Wind Turbines (FOWTs) is critical for ensuring operational safety and efficiency. However, identifying damage in components like mooring systems from limited sensor data poses a challenging…

Computational Engineering, Finance, and Science · Computer Science 2026-01-13 Ana Fernandez-Navamuel , Martin Alberto Diaz Viera , Matteo Croci

Extracting large amounts of data from biological samples is not feasible due to radiation issues, and image processing in the small-data regime is one of the critical challenges when working with a limited amount of data. In this work, we…

Machine Learning · Computer Science 2020-07-21 Varun Mannam , Arman Kazemi

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

We introduce a framework that integrates variational autoencoders (VAE) with reinforcement learning (RL) to balance system performance and resource usage in multi-agent systems by dynamically adjusting network structures over time. A key…

Machine Learning · Computer Science 2024-11-01 Qiliang Chen , Babak Heydari

Variational Autoencoders (VAEs) provide a flexible and scalable framework for non-linear dimensionality reduction. However, in application domains such as genomics where data sets are typically tabular and high-dimensional, a black-box…

Machine Learning · Statistics 2020-03-10 Kaspar Märtens , Christopher Yau

Learning from an imbalanced distribution presents a major challenge in predictive modeling, as it generally leads to a reduction in the performance of standard algorithms. Various approaches exist to address this issue, but many of them…

Machine Learning · Computer Science 2024-12-11 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

Computation and Language · Computer Science 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

Electron, optical, and scanning probe microscopy methods are generating ever increasing volume of image data containing information on atomic and mesoscale structures and functionalities. This necessitates the development of the machine…

Machine Learning · Computer Science 2023-04-03 Mani Valleti , Yongtao Liu , Sergei Kalinin

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

Machine Learning · Computer Science 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

This paper proposes a new model for music prediction based on Variational Autoencoders (VAEs). In this work, VAEs are used in a novel way in order to address two different problems: music representation into the latent space, and using this…

Sound · Computer Science 2019-06-25 Daniel Rivero , Enrique Fernandez-Blanco , Alejandro Pazos

Variational autoencoders are among the most popular methods for distilling low-dimensional structure from high-dimensional data, making them increasingly valuable as tools for data exploration and scientific discovery. However, unlike…

Machine Learning · Computer Science 2022-01-17 Miles Martinez , John Pearson

Variational autoencoders (VAEs) are essential tools in end-to-end representation learning. However, the sequential text generation common pitfall with VAEs is that the model tends to ignore latent variables with a strong auto-regressive…

Machine Learning · Computer Science 2021-02-26 Yang Zhao , Ping Yu , Suchismit Mahapatra , Qinliang Su , Changyou Chen

In this paper we propose a Bayesian method as a numerical way to correct and stabilise projection-based reduced order models (ROM) in computational fluid dynamics problems. The approach is of hybrid type, and consists of the classical…

Numerical Analysis · Mathematics 2019-11-19 Giovanni Stabile , Bojana Rosic

Analyzing large-scale data from simulations of turbulent flows is memory intensive, requiring significant resources. This major challenge highlights the need for data compression techniques. In this study, we apply a physics-informed Deep…

Fluid Dynamics · Physics 2022-07-26 Mohammadreza Momenifar , Enmao Diao , Vahid Tarokh , Andrew D. Bragg

A novel convolutional autoencoder neural ODE (CAE-NODE) framework is proposed for a reduced-order model (ROM) of transient 2D counterflow flames, as an extension of AE-NODE methods in homogeneous reactive systems to spatially resolved…