English
Related papers

Related papers: Generative Models For Deep Learning with Very Scar…

200 papers

Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 'rehearsal-free'…

Machine Learning · Computer Science 2023-11-10 Gido M. van de Ven , Zhe Li , Andreas S. Tolias

We investigate the performance of machine learning algorithms trained exclusively with configurations obtained from importance sampling Monte Carlo simulations of the two-dimensional Ising model with conserved magnetization. For supervised…

Statistical Mechanics · Physics 2021-03-19 Ahmadreza Azizi , Michel Pleimling

In this work, we develop an importance sampling estimator by coupling the reduced-order model and the generative model in a problem setting of uncertainty quantification. The target is to estimate the probability that the quantity of…

Machine Learning · Statistics 2024-12-20 Xiaoliang Wan , Shuangqing Wei

Semi-supervised learning through deep generative models and multi-lingual pretraining techniques have orchestrated tremendous success across different areas of NLP. Nonetheless, their development has happened in isolation, while the…

Computation and Language · Computer Science 2021-01-27 Yi Zhu , Ehsan Shareghi , Yingzhen Li , Roi Reichart , Anna Korhonen

Generative learning generates high dimensional data based on low dimensional conditions, also called prompts. Therefore, generative learning algorithms are eligible for solving (Bayesian) inverse problems. In this article we compare a…

Machine Learning · Computer Science 2026-02-02 Patrick Krüger , Patrick Materne , Werner Krebs , Hanno Gottschalk

Massive MIMO (mMIMO) systems are essential for 5G/6G networks to meet high throughput and reliability demands, with machine learning (ML)-based techniques, particularly autoencoders (AEs), showing promise for practical deployment. However,…

Information Theory · Computer Science 2024-11-27 Ju-Hyung Lee , Joohan Lee , Andreas F. Molisch

Deep generative models provide a powerful set of tools to understand real-world data. But as these models improve, they increase in size and complexity, so their computational cost in memory and execution time grows. Using binary weights in…

Machine Learning · Computer Science 2021-05-05 Thomas Bird , Friso H. Kingma , David Barber

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

Machine Learning · Statistics 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

The goal of generative machine learning is to model the probability distribution underlying a given data set. This probability distribution helps to characterize the generation process of the data samples. While classical generative machine…

Quantum Physics · Physics 2021-11-29 Christa Zoufal

In standard generative deep learning models, such as autoencoders or GANs, the size of the parameter set is proportional to the complexity of the generated data distribution. A significant challenge is to deploy resource-hungry deep…

Machine Learning · Computer Science 2021-10-29 Shreshth Tuli , Shikhar Tuli , Giuliano Casale , Nicholas R. Jennings

Despite recent advances, goal-directed generation of structured discrete data remains challenging. For problems such as program synthesis (generating source code) and materials design (generating molecules), finding examples which satisfy…

Machine Learning · Computer Science 2020-10-26 Amina Mollaysa , Brooks Paige , Alexandros Kalousis

In recent years deep neural networks have been successfully applied to the domains of reinforcement learning \cite{bengio2009learning,krizhevsky2012imagenet,hinton2006reducing}. Deep reinforcement learning \cite{mnih2015human} is reported…

Machine Learning · Computer Science 2020-05-19 Huihui Zhang , Wu Huang

Recent deep learning models have shown improving results to natural language generation (NLG) irrespective of providing sufficient annotated data. However, a modest training data may harm such models performance. Thus, how to build a…

Computation and Language · Computer Science 2018-11-13 Van-Khanh Tran , Le-Minh Nguyen

Variational autoencoders (VAEs) are powerful generative models with the salient ability to perform inference. Here, we introduce a quantum variational autoencoder (QVAE): a VAE whose latent generative process is implemented as a quantum…

A generative model is developed for deep (multi-layered) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up (pretraining) and top-down (refinement)…

Machine Learning · Statistics 2015-04-17 Yunchen Pu , Xin Yuan , Lawrence Carin

Heralded by the initial success in speech recognition and image classification, learning-based approaches with neural networks, commonly referred to as deep learning, have spread across various fields. A primitive form of a neural network…

Robotics · Computer Science 2024-09-02 Takuma Yoneda

The deployment of reinforcement learning (RL)-based controllers on physical systems is often limited by poor generalization to real-world scenarios, known as the simulation-to-reality (sim-to-real) gap. This gap is particularly challenging…

Machine Learning · Computer Science 2026-05-12 Alex E. Ballentine , Nachiket U. Bapat , Raghvendra V. Cowlagi

Constrained generative modeling is fundamental to applications such as robotic control and autonomous driving, where models must respect physical laws and safety-critical constraints. In real-world settings, these constraints rarely take…

Machine Learning · Computer Science 2026-03-10 Xiaoxuan Liang , Saeid Naderiparizi , Yunpeng Liu , Berend Zwartsenberg , Frank Wood

In population synthesis applications, when considering populations with many attributes, a fundamental problem is the estimation of rare combinations of feature attributes. Unsurprisingly, it is notably more difficult to reliably…

Machine Learning · Statistics 2019-09-18 Sergio Garrido , Stanislav S. Borysov , Francisco C. Pereira , Jeppe Rich