English
Related papers

Related papers: Generalized Eigenvalue Problems with Generative Pr…

200 papers

Generative modeling over discrete data has recently seen numerous success stories, with applications spanning language modeling, biological sequence design, and graph-structured molecular data. The predominant generative modeling paradigm…

Machine Learning · Computer Science 2024-11-01 Oscar Davis , Samuel Kessler , Mircea Petrache , İsmail İlkan Ceylan , Michael Bronstein , Avishek Joey Bose

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

Despite the increasing use of the Particle Finite Element Method (PFEM) in fluid flow simulation and the outstanding success of the Generalized-alpha time integration method, very little discussion has been devoted to their combined…

We present a computationally-efficient strategy to initialise the hyperparameters of a Gaussian process (GP) avoiding the computation of the likelihood function. Our strategy can be used as a pretraining stage to find initial conditions for…

Machine Learning · Computer Science 2023-04-27 Felipe Tobar , Elsa Cazelles , Taco de Wolff

Generalized Linear Models (GLM) form a wide class of regression and classification models, where prediction is a function of a linear combination of the input variables. For statistical inference in high dimension, sparsity inducing…

Machine Learning · Statistics 2022-08-25 Mathurin Massias , Samuel Vaiter , Alexandre Gramfort , Joseph Salmon

Generative models are capable to address difficult problems with non-unique solutions like bandwidth extension and gap filling, removing highly non-linear artifacts from codecs, clipping and distortion, as opposed to removing linear…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-18 Sebastian Braun

Grammatical Evolution (GE) is one of the most popular Genetic Programming (GP) variants, and it has been used with success in several problem domains. Since the original proposal, many enhancements have been proposed to GE in order to…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Jessica Mégane , Nuno Lourenço , Penousal Machado

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

We consider a stochastic generalized Nash equilibrium problem (GNEP) with expected-value cost functions. Inspired by Yi and Pavel (Automatica, 2019), we propose a distributed GNE seeking algorithm by exploiting the forward-backward operator…

Optimization and Control · Mathematics 2020-02-17 Barbara Franci , Sergio Grammatico

Invertible flow-based generative models are an effective method for learning to generate samples, while allowing for tractable likelihood computation and inference. However, the invertibility requirement restricts models to have the same…

Machine Learning · Computer Science 2020-02-21 Abhishek Kumar , Ben Poole , Kevin Murphy

In this article, we propose a data-driven reduced basis (RB) method for the approximation of parametric eigenvalue problems. The method is based on the offline and online paradigms. In the offline stage, we generate snapshots and construct…

Numerical Analysis · Mathematics 2023-01-24 Fleurianne Bertrand , Daniele Boffi , Abdul Halim

Gaussian Process Regression (GPR) is a powerful tool for nonparametric regression, but its application in a fully Bayesian fashion in high-dimensional settings is hindered by two primary challenges: the difficulty of variable selection and…

Methodology · Statistics 2025-11-11 Peter Knaus

Preference learning from human feedback has the ability to align generative models with the needs of end-users. Human feedback is costly and time-consuming to obtain, which creates demand for data-efficient query selection methods. This…

Machine Learning · Computer Science 2026-02-18 Guy Schacht , Ziyad Sheebaelhamd , Riccardo De Santi , Mojmír Mutný , Andreas Krause

We study sample efficient reinforcement learning (RL) under the general framework of interactive decision making, which includes Markov decision process (MDP), partially observable Markov decision process (POMDP), and predictive state…

Machine Learning · Computer Science 2023-07-03 Han Zhong , Wei Xiong , Sirui Zheng , Liwei Wang , Zhaoran Wang , Zhuoran Yang , Tong Zhang

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

The performance of Gaussian Process (GP) regression is often hampered by the curse of dimensionality, which inflates computational cost and reduces predictive power in high-dimensional problems. Variable selection is thus crucial for…

Methodology · Statistics 2025-11-24 Minshen Xu , Shiwei Lan , Lulu Kang

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

Since most inverse problems arising in scientific and engineering applications are ill-posed, prior information about the solution space is incorporated, typically through regularization, to establish a well-posed problem with a unique…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Carter Lyons , Raghu G. Raj , Margaret Cheney

Classical penalized likelihood regression problems deal with the case that the independent variables data are known exactly. In practice, however, it is common to observe data with incomplete covariate information. We are concerned with a…

Methodology · Statistics 2010-08-04 Xiwen Ma , Bin Dai , Ronald Klein , Barbara E. K. Klein , Kristine E. Lee , Grace Wahba

Methods for solving PDEs using neural networks have recently become a very important topic. We provide an a priori error analysis for such methods which is based on the $\mathcal{K}_1(\mathbb{D})$-norm of the solution. We show that the…

Numerical Analysis · Mathematics 2022-07-15 Qingguo Hong , Jonathan W. Siegel , Jinchao Xu