English
Related papers

Related papers: Operator learning without the adjoint

200 papers

We consider the problem of performing inverse reinforcement learning when the trajectory of the expert is not perfectly observed by the learner. Instead, a noisy continuous-time observation of the trajectory is provided to the learner. This…

Robotics · Computer Science 2017-10-30 Shervin Shahryari , Prashant Doshi

Kaltofen has proposed a new approach in 1992 for computing matrix determinants without divisions. The algorithm is based on a baby steps/giant steps construction of Krylov subspaces, and computes the determinant as the constant term of a…

Symbolic Computation · Computer Science 2008-11-03 Gilles Villard

In this paper we continue to develop the following general approach. We study asymptotic behavior of the errors of sampling recovery not for an individual smoothness class, how it is usually done, but for the collection of classes, which…

Numerical Analysis · Mathematics 2026-01-14 V. Temlyakov

Fourier phase retrieval (FPR) is a challenging task widely used in various applications. It involves recovering an unknown signal from its Fourier phaseless measurements. FPR with few measurements is important for reducing time and hardware…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Liyuan Ma , Hongxia Wang , Ningyi Leng , Ziyang Yuan

One relates factorization of bivariate polynomials to singularities of projective plane curves. One proves that adjoint polynomials permit to solve the recombinations of the modular factors induced by the absolute and rational…

Algebraic Geometry · Mathematics 2012-02-20 Martin Weimann

An algorithm is proposed for solving optimization problems with stochastic objective and deterministic equality and inequality constraints. This algorithm is objective-function-free in the sense that it only uses the objective's gradient…

Optimization and Control · Mathematics 2026-04-01 S. Gratton , Ph. L. Toint

We consider large-scale Markov decision processes with an unknown cost function and address the problem of learning a policy from a finite set of expert demonstrations. We assume that the learner is not allowed to interact with the expert…

Machine Learning · Computer Science 2021-12-30 Angeliki Kamoutsi , Goran Banjac , John Lygeros

The goal of active learning is to achieve the same accuracy achievable by passive learning, while using much fewer labels. Exponential savings in terms of label complexity have been proved in very special cases, but fundamental lower bounds…

Machine Learning · Statistics 2026-01-01 Yinglun Zhu , Robert Nowak

This paper explores a method for solving constrained optimization problems when the derivatives of the objective function are unavailable, while the derivatives of the constraints are known. We allow the objective and constraint function to…

Optimization and Control · Mathematics 2024-02-20 Melody Qiming Xuan , Jorge Nocedal

This article considers algorithmic and statistical aspects of linear regression when the correspondence between the covariates and the responses is unknown. First, a fully polynomial-time approximation scheme is given for the natural least…

Machine Learning · Computer Science 2017-11-09 Daniel Hsu , Kevin Shi , Xiaorui Sun

Proximal operators are ubiquitous in inverse problems, commonly appearing as part of algorithmic strategies to regularize problems that are otherwise ill-posed. Modern deep learning models have been brought to bear for these tasks too, as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhenghan Fang , Sam Buchanan , Jeremias Sulam

We learn recurrent neural network optimizers trained on simple synthetic functions by gradient descent. We show that these learned optimizers exhibit a remarkable degree of transfer in that they can be used to efficiently optimize a broad…

Fourier phase retrieval (FPR) is an inverse problem that recovers the signal from its Fourier magnitude measurement, it's ill-posed especially when the sampling rates are low. In this paper, an untrained generative prior is introduced to…

Signal Processing · Electrical Eng. & Systems 2022-10-25 Liyuan Ma , Hongxia Wang , Ningyi Leng , Ziyang Yuan

We consider the problem of solving linear least squares problems in a framework where only evaluations of the linear map are possible. We derive randomized methods that do not need any other matrix operations than forward evaluations,…

Numerical Analysis · Mathematics 2023-09-15 Dirk A. Lorenz , Felix Schneppe , Lionel Tondji

Computationally efficient surrogates for parametrized physical models play a crucial role in science and engineering. Operator learning provides data-driven surrogates that map between function spaces. However, instead of full-field…

Machine Learning · Computer Science 2024-12-31 Daniel Zhengyu Huang , Nicholas H. Nelsen , Margaret Trautner

Pure exploration (aka active testing) is the fundamental task of sequentially gathering information to answer a query about a stochastic environment. Good algorithms make few mistakes and take few samples. Lower bounds (for multi-armed…

Machine Learning · Statistics 2019-06-26 Rémy Degenne , Wouter M. Koolen , Pierre Ménard

Solving an ill-posed linear inverse problem requires knowledge about the underlying signal model. In many applications, this model is a priori unknown and has to be learned from data. However, it is impossible to learn the model using…

Machine Learning · Statistics 2024-10-22 Julián Tachella , Dongdong Chen , Mike Davies

In this paper we study properties of functions of triples of not necessarily commuting self-adjoint operators. The main result of the paper shows that unlike in the case of functions of pairs of self-adjoint operators there is no Lipschitz…

Functional Analysis · Mathematics 2016-06-30 Vladimir Peller

We formulate the issue of minimality of self-adjoint operators on a Hilbert space as a semi-definite problem, linking the work by Overton in [1] to the characterization of minimal hermitian matrices. This motivates us to investigate the…

Functional Analysis · Mathematics 2024-05-16 Tamara Bottazzi , Alejandro Varela

We develop an algorithm for minimizing a function using $n$ batched function value measurements at each of $T$ rounds by using classifiers to identify a function's sublevel set. We show that sufficiently accurate classifiers can achieve…

Machine Learning · Statistics 2018-04-12 Tatsunori B. Hashimoto , Steve Yadlowsky , John C. Duchi