English
Related papers

Related papers: Learning the Maximum of a H\"older Function from I…

200 papers

We present a systematic study of the reconstruction of a non-negative function via maximum entropy approach utilizing the information contained in a finite number of moments of the function. For testing the efficacy of the approach, we…

Mathematical Physics · Physics 2015-05-18 Parthapratim Biswas , Arun K. Bhattacharya

A fundamental problem in statistics and machine learning is to estimate a function $f$ from possibly noisy observations of its point samples. The goal is to design a numerical algorithm to construct an approximation $\hat f$ to $f$ in a…

Statistics Theory · Mathematics 2025-05-30 Ronald DeVore , Robert D. Nowak , Rahul Parhi , Guergana Petrova , Jonathan W. Siegel

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

Machine Learning · Computer Science 2012-06-22 Sergey Levine , Vladlen Koltun

Recently, there was a substantial progress in the problem of sampling recovery on function classes with mixed smoothness. Mostly, it has been done by proving new and sometimes optimal upper bounds for both linear sampling recovery and for…

Numerical Analysis · Mathematics 2025-05-29 A. Gasnikov , V. Temlyakov

This article considers the problem of optimally recovering stable linear time-invariant systems observed via linear measurements made on their transfer functions. A common modeling assumption is replaced here by the related assumption that…

Optimization and Control · Mathematics 2019-08-19 Mahmood Ettehad , Simon Foucart

In a recent paper an Inexact Restoration method for solving continuous constrained optimization problems was analyzed from the point of view of worst-case functional complexity and convergence. On the other hand, the Inexact Restoration…

Optimization and Control · Mathematics 2023-09-20 L. F. Bueno , F. Larreal , J. M. Martínez

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

Iterative first-order methods such as gradient descent and its variants are widely used for solving optimization and machine learning problems. There has been recent interest in analytic or numerically efficient methods for computing…

Systems and Control · Computer Science 2020-03-24 Laurent Lessard , Peter Seiler

We propose a new reconstruction operator that aims to recover the missing parts of a function given the observed parts. This new operator belongs to a new, very large class of functional operators which includes the classical regression…

Statistics Theory · Mathematics 2019-05-14 Alois Kneip , Dominik Liebl

This paper considers the problem of reconstructing missing parts of functions based on their observed segments. It provides, for Gaussian processes and arbitrary bijective transformations thereof, theoretical expressions for the…

Statistics Theory · Mathematics 2024-11-04 Pauliina Ilmonen , Nourhan Shafik , Tommi Sottinen , Germain Van Bever , Lauri Viitasaari

The paper is about developing a solver for maximizing a real-valued function of binary variables. The solver relies on an algorithm that estimates the optimal objective-function value of instances from the underlying distribution of…

Machine Learning · Computer Science 2025-11-05 Nimrod Megiddo , Segev Wasserkrug , Orit Davidovich , Shimrit Shtern

This paper deals with the problem of finding suboptimal values of an unknown function on the basis of measured data corrupted by bounded noise. As a prior, we assume that the unknown function is parameterized in terms of a number of basis…

Optimization and Control · Mathematics 2025-06-10 Jaap Eising , Jorge Cortes

We propose an active-learning method for nonlinear minimax regression. Given a nonlinear function that can be arbitrarily evaluated over a compact set, we fit a surrogate model, such as a feedforward neural network, by minimizing the…

Systems and Control · Electrical Eng. & Systems 2026-04-24 Alberto Bemporad

In many real world problems, optimization decisions have to be made with limited information. The decision maker may have no a priori or posteriori data about the often nonconvex objective function except from on a limited number of points…

Optimization and Control · Mathematics 2011-11-10 Tansu Alpcan

The Inexact Restoration approach has proved to be an adequate tool for handling the problem of minimizing an expensive function within an arbitrary feasible set by using different degrees of precision in the objective function. The Inexact…

Optimization and Control · Mathematics 2023-04-28 Ernesto G. Birgin , Natasa Krejić , José Mario Martínez

We explore the local landscape of low-rank matrix recovery, focusing on reconstructing a $d_1\times d_2$ matrix $X^\star$ with rank $r$ from $m$ linear measurements, some potentially noisy. When the noise is distributed according to an…

Machine Learning · Computer Science 2025-04-07 Jianhao Ma , Salar Fattahi

Models based on approximation capabilities have recently been studied in the context of Optimal Recovery. These models, however, are not compatible with overparametrization, since model- and data-consistent functions could then be…

Optimization and Control · Mathematics 2020-04-02 Simon Foucart

We study worst-case guarantees on the expected return of fixed-dataset policy optimization algorithms. Our core contribution is a unified conceptual and mathematical framework for the study of algorithms in this regime. This analysis…

Artificial Intelligence · Computer Science 2020-12-01 Jacob Buckman , Carles Gelada , Marc G. Bellemare

We present a simplified derivation of the optimal checkpoint interval in Young_1974 [1]. The optimal checkpoint interval derivation in [1] is based on minimizing the total lost time as an objective-function. Lost time is a function of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-25 Nirmal Raj Saxena , Saurabh Hukerikar , Mikolaj Blaz , Swapna Raj

Consider the problem of finding an optimal value of some objective functional subject to constraints over numerical domain. This type of problem arises frequently in practical engineering tasks. Nowdays almost all general methods for…

Optimization and Control · Mathematics 2019-09-13 Sergey Karpukhin