English
Related papers

Related papers: Information-Theoretic Bounds for Integral Estimati…

200 papers

This paper considers the problem of estimating a periodic function in a continuous time regression model with a general square integrable semimartingale noise. A model selection adaptive procedure is proposed. Sharp non-asymptotic oracle…

Statistics Theory · Mathematics 2009-09-18 Victor Konev , Serguei Pergamenchtchikov

This paper consider penalized empirical loss minimization of convex loss functions with unknown non-linear target functions. Using the elastic net penalty we establish a finite sample oracle inequality which bounds the loss of our estimator…

Statistics Theory · Mathematics 2013-12-13 Mehmet Caner , Anders Bredahl Kock

This work proposes a universal and adaptive second-order method for minimizing second-order smooth, convex functions. Our algorithm achieves $O(\sigma / \sqrt{T})$ convergence when the oracle feedback is stochastic with variance $\sigma^2$,…

Optimization and Control · Mathematics 2022-12-13 Kimon Antonakopoulos , Ali Kavis , Volkan Cevher

Finding the maximum value of a function in a dynamic model plays an important role in many application settings, including discrete optimization in the presence of hard constraints. We present an iterative quantum algorithm for finding the…

Quantum Physics · Physics 2020-06-09 Charles Moussa , Henri Calandra , Travis S. Humble

We investigate the numerical approximation of integrals over $\mathbb{R}^d$ equipped with the standard Gaussian measure $\gamma$ for integrands belonging to the Gaussian-weighted Sobolev spaces $W^\alpha_p(\mathbb{R}^d, \gamma)$ of mixed…

Numerical Analysis · Mathematics 2023-06-21 Dinh Dũng , Van Kien Nguyen

We consider non parametric estimation problem for stochastic tomography regression model, i.e. we consider the estimation problem of function of multivariate variables (image) observed through its Radon transformation calculated with the…

Statistics Theory · Mathematics 2018-11-22 Dominique Fourdrinier , Sergey Pergamenshchikov

Quantum amplitude estimation is a key sub-routine of a number of quantum algorithms with various applications. We propose an adaptive algorithm for interval estimation of amplitudes. The quantum part of the algorithm is based only on…

Quantum Physics · Physics 2022-06-20 Yunpeng Zhao , Haiyan Wang , Kuai Xu , Yue Wang , Ji Zhu , Feng Wang

An adaptive nonparametric estimation procedure is constructed for the estimation problem of heteroscedastic regression when the noise variance depends on the unknown regression. A non-asymptotic upper bound for a quadratic risk (an oracle…

Statistics Theory · Mathematics 2008-12-18 Leonid Galtchouk , Serguey Pergamenshchikov

We initiate the study of stochastic optimization with oblivious noise, broadly generalizing the standard heavy-tailed noise setup. In our setting, in addition to random observation noise, the stochastic gradient may be subject to…

Data Structures and Algorithms · Computer Science 2024-08-06 Ilias Diakonikolas , Sushrut Karmalkar , Jongho Park , Christos Tzamos

We propose a new procedure for estimating high dimensional Gaussian graphical models. Our approach is asymptotically tuning-free and non-asymptotically tuning-insensitive: it requires very few efforts to choose the tuning parameter in…

Methodology · Statistics 2012-09-13 Han Liu , Lie Wang

We consider minimization of a smooth nonconvex function with inexact oracle access to gradient and Hessian (without assuming access to the function value) to achieve approximate second-order optimality. A novel feature of our method is that…

Optimization and Control · Mathematics 2024-03-27 Shuyao Li , Stephen J. Wright

We provide a first-order oracle complexity lower bound for finding stationary points of min-max optimization problems where the objective function is smooth, nonconvex in the minimization variable, and strongly concave in the maximization…

Optimization and Control · Mathematics 2021-04-20 Haochuan Li , Yi Tian , Jingzhao Zhang , Ali Jadbabaie

In our preceding paper, we have proposed an algorithm for obtaining finite-norm solutions of higher-order linear ordinary differential equations of the Fuchsian type [\sum_m p_m (x) (d/dx)^m] f(x) = 0 (where p_m is a polynomial with…

Numerical Analysis · Mathematics 2016-09-28 Fuminori Sakaguchi , Masahito Hayashi

The approximate degree of a Boolean function is the minimum degree of real polynomial that approximates it pointwise. For any Boolean function, its approximate degree serves as a lower bound on its quantum query complexity, and generically…

Computational Complexity · Computer Science 2023-05-23 Mark Bun , Nadezhda Voronova

Classical trust region methods were designed to solve problems in which function and gradient information are exact. This paper considers the case when there are bounded errors (or noise) in the above computations and proposes a simple…

Optimization and Control · Mathematics 2022-01-05 Shigeng Sun , Jorge Nocedal

Several scenarios require the optimization of non-convex black-box functions, that are noisy expensive to evaluate functions with unknown analytical expression, whose gradients are hence not accessible. For example, the hyper-parameter…

Machine Learning · Computer Science 2025-02-12 Eduardo C. Garrido-Merchán

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

We derive an asymptotic error formula for Gauss--Legendre quadrature applied to functions with limited regularity, using the contour-integral representation of the remainder term. To address the absence of uniformly valid approximations of…

Numerical Analysis · Mathematics 2025-09-30 Pei Liu

We study the fundamental tradeoffs between computational tractability and statistical accuracy for a general family of hypothesis testing problems with combinatorial structures. Based upon an oracle model of computation, which captures the…

Machine Learning · Statistics 2015-12-31 Zhaoran Wang , Quanquan Gu , Han Liu

We present new algorithms for inverse reinforcement learning (IRL, or inverse optimal control) in convex optimization settings. We argue that finite-space IRL can be posed as a convex quadratic program under a Bayesian inference framework…

Machine Learning · Computer Science 2013-01-22 Qifeng Qiao , Peter A. Beling