English
Related papers

Related papers: On Sharp Stochastic Zeroth Order Hessian Estimator…

200 papers

We consider entanglement-assisted frequency estimation by Ramsey interferometry, in the presence of dephasing noise from spatiotemporally correlated environments.By working in the widely employed local estimation regime, we show that even…

Quantum Physics · Physics 2023-09-20 Francisco Riberi , Gerardo Paz-Silva , Lorenza Viola

First-order optimization algorithms can be considered as a discretization of ordinary differential equations (ODEs) \cite{su2014differential}. In this perspective, studying the properties of the corresponding trajectories may lead to…

Optimization and Control · Mathematics 2022-06-22 Jean-François Aujol , Charles Dossal , Văn Hào Hoàng , Hippolyte Labarrière , Aude Rondepierre

We introduce a hybrid stochastic estimator to design stochastic gradient algorithms for solving stochastic optimization problems. Such a hybrid estimator is a convex combination of two existing biased and unbiased estimators and leads to…

Optimization and Control · Mathematics 2019-05-16 Quoc Tran-Dinh , Nhan H. Pham , Dzung T. Phan , Lam M. Nguyen

We show how to control the bias of a sieve type profile estimator under natural conditions on the Hessian of the expected contrast functional.

Statistics Theory · Mathematics 2014-06-18 Andreas Andresen

We will propose a new algorithm for finding critical points of cost functions defined on a differential manifold. We will lift the initial cost function to a manifold that can be embedded in a Riemannian manifold (Euclidean space) and will…

Optimization and Control · Mathematics 2018-09-05 Petre Birtea , Dan Comănescu , Călin-Adrian Popa

Optimization of convex functions under stochastic zeroth-order feedback has been a major and challenging question in online learning. In this work, we consider the problem of optimizing second-order smooth and strongly convex functions…

Machine Learning · Computer Science 2024-07-01 Qian Yu , Yining Wang , Baihe Huang , Qi Lei , Jason D. Lee

In this paper, we derive an \emph{a priori} second order estimate for solutions which are in $\Gamma_{k+1}$ cone to a class of complex Hessian equations with both sides of the equation depending on the gradient on compact Hermitian…

Analysis of PDEs · Mathematics 2021-05-25 Weisong Dong

In this paper, we give explicit descriptions of versions of (Local-) Backtracking Gradient Descent and New Q-Newton's method to the Riemannian setting.Here are some easy to state consequences of results in this paper, where X is a general…

Optimization and Control · Mathematics 2020-09-01 Tuyen Trung Truong

In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and…

Optimization and Control · Mathematics 2024-02-06 Fangzhao Zhang , Mert Pilanci

Robins et al. (2008, 2017) applied the theory of higher order influence functions (HOIFs) to derive an estimator of the mean $\psi$ of an outcome Y in a missing data model with Y missing at random conditional on a vector X of continuous…

Statistics Theory · Mathematics 2026-01-27 Lin Liu , Rajarshi Mukherjee , Whitney K. Newey , James M. Robins

In this paper, we establish the modified concavity inequality for complex Hessian equations under the semi-convexity assumption inspired by Lu \cite{Lu23} and Zhang \cite{Z24} for real case. Then second order estimates for admissible…

Analysis of PDEs · Mathematics 2025-07-21 Xiaojuan Chen , Qiang Tu , Ni Xiang

We design an algorithm which finds an $\epsilon$-approximate stationary point (with $\|\nabla F(x)\|\le \epsilon$) using $O(\epsilon^{-3})$ stochastic gradient and Hessian-vector products, matching guarantees that were previously available…

Machine Learning · Computer Science 2020-06-25 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Ayush Sekhari , Karthik Sridharan

Various tasks in scientific computing can be modeled as an optimization problem on the indefinite Stiefel manifold. We address this using the Riemannian approach, which basically consists of equipping the feasible set with a Riemannian…

Optimization and Control · Mathematics 2026-04-17 Dinh Van Tiep , Duong Thi Viet An , Nguyen Thi Ngoc Oanh , Nguyen Thanh Son

We consider Carleson-Sj\"{o}lin operators on Riemannian manifolds that arise naturally from the study of Bochner-Riesz problems on manifolds. They are special cases of H\"{o}rmander-type oscillatory integral operators. We obtain improved…

Differential Geometry · Mathematics 2024-01-09 Song Dai , Liuwei Gong , Shaoming Guo , Ruixiang Zhang

In this paper, we establish some Strichartz estimates for orthonormal functions and probabilistic convergence of density functions related to compact operators on manifolds. Firstly, we present the suitable bound of $\int_{a\leq|s|\leq…

Probability · Mathematics 2024-11-12 Wei Yan , Jinqiao Duan , Jianhua Huang , Haoyuan Xu , Meihua Yang

In this paper we give new estimates for integrals involving some arithmetic functions defined over prime numbers. The main focus here is on the prime counting function $\pi(x)$ and the Chebyshev $\vartheta$-function. Some of these estimates…

Number Theory · Mathematics 2022-03-18 Christian Axler

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We study function estimation in the empirical Bayes setting for Poisson and normal means. Specifically, given observations $Y_i\sim f(\cdot; \theta_i)$ with latent parameters $\theta_i\sim \pi$, the goal is to estimate…

Statistics Theory · Mathematics 2026-01-27 Benjamin Kang , Yury Polyanskiy , Anzo Teh

In this paper, we prove a finite dimensional approximation scheme for the Wiener measure on closed Riemannian manifolds, establishing a generalization for $L^{1}$-functionals, of the approach followed by Andersson and Driver on [1]. We…

Differential Geometry · Mathematics 2022-01-28 Juan Carlos Sampedro

This paper studies the estimation of smooth functionals $f(\theta)$ of a mean parameter $\theta = \mathbb{E}_P[W]$ for a distribution $P$ on a general Banach space. We propose a cross-fitted estimator based on a single sample splitting and…

Statistics Theory · Mathematics 2026-04-03 Woonyoung Chang , Arun Kumar Kuchibhotla