中文
相关论文

相关论文: On Sharp Stochastic Zeroth Order Hessian Estimator…

200 篇论文

We consider entanglement-assisted frequency estimation by Ramsey interferometry, in the presence of dephasing noise from spatiotemporally correlated environments.By working in the widely employed local estimation regime, we show that even…

量子物理 · 物理学 2023-09-20 Francisco Riberi , Gerardo Paz-Silva , Lorenza Viola

First-order optimization algorithms can be considered as a discretization of ordinary differential equations (ODEs) \cite{su2014differential}. In this perspective, studying the properties of the corresponding trajectories may lead to…

We introduce a hybrid stochastic estimator to design stochastic gradient algorithms for solving stochastic optimization problems. Such a hybrid estimator is a convex combination of two existing biased and unbiased estimators and leads to…

最优化与控制 · 数学 2019-05-16 Quoc Tran-Dinh , Nhan H. Pham , Dzung T. Phan , Lam M. Nguyen

We show how to control the bias of a sieve type profile estimator under natural conditions on the Hessian of the expected contrast functional.

统计理论 · 数学 2014-06-18 Andreas Andresen

We will propose a new algorithm for finding critical points of cost functions defined on a differential manifold. We will lift the initial cost function to a manifold that can be embedded in a Riemannian manifold (Euclidean space) and will…

最优化与控制 · 数学 2018-09-05 Petre Birtea , Dan Comănescu , Călin-Adrian Popa

Optimization of convex functions under stochastic zeroth-order feedback has been a major and challenging question in online learning. In this work, we consider the problem of optimizing second-order smooth and strongly convex functions…

机器学习 · 计算机科学 2024-07-01 Qian Yu , Yining Wang , Baihe Huang , Qi Lei , Jason D. Lee

In this paper, we derive an \emph{a priori} second order estimate for solutions which are in $\Gamma_{k+1}$ cone to a class of complex Hessian equations with both sides of the equation depending on the gradient on compact Hermitian…

偏微分方程分析 · 数学 2021-05-25 Weisong Dong

In this paper, we give explicit descriptions of versions of (Local-) Backtracking Gradient Descent and New Q-Newton's method to the Riemannian setting.Here are some easy to state consequences of results in this paper, where X is a general…

最优化与控制 · 数学 2020-09-01 Tuyen Trung Truong

In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and…

最优化与控制 · 数学 2024-02-06 Fangzhao Zhang , Mert Pilanci

Robins et al. (2008, 2017) applied the theory of higher order influence functions (HOIFs) to derive an estimator of the mean $\psi$ of an outcome Y in a missing data model with Y missing at random conditional on a vector X of continuous…

统计理论 · 数学 2026-01-27 Lin Liu , Rajarshi Mukherjee , Whitney K. Newey , James M. Robins

In this paper, we establish the modified concavity inequality for complex Hessian equations under the semi-convexity assumption inspired by Lu \cite{Lu23} and Zhang \cite{Z24} for real case. Then second order estimates for admissible…

偏微分方程分析 · 数学 2025-07-21 Xiaojuan Chen , Qiang Tu , Ni Xiang

We design an algorithm which finds an $\epsilon$-approximate stationary point (with $\|\nabla F(x)\|\le \epsilon$) using $O(\epsilon^{-3})$ stochastic gradient and Hessian-vector products, matching guarantees that were previously available…

机器学习 · 计算机科学 2020-06-25 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Ayush Sekhari , Karthik Sridharan

Various tasks in scientific computing can be modeled as an optimization problem on the indefinite Stiefel manifold. We address this using the Riemannian approach, which basically consists of equipping the feasible set with a Riemannian…

最优化与控制 · 数学 2026-04-17 Dinh Van Tiep , Duong Thi Viet An , Nguyen Thi Ngoc Oanh , Nguyen Thanh Son

We consider Carleson-Sj\"{o}lin operators on Riemannian manifolds that arise naturally from the study of Bochner-Riesz problems on manifolds. They are special cases of H\"{o}rmander-type oscillatory integral operators. We obtain improved…

微分几何 · 数学 2024-01-09 Song Dai , Liuwei Gong , Shaoming Guo , Ruixiang Zhang

In this paper, we establish some Strichartz estimates for orthonormal functions and probabilistic convergence of density functions related to compact operators on manifolds. Firstly, we present the suitable bound of $\int_{a\leq|s|\leq…

概率论 · 数学 2024-11-12 Wei Yan , Jinqiao Duan , Jianhua Huang , Haoyuan Xu , Meihua Yang

In this paper we give new estimates for integrals involving some arithmetic functions defined over prime numbers. The main focus here is on the prime counting function $\pi(x)$ and the Chebyshev $\vartheta$-function. Some of these estimates…

数论 · 数学 2022-03-18 Christian Axler

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

统计方法学 · 统计学 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We study function estimation in the empirical Bayes setting for Poisson and normal means. Specifically, given observations $Y_i\sim f(\cdot; \theta_i)$ with latent parameters $\theta_i\sim \pi$, the goal is to estimate…

统计理论 · 数学 2026-01-27 Benjamin Kang , Yury Polyanskiy , Anzo Teh

In this paper, we prove a finite dimensional approximation scheme for the Wiener measure on closed Riemannian manifolds, establishing a generalization for $L^{1}$-functionals, of the approach followed by Andersson and Driver on [1]. We…

微分几何 · 数学 2022-01-28 Juan Carlos Sampedro

This paper studies the estimation of smooth functionals $f(\theta)$ of a mean parameter $\theta = \mathbb{E}_P[W]$ for a distribution $P$ on a general Banach space. We propose a cross-fitted estimator based on a single sample splitting and…

统计理论 · 数学 2026-04-03 Woonyoung Chang , Arun Kumar Kuchibhotla