中文
相关论文

相关论文: Optimal rates and adaptation in the single-index m…

200 篇论文

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

最优化与控制 · 数学 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

We propose a method called ideal regression for approximating an arbitrary system of polynomial equations by a system of a particular type. Using techniques from approximate computational algebraic geometry, we show how we can solve ideal…

Gradient methods are widely used in optimization problems. In practice, while the smoothness parameter can be estimated utilizing techniques such as backtracking, estimating the strong convexity parameter remains a challenge; moreover, even…

最优化与控制 · 数学 2026-02-17 Xiaozhe Hu , Sara Pollock , Zhongqin Xue , Yunrong Zhu

Contextual bandits are a central framework for sequential decision-making, with applications ranging from recommendation systems to clinical trials. While nonparametric methods can flexibly model complex reward structures, they suffer from…

统计理论 · 数学 2026-01-01 Wanteng Ma , T. Tony Cai

We establish the optimal nonergodic sublinear convergence rate of the proximal point algorithm for maximal monotone inclusion problems. First, the optimal bound is formulated by the performance estimation framework, resulting in an infinite…

最优化与控制 · 数学 2019-07-15 Guoyong Gu , Junfeng Yang

This paper presents a novel Differential Evolution algorithm for protein folding optimization that is applied to a three-dimensional AB off-lattice model. The proposed algorithm includes two new mechanisms. A local search is used to improve…

人工智能 · 计算机科学 2018-05-08 Borko Bošković , Janez Brest

We focus on the problem of minimizing the sum of smooth component functions (where the sum is strongly convex) and a non-smooth convex function, which arises in regularized empirical risk minimization in machine learning and distributed…

最优化与控制 · 数学 2016-08-08 Nuri Denizcan Vanli , Mert Gurbuzbalaban , Asu Ozdaglar

We study mixed models with a single grouping factor, where inference about unknown parameters requires optimizing a marginal likelihood defined by an intractable integral. Low-dimensional numerical integration techniques are regularly used…

统计方法学 · 统计学 2025-01-22 Alex Stringer , Blair Bilodeau , Yanbo Tang

The active regression problem of the single-index model is to solve $\min_x \lVert f(Ax)-b\rVert_p$, where $A$ is fully accessible and $b$ can only be accessed via entry queries, with the goal of minimizing the number of queries to the…

数据结构与算法 · 计算机科学 2025-02-26 Yi Li , Wai Ming Tai

We propose a rate optimal estimator for the linear regression model on network data with interacted (unobservable) individual effects. The estimator achieves a faster rate of convergence $N$ compared to the standard estimators' $\sqrt{N}$…

计量经济学 · 经济学 2023-04-26 Yassine Sbai Sassi

We consider a recursive algorithm to construct an aggregated estimator from a finite number of base decision rules in the classification problem. The estimator approximately minimizes a convex risk functional under the l1-constraint. It is…

统计理论 · 数学 2007-06-13 Anatoli Juditsky , Alexander Nazin , Alexandre Tsybakov , Nicolas Vayatis

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

统计理论 · 数学 2013-02-14 T. Tony Cai , Harrison H. Zhou

We study convergence rates of the classic proximal bundle method for a variety of nonsmooth convex optimization problems. We show that, without any modification, this algorithm adapts to converge faster in the presence of smoothness or a…

最优化与控制 · 数学 2023-05-03 Mateo Díaz , Benjamin Grimmer

Individualized treatment rules aim to identify if, when, which, and to whom treatment should be applied. A globally aging population, rising healthcare costs, and increased access to patient-level data have created an urgent need for…

统计方法学 · 统计学 2019-01-04 Ying-Qi Zhao , Eric B. Laber , Yang Ning , Sumona Saha , Bruce Sands

We consider the distributed optimization problem for the sum of convex functions where the underlying communications network connecting agents at each time is drawn at random from a collection of directed graphs. Building on an earlier work…

最优化与控制 · 数学 2020-09-16 Pouya Rezaeinia , Bahman Gharesifard

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

最优化与控制 · 数学 2026-03-10 Mickael Binois , Jeffrey Larson

We consider adaptive estimation and statistical inference for high-dimensional graph-based linear models. In our model, the coordinates of regression coefficients correspond to an underlying undirected graph. Furthermore, the given graph…

统计理论 · 数学 2020-01-30 Duzhe Wang , Po-Ling Loh

This paper investigates the large sample properties of local regression distribution estimators, which include a class of boundary adaptive density estimators as a prime example. First, we establish a pointwise Gaussian large sample…

计量经济学 · 经济学 2021-01-29 Matias D. Cattaneo , Michael Jansson , Xinwei Ma

We propose a new subgradient method for the minimization of nonsmooth convex functions over a convex set. To speed up computations we use adaptive approximate projections only requiring to move within a certain distance of the exact…

最优化与控制 · 数学 2015-03-19 Dirk A. Lorenz , Marc E. Pfetsch , Andreas M. Tillmann

We consider the model of nonregular nonparametric regression where smoothness constraints are imposed on the regression function $f$ and the regression errors are assumed to decay with some sharpness level at their endpoints. The aim of…

统计理论 · 数学 2014-10-02 Moritz Jirak , Alexander Meister , Markus Reiß