English
Related papers

Related papers: Conditional quantile sequential estimation for sto…

200 papers

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

In this paper, we develop uniform inference methods for the conditional mode based on quantile regression. Specifically, we propose to estimate the conditional mode by minimizing the derivative of the estimated conditional quantile function…

Statistics Theory · Mathematics 2021-04-14 Tao Zhang , Kengo Kato , David Ruppert

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

This paper studies estimation in functional linear quantile regression in which the dependent variable is scalar while the covariate is a function, and the conditional quantile for each fixed quantile index is modeled as a linear functional…

Statistics Theory · Mathematics 2013-02-28 Kengo Kato

Estimation of quantiles is one of the most fundamental real-time analysis tasks. Most real-time data streams vary dynamically with time and incremental quantile estimators document state-of-the art performance to track quantiles of such…

Methodology · Statistics 2019-02-15 Hugo Lewi Hammer , Anis Yazidi , Håvard Rue

We consider stochastic approximation with block-coordinate stepsizes and propose adaptive stepsize rules that aim to minimize the expected distance from the next iterate to an (unknown) target point. These stepsize rules employ online…

Optimization and Control · Mathematics 2025-12-09 Tao Jiang , Lin Xiao

This paper investigates the identification of quantiles and quantile regression parameters when observations are set valued. We define the identification set of quantiles of random sets in a way that extends the definition of quantiles for…

Methodology · Statistics 2020-04-10 Arie Beresteanu , Yuya Sasaki

One of the goals in scaling sequential machine learning methods pertains to dealing with high-dimensional data spaces. A key related challenge is that many methods heavily depend on obtaining the inverse covariance matrix of the data. It is…

Computation · Statistics 2017-07-28 Tomer Lancewicki

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We propose a sequential quadratic programming (SQP) algorithm for inequality constrained optimization that is robust to the presence of bounded noise in function and derivative evaluations. We cover the case where constraint evaluations…

Optimization and Control · Mathematics 2026-04-17 Figen Oztoprak , Richard Byrd

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and…

Machine Learning · Statistics 2024-09-09 Haoyu Jiang , Jason Xu

We present quantum algorithms for the estimation of n-time correlation functions, the local and non-local density of states, and dynamical linear response functions. These algorithms are all based on block-encodings - a versatile technique…

Quantum Physics · Physics 2020-08-19 Patrick Rall

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

Computation · Statistics 2021-12-16 Aden Forrow , Ruth E. Baker

We investigate an empirical quantile estimation approach to solve chance-constrained nonlinear optimization problems. Our approach is based on the reformulation of the chance constraint as an equivalent quantile constraint to provide…

Optimization and Control · Mathematics 2024-10-16 Fengqiao Luo , Jeffrey Larson

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

Let $X\in \mathbb{R}^p$ and $Y\in \mathbb{R}$ be two random variables. We estimate the conditional covariance matrix $\mathrm{Cov}\left(\mathrm{E}\left[\boldsymbol{X}\vert Y\right]\right)$ applying a plug-in kernel-based algorithm to its…

Methodology · Statistics 2018-02-13 Jean-Michel Loubes , Clement Marteau , Maikol Solís

We study k-median clustering under the sequential no-substitution setting. In this setting, a data stream is sequentially observed, and some of the points are selected by the algorithm as cluster centers. However, a point can be selected as…

Machine Learning · Computer Science 2022-04-14 Tom Hess , Michal Moshkovitz , Sivan Sabato

Quantile regression is a method to estimate the quantiles of the conditional distribution of a response variable, and as such it permits a much more accurate portrayal of the relationship between the response variable and observed…

Data Structures and Algorithms · Computer Science 2014-01-08 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

In this work, we study a new recursive stochastic algorithm for the joint estimation of quantile and superquantile of an unknown distribution. The novelty of this algorithm is to use the Cesaro averaging of the quantile estimation inside…

Probability · Mathematics 2021-09-16 Manon Costa , Sébastien Gadat

Quantile regression (QR) is a principal regression method for analyzing the impact of covariates on outcomes. The impact is described by the conditional quantile function and its functionals. In this paper we develop the nonparametric…