English
Related papers

Related papers: Estimation and Inference by Stochastic Optimizatio…

200 papers

We consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling…

Optimization and Control · Mathematics 2021-09-28 Raghu Bollapragada , Stefan M. Wild

This work develops a new method for estimating and optimizing the directed information rate between two jointly stationary and ergodic stochastic processes. Building upon recent advances in machine learning, we propose a recurrent neural…

Information Theory · Computer Science 2022-03-29 Dor Tsur , Ziv Aharoni , Ziv Goldfeld , Haim Permuter

We investigate the validity of two resampling techniques when carrying out inference on the underlying unknown copula using a recently proposed class of smooth, possibly data-adaptive nonparametric estimators that contains empirical…

Statistics Theory · Mathematics 2023-01-16 Ivan Kojadinovic , Bingqing Yi

Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the quality of the…

Numerical Analysis · Mathematics 2024-10-03 Ethan N. Epperly , Joel A. Tropp

Motivated by applications arising from large scale optimization and machine learning, we consider stochastic quasi-Newton (SQN) methods for solving unconstrained convex optimization problems. The convergence analysis of the SQN methods,…

Optimization and Control · Mathematics 2019-10-02 Farzad Yousefian , Angelia Nedić , Uday Shanbhag

In this paper we address the problem of performing statistical inference for large scale data sets i.e., Big Data. The volume and dimensionality of the data may be so high that it cannot be processed or stored in a single computing node. We…

Methodology · Statistics 2016-04-20 Shahab Basiri , Esa Ollila , Visa Koivunen

Faced with massive data, subsampling is a commonly used technique to improve computational efficiency, and using nonuniform subsampling probabilities is an effective approach to improve estimation efficiency. For computational efficiency,…

Statistics Theory · Mathematics 2022-05-19 Jing Wang , Jiahui Zou , HaiYing Wang

Uncertainty quantification is crucial for building reliable and trustable machine learning systems. We propose to estimate uncertainty in recurrent neural networks (RNNs) via stochastic discrete state transitions over recurrent timesteps.…

Machine Learning · Computer Science 2020-11-25 Cheng Wang , Carolin Lawrence , Mathias Niepert

We present two sampled quasi-Newton methods (sampled LBFGS and sampled LSR1) for solving empirical risk minimization problems that arise in machine learning. Contrary to the classical variants of these methods that sequentially build…

Optimization and Control · Mathematics 2021-07-29 Albert S. Berahas , Majid Jahani , Peter Richtárik , Martin Takáč

We consider a resampling scheme for parameters estimates in nonlinear regression models. We provide an estimation procedure which recycles, via random weighting, the relevant parameters estimates to construct consistent estimates of the…

Methodology · Statistics 2018-12-18 Ben Boukai , Yue Zhang

Constrained stochastic nonlinear optimization problems have attracted significant attention for their ability to model complex real-world scenarios in physics, economics, and biology. As datasets continue to grow, online inference methods…

Machine Learning · Statistics 2025-05-27 Xinchen Du , Wanrong Zhu , Wei Biao Wu , Sen Na

Stochastic optimisation in Riemannian manifolds, especially the Riemannian stochastic gradient method, has attracted much recent attention. The present work applies stochastic optimisation to the task of recursive estimation of a…

Statistics Theory · Mathematics 2020-01-08 Jialun Zhou , Salem Said

In this paper, we propose new methods to efficiently solve convex optimization problems encountered in sparse estimation, which include a new quasi-Newton method that avoids computing the Hessian matrix and improves efficiency, and we prove…

Optimization and Control · Mathematics 2023-09-06 Ryosuke Shimmura , Joe Suzuki

We present a quasi-Newton method for unconstrained stochastic optimization. Most existing literature on this topic assumes a setting of stochastic optimization in which a finite sum of component functions is a reasonable approximation of an…

Optimization and Control · Mathematics 2024-09-04 Matt Menickelly , Stefan M. Wild , Miaolan Xie

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi- Newton updating techniques for deterministic optimization leads to noisy curvature…

Optimization and Control · Mathematics 2015-02-19 R. H. Byrd , S. L. Hansen , J. Nocedal , Y. Singer

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

In stochastic simulation, input uncertainty refers to the output variability arising from the statistical noise in specifying the input models. This uncertainty can be measured by a variance contribution in the output, which, in the…

Methodology · Statistics 2021-05-20 Henry Lam , Huajie Qian

We present novel algorithms for simulation optimization using random directions stochastic approximation (RDSA). These include first-order (gradient) as well as second-order (Newton) schemes. We incorporate both continuous-valued as well as…

Optimization and Control · Mathematics 2015-08-11 Prashanth L. A. , Shalabh Bhatnagar , Michael Fu , Steve Marcus

The work is devoted to the analysis of the Resampling method proposed by A. Andronov and to the analysis of the Resampling method application possibility to the estimation and simulation of the calculation and logical systems reliability.…

Applications · Statistics 2013-04-25 Maxim Fioshin