English
Related papers

Related papers: New Algorithms And Fast Implementations To Approxi…

200 papers

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

Our study focuses on fractional order compartment models derived from underlying physical stochastic processes, providing a more physically grounded approach compared to models that use the dynamical system approach by simply replacing…

The simplest, and most common, stochastic model for population processes, including those from biochemistry and cell biology, are continuous time Markov chains. Simulation of such models is often relatively straightforward as there are…

Probability · Mathematics 2012-03-01 David F. Anderson , Masanori Koyama

We survey key techniques and results from approximation theory in the context of uniform approximations to real functions such as e^{-x}, 1/x, and x^k. We then present a selection of results demonstrating how such approximations can be used…

Data Structures and Algorithms · Computer Science 2013-09-20 Sushant Sachdeva , Nisheeth Vishnoi

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

We consider a stationary process (with either discrete or continuous time) and find an adaptive approximating stationary process combining approximation quality and supplementary good properties that can be interpreted as additional…

Probability · Mathematics 2020-02-19 Zakhar Kabluchko , Mikhail Lifshits

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

This paper discusses new simulation algorithms for stochastic chemical kinetics that exploit the linearity of the chemical master equation and its matrix exponential exact solution. These algorithms make use of various approximations of the…

Numerical Analysis · Computer Science 2016-09-08 Azam S. Zavar Moosavi , Adrian Sandu

Max-stable processes play an important role as models for spatial extreme events. Their complex structure as the pointwise maximum over an infinite number of random functions makes simulation highly nontrivial. Algorithms based on finite…

Methodology · Statistics 2015-06-16 Clément Dombry , Sebastian Engelke , Marco Oesting

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonconvex part is smooth and the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem…

Optimization and Control · Mathematics 2016-05-24 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

This paper formed part of a preliminary research report for a risk consultancy and academic research. Stochastic Programming models provide a powerful paradigm for decision making under uncertainty. In these models the uncertainties are…

Computational Finance · Quantitative Finance 2009-04-08 Sovan Mitra

Stochastic processes defined on integer valued state spaces are popular within the physical and biological sciences. These models are necessary for capturing the dynamics of small systems where the individual nature of the populations…

Machine Learning · Statistics 2024-04-15 Luke O'Loughlin , John Maclean , Andrew Black

Continuous time stochastic processes are useful models especially for financial and insurance purposes. The numerical simulation of such models is dependant of the time discrete discretization, of the parametric estimation and of the choice…

Computational Finance · Quantitative Finance 2010-01-13 Frédéric Planchet , Pierre-Emanuel Thérond

Stochastic optimization algorithms have been successfully applied in several domains to find optimal solutions. Because of the ever-growing complexity of the integrated systems, novel stochastic algorithms are being proposed, which makes…

Artificial Intelligence · Computer Science 2024-06-04 Sowmya Chandrasekaran , Thomas Bartz-Beielstein

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

We consider a distributed computing network consisting of a master and multiple workers processing tasks of different types. The master is running multiple applications. Each application stochastically generates real-time jobs with a strict…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-31 Yu-Pin Hsu , Yu-Chih Huang , Shin-Lin Shieh

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…