English
Related papers

Related papers: Stochastic Approximation and Modern Model-Based De…

200 papers

Giving a convincing experimental evidence of the quantum supremacy over classical simulations is a challenging goal. Noise is considered to be the main problem in such a demonstration, hence it is urgent to understand the effect of noise.…

Quantum Physics · Physics 2022-03-08 Valery Shchesnovich

Two-time-scale stochastic approximation, a generalized version of the popular stochastic approximation, has found broad applications in many areas including stochastic control, optimization, and machine learning. Despite its popularity,…

Optimization and Control · Mathematics 2021-03-24 Thinh T. Doan

Our study focuses on fractional order compartment models derived from underlying physical stochastic processes, providing a more physically grounded approach compared to models that use the dynamical system approach by simply replacing…

Stochastic optimization has found wide applications in minimizing objective functions in machine learning, which motivates a lot of theoretical studies to understand its practical success. Most of existing studies focus on the convergence…

Artificial Intelligence · Computer Science 2023-07-19 Yunwen Lei

Low-rank approximation is a fundamental technique in modern data analysis, widely utilized across various fields such as signal processing, machine learning, and natural language processing. Despite its ubiquity, the mechanics of low-rank…

Machine Learning · Computer Science 2024-08-13 Jun Lu

Estimating the empirical distribution of a scalar-valued data set is a basic and fundamental task. In this paper, we tackle the problem of estimating an empirical distribution in a setting with two challenging features. First, the algorithm…

Machine Learning · Computer Science 2023-01-16 Princewill Okoroafor , Vaishnavi Gupta , Robert Kleinberg , Eleanor Goh

Optimization problems with stochastic dominance constraints provide a possibility to shape risk by selecting a benchmark random outcome with a desired distribution. The comparison of the relevant random outcomes to the respective benchmarks…

Optimization and Control · Mathematics 2025-09-09 Darinka Dentcheva , Yunxuan Yi

In this work, multiplicative stochasticity is applied to the learning rate of stochastic optimization algorithms, giving rise to stochastic learning-rate schemes. In-expectation theoretical convergence results of Stochastic Gradient Descent…

Optimization and Control · Mathematics 2022-03-22 Theodoros Mamalis , Dusan Stipanovic , Petros Voulgaris

Causal inference methods are widely applied in various decision-making domains such as precision medicine, optimal policy and economics. Central to causal inference is the treatment effect estimation of intervention strategies, such as…

Artificial Intelligence · Computer Science 2021-05-31 Tri Dung Duong , Qian Li , Guandong Xu

The Robbins-Monro algorithm is a recursive, simulation-based stochastic procedure to approximate the zeros of a function that can be written as an expectation. It is known that under some technical assumptions, a Gaussian convergence can be…

Probability · Mathematics 2025-10-17 Lorick Huang , V Konakov

Randomization is a common technique used in clinical trials to eliminate potential bias and confounders in a patient population. Equal allocation to treatment groups is the standard due to its optimal efficiency in many cases. However, in…

Applications · Statistics 2020-04-09 Thevaa Chandereng , Xiaodan Wei , Rick Chappell

In recent years dynamical systems (of deterministic and stochastic nature), describing many models in mathematics, physics, engineering and finances, become more and more complex. Numerical analysis narrowed only to deterministic algorithms…

Numerical Analysis · Mathematics 2024-02-13 Paweł Przybyłowicz

Risk management often plays an important role in decision making under uncertainty. In quantitative risk management, assessing and optimizing risk metrics requires efficient computing techniques and reliable theoretical guarantees. In this…

Optimization and Control · Mathematics 2026-01-01 Zhaolin Hu

The approximation ratio has become one of the dominant measures in mechanism design problems. In light of analysis of algorithms, we define the \emph{smoothed approximation ratio} to compare the performance of the optimal mechanism and a…

Computer Science and Game Theory · Computer Science 2017-06-23 Xiaotie Deng , Yansong Gao , Jie Zhang

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

Machine Learning · Computer Science 2025-11-21 Ethan Blaser , Shangtong Zhang

Phase I early-phase clinical studies aim at investigating the safety and the underlying dose-toxicity relationship of a drug or combination. While little may still be known about the compound's properties, it is crucial to consider…

Methodology · Statistics 2022-09-13 Christian Röver , Moreno Ursino , Tim Friede , Sarah Zohar

We propose a new method to improve the convergence speed of the Robbins-Monro algorithm by introducing prior information about the target point into the Robbins-Monro iteration. We achieve the incorporation of prior information without the…

Machine Learning · Computer Science 2024-01-09 Siwei Liu , Ke Ma , Stephan M. Goetz

Radiotherapy is sensitive to executional and preparational uncertainties that propagate to uncertainty in dose and plan quality indicators like dose-volume histograms (DVHs). Current approaches to quantify and mitigate such uncertainties…

Medical Physics · Physics 2020-10-27 Niklas Wahl , Philipp Hennig , Hans-Peter Wieser , Mark Bangert

Phase I dose-finding studies aim at identifying the maximal tolerated dose (MTD). It is not uncommon that several dose-finding studies are conducted, although often with some variation in the administration mode or dose panel. For instance,…

Quantitative Methods · Quantitative Biology 2021-03-24 Moreno Ursino , Christian Röver , Sarah Zohar , Tim Friede

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond