English
Related papers

Related papers: Solving Dynamic Discrete Choice Models Using Smoot…

200 papers

We consider a simple approach to solving assortment optimization under the random utility maximization model. The approach uses Monte-Carlo simulation to construct a ranking-based choice model that serves as a proxy for the true choice…

Optimization and Control · Mathematics 2025-10-02 Hassaan Khalid , Bradley Sturt

Designing efficient learning algorithms with complexity guarantees for Markov decision processes (MDPs) with large or continuous state and action spaces remains a fundamental challenge. We address this challenge for entropy-regularized MDPs…

Machine Learning · Computer Science 2025-06-05 Matthieu Meunier , Christoph Reisinger , Yufei Zhang

Recently proposed adaptive Sketch & Project (SP) methods connect several well-known projection methods such as Randomized Kaczmarz (RK), Randomized Block Kaczmarz (RBK), Motzkin Relaxation (MR), Randomized Coordinate Descent (RCD), Capped…

Numerical Analysis · Mathematics 2020-12-25 Md Sarowar Morshed , Sabbir Ahmad , Md Noor-E-Alam

We propose an adaptive smoothing algorithm based on Nesterov's smoothing technique in \cite{Nesterov2005c} for solving "fully" nonsmooth composite convex optimization problems. Our method combines both Nesterov's accelerated proximal…

Optimization and Control · Mathematics 2016-07-05 Quoc Tran-Dinh

We present an approach to deep estimation of discrete conditional probability distributions. Such models have several applications, including generative modeling of audio, image, and video data. Our approach combines two main techniques:…

Machine Learning · Statistics 2017-03-01 Wesley Tansey , Karl Pichotta , James G. Scott

The analysis of high-dimensional dynamical systems generally requires the integration of simulation data with experimental measurements. Experimental data often has substantial amounts of measurement noise that compromises the ability to…

Numerical Analysis · Mathematics 2019-10-02 Samuel Rudy , Steven Brunton , J. Nathan Kutz

Inverse problems in scientific computing often require optimization over infinite-dimensional Hilbert spaces. A commonly used solver in such settings is stochastic gradient descent (SGD), where gradients are approximated using randomly…

Optimization and Control · Mathematics 2026-04-14 Sandra Cerrai , Qin Li , Anjali Nair , Jaeyoung Yoon

We introduce a lattice random walk discretisation scheme for stochastic differential equations (SDEs) that samples binary or ternary increments at each step, suppressing complex drift and diffusion computations to simple 1 or 2 bit random…

Numerical Analysis · Mathematics 2026-02-18 Samuel Duffield , Maxwell Aifer , Denis Melanson , Zach Belateche , Patrick J. Coles

Stochastic differential equations (SDEs) or diffusions are continuous-valued continuous-time stochastic processes widely used in the applied and mathematical sciences. Simulating paths from these processes is usually an intractable problem,…

Computation · Statistics 2020-05-27 Qi Wang , Vinayak Rao , Yee Whye Teh

The Discrete Ordinates Method (DOM) is widely used for velocity discretization in radiative transport simulations. However, DOM tends to exhibit the ray effect when the velocity discretization is not sufficiently refined, a limitation that…

Numerical Analysis · Mathematics 2025-10-07 Lei Li , Min Tang , Yuqi Yang

The moments of spatial probabilistic systems are often given by an infinite hierarchy of coupled differential equations. Moment closure methods are used to approximate a subset of low order moments by terminating the hierarchy at some order…

Machine Learning · Computer Science 2019-05-30 Oliver K. Ernst , Tom Bartol , Terrence Sejnowski , Eric Mjolsness

Asymptotic error distribution for approximation of a stochastic integral with respect to continuous semimartingale by Riemann sum with general stochastic partition is studied. Effective discretization schemes of which asymptotic conditional…

Probability · Mathematics 2010-04-14 Masaaki Fukasawa

Random smoothing data augmentation is a unique form of regularization that can prevent overfitting by introducing noise to the input data, encouraging the model to learn more generalized features. Despite its success in various…

Machine Learning · Statistics 2023-05-15 Liang Ding , Tianyang Hu , Jiahang Jiang , Donghao Li , Wenjia Wang , Yuan Yao

This paper introduces a drift optimization model of stochastic optimization problems driven by regulated stochastic processes. A broad range of problems across operations research, machine learning, and statistics can be viewed as…

Optimization and Control · Mathematics 2025-06-10 Zihe Zhou , Harsha Honnappa , Raghu Pasupathy

A new sampling methodology based on incomplete cosine expansion series is presented as an alternative to the traditional sinc function approach. Numerical integration shows that this methodology is efficient and practical. Applying the…

Numerical Analysis · Mathematics 2015-03-24 S. M. Abrarov , B. M. Quine

We propose dynamic sampled stochastic approximation (SA) methods for stochastic optimization with a heavy-tailed distribution (with finite 2nd moment). The objective is the sum of a smooth convex function with a convex regularizer.…

Optimization and Control · Mathematics 2017-05-26 Alejandro Jofré , Philip Thompson

We propose a novel study of the stochastic proximal gradient method for minimizing the sum of two convex functions, one of which is smooth. Under suitable assumptions and without requiring any boundedness or control of the variance of the…

Optimization and Control · Mathematics 2026-04-16 Javier I. Madariaga

In this paper, we investigate the problem of strong approximation of the solutions of stochastic differential equations (SDEs) when the drift coefficient is given in integral form. We investigate its upper error bounds, in terms of the…

Numerical Analysis · Mathematics 2025-11-20 Paweł Przybyłowicz , Michał Sobieraj

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev

Dynamic Programming (DP) suffers from the well-known ``curse of dimensionality'', further exacerbated by the need to compute expectations over process noise in stochastic models. This paper presents a Monte Carlo-based sampling approach for…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Mohammad S. Ramadan , Ahmad Al-Tawaha , Mohamed Shouman , Ahmed Atallah , Ming Jin