English
Related papers

Related papers: CVXSADes: a stochastic algorithm for constructing …

200 papers

A simple yet efficient computational algorithm for computing the continuous optimal experimental design for linear models is proposed. An alternative proof the monotonic convergence for $D$-optimal criterion on continuous design spaces are…

Computation · Statistics 2018-04-10 Jiangtao Duan , Wei Gao , Hon Keung Tony Ng

Software methods introduced for automated design of approximate implementations of arithmetic circuits rely on fast and accurate evaluation of approximate candidate implementations. To accelerate the evaluation of circuit error, we propose…

Hardware Architecture · Computer Science 2022-08-29 Vojtech Mrazek

We study the Regularized A-optimal Design (RAOD) problem, which selects a subset of $k$ experiments to minimize the inverse of the Fisher information matrix, regularized with a scaled identity matrix. RAOD has broad applications in Bayesian…

Optimization and Control · Mathematics 2025-05-22 Yongchun Li

Stochastic process models are now commonly used to analyse complex biological, ecological and industrial systems. Increasingly there is a need to deliver accurate estimates of model parameters and assess model fit by optimizing the timing…

Computation · Statistics 2018-09-18 Colin S. Gillespie , Richard J. Boys

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

It is generally believed that ensemble approaches, which combine multiple algorithms or models, can outperform any single algorithm at machine learning tasks, such as prediction. In this paper, we propose Bayesian convex and linear…

Statistics Theory · Mathematics 2014-03-07 Yun Yang , David B. Dunson

We consider optimal experimental design (OED) for nonlinear inverse problems within the Bayesian framework. Optimizing the data acquisition process for large-scale nonlinear Bayesian inverse problems is a computationally challenging task…

Numerical Analysis · Mathematics 2024-05-14 Karina Koval , Ruanui Nicholson

We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the…

Computation · Statistics 2014-05-29 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

Distributed stochastic optimization algorithms can simultaneously process large-scale datasets, significantly accelerating model training. However, their effectiveness is often hindered by the sparsity of distributed networks and data…

Machine Learning · Computer Science 2025-02-14 Yuchen Hu , Xi Chen , Weidong Liu , Xiaojun Mao

Modern advanced manufacturing and advanced materials design often require searches of relatively high-dimensional process control parameter spaces for settings that result in optimal structure, property, and performance parameters. The…

Machine Learning · Computer Science 2024-07-25 Carlo Graziani , Marieme Ngom

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

In this paper, we consider multi-stage stochastic optimization problems with convex objectives and conic constraints at each stage. We present a new stochastic first-order method, namely the dynamic stochastic approximation (DSA) algorithm,…

Optimization and Control · Mathematics 2019-08-22 Guanghui Lan , Zhiqiang Zhou

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

We present a novel stochastic approach to binary optimization for optimal experimental design (OED) for Bayesian inverse problems governed by mathematical models such as partial differential equations. The OED utility function, namely, the…

Optimization and Control · Mathematics 2022-06-28 Ahmed Attia , Sven Leyffer , Todd Munson

We address the problem of optimal experimental design (OED) for Bayesian nonlinear inverse problems governed by PDEs. The goal is to find a placement of sensors, at which experimental data are collected, so as to minimize the uncertainty in…

Optimization and Control · Mathematics 2015-11-04 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

The generation of decision-theoretic Bayesian optimal designs is complicated by the significant computational challenge of minimising an analytically intractable expected loss function over a, potentially, high-dimensional design space. A…

Methodology · Statistics 2017-02-07 Antony M. Overstall , James M. McGree , Christopher C. Drovandi

In this paper, we consider two sequential decision making problems with a convexity structure, namely an energy storage optimization task and a multi-product assembly example. We formulate these problems in the stochastic programming…

Optimization and Control · Mathematics 2016-09-22 Gábor Balázs , András György , Csaba Szepesvári

We consider stochastic strongly convex optimization with a complex inequality constraint. This complex inequality constraint may lead to computationally expensive projections in algorithmic iterations of the stochastic gradient…

Machine Learning · Computer Science 2016-05-25 Jianhui Chen , Tianbao Yang , Qihang Lin , Lijun Zhang , Yi Chang

An emulator is a fast-to-evaluate statistical approximation of a detailed mathematical model (simulator). When used in lieu of simulators, emulators can expedite tasks that require many repeated evaluations, such as sensitivity analyses,…

This paper considers the stochastic convex composite optimization problem and presents multi-cut stochastic approximation (SA) methods for solving it, whose models in expectation overestimate its objective function. The multi-cut model…

Optimization and Control · Mathematics 2026-03-03 Jiaming Liang , Renato D. C. Monteiro , Honghao Zhang