English
Related papers

Related papers: Symmetric confidence regions and confidence interv…

200 papers

This paper considers variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions and provides three stochastic approximation schemes to solve them. All methods use an empirical estimate of the CVaR…

Optimization and Control · Mathematics 2022-11-16 Jasper Verbree , Ashish Cherukuri

The sample average approximation (SAA) approach is applied to risk-neutral optimization problems governed by semilinear elliptic partial differential equations with random inputs. After constructing a compact set that contains the SAA…

Optimization and Control · Mathematics 2024-02-28 Johannes Milz , Michael Ulbrich

Stochastic variational inference (SVI) lets us scale up Bayesian computation to massive data. It uses stochastic optimization to fit a variational distribution, following easy-to-compute noisy natural gradients. As with most traditional…

Machine Learning · Statistics 2014-11-19 Stephan Mandt , David Blei

Local solutions for variational and quasi-variational inequalities are usually the best type of solutions that could practically be obtained when in case of lack of convexity or else when available numerical techniques are too limited for…

Optimization and Control · Mathematics 2024-05-16 Didier Aussel , Parin Chaipunya

In this work, we conduct a systematic study of stochastic saddle point problems (SSP) and stochastic variational inequalities (SVI) under the constraint of $(\epsilon,\delta)$-differential privacy (DP) in both Euclidean and non-Euclidean…

Machine Learning · Computer Science 2024-11-11 Raef Bassily , Cristóbal Guzmán , Michael Menart

This paper is a study on solutions of the Sample Average Approximation Method to solve compound stochastic programs. We derive nonasymptotic upper estimates for probabilities of the approximation errors. The results depend on the sample…

Optimization and Control · Mathematics 2025-08-29 Volker Kratschmer

Estimating associations between spatial covariates and responses - rather than merely predicting responses - is central to environmental science, epidemiology, and economics. For instance, public health officials might be interested in…

Machine Learning · Statistics 2025-11-11 David R. Burt , Renato Berlinghieri , Stephen Bates , Tamara Broderick

We investigate the feasibility of sample average approximation (SAA) for general stochastic optimization problems, including two-stage stochastic programming without the relatively complete recourse assumption. Instead of analyzing problems…

Optimization and Control · Mathematics 2022-02-22 Henry Lam , Fengpei Li

We study the sample complexity of the Sign-Perturbed Sums (SPS) method, which constructs exact, non-asymptotic confidence regions for the true system parameters under mild statistical assumptions, such as independent and symmetric noise…

Machine Learning · Statistics 2024-09-04 Szabolcs Szentpéteri , Balázs Csanád Csáji

While Variational Inequality (VI) is a well-established mathematical framework that subsumes Nash equilibrium and saddle-point problems, less is known about its extension, Quasi-Variational Inequalities (QVI). QVI allows for cases where the…

Optimization and Control · Mathematics 2025-11-25 Zeinab Alizadeh , Afrooz Jalilzadeh

This paper is focused on a stochastic quasi-variational inequality (SQVI) problem with a continuous and strongly-monotone mapping over a closed and convex set where the projection onto the constraint set may not be easy to compute. We…

Optimization and Control · Mathematics 2022-09-02 Zeinab Alizadeh , Brianna M. Otero , Afrooz Jalilzadeh

We consider a stochastic variational inequality (SVI) problem with a continuous and monotone mapping over a closed and convex set. In strongly monotone regimes, we present a variable sample-size averaging scheme (VS-Ave) that achieves a…

Optimization and Control · Mathematics 2019-10-01 Afrooz Jalilzadeh , Uday V. Shanbhag

This paper focuses on the solvability of multistage pseudomonotone stochastic variational inequalities (SVIs). On one hand, some known solvability results of pseudomonotone deterministic variational inequalities cannot be directly extended…

Optimization and Control · Mathematics 2022-01-06 Xingbang Cui , Jie Sun , Liping Zhang

In this work, we conduct the first systematic study of stochastic variational inequality (SVI) and stochastic saddle point (SSP) problems under the constraint of differential privacy (DP). We propose two algorithms: Noisy Stochastic…

Optimization and Control · Mathematics 2022-04-04 Digvijay Boob , Cristóbal Guzmán

Simulation-Based Inference (SBI) is an approach to statistical inference where simulations from an assumed model are used to construct estimators and confidence sets. SBI is often used when the likelihood is intractable and to construct…

Methodology · Statistics 2025-08-05 Lorenzo Tomaselli , Valérie Ventura , Larry Wasserman

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches…

Machine Learning · Statistics 2016-06-29 Alexander Moreno , Tameem Adel , Edward Meeds , James M. Rehg , Max Welling

In this paper we study a class of split variational inclusion (SVI) and regularized split variational inclusion (RSVI) problems in real Hilbert spaces. We discuss various analytical properties of the net generated by the RSVI and establish…

Optimization and Control · Mathematics 2023-10-17 Soumitra Dey , Chinedu Izuchukwu , Adeolu Taiwo , Simeon Reich

Stochastic variational inference (SVI) employs stochastic optimization to scale up Bayesian computation to massive data. Since SVI is at its core a stochastic gradient-based algorithm, horizontal parallelism can be harnessed to allow larger…

Machine Learning · Statistics 2018-01-16 Saad Mohamad , Abdelhamid Bouchachia , Moamar Sayed-Mouchaweh

Profile likelihood confidence intervals are a robust alternative to Wald's method if the asymptotic properties of the maximum likelihood estimator are not met. However, the constrained optimization problem defining profile likelihood…

Computation · Statistics 2021-05-10 Samuel M. Fischer , Mark A. Lewis

We are concerned with optimization in a broad sense through the lens of solving variational inequalities (VIs) -- a class of problems that are so general that they cover as particular cases minimization of functions, saddle-point (minimax)…

Optimization and Control · Mathematics 2026-02-17 Pavel Dvurechensky , Andrea Ebner , Johannes Carl Schnebel , Shimrit Shtern , Mathias Staudigl