English
Related papers

Related papers: Probabilistic analysis of dual decomposition on tw…

200 papers

Binary classification is a common statistical learning problem in which a model is estimated on a set of covariates for some outcome indicating the membership of one of two classes. In the literature, there exists a distinction between hard…

Machine Learning · Statistics 2014-11-20 Patrick K. Kimes , D. Neil Hayes , J. S. Marron , Yufeng Liu

In this work, we design primal and dual bounding methods for multistage adaptive robust optimization (MSARO) problems motivated by two decision rules rooted in the stochastic programming literature. From the primal perspective, this is…

Optimization and Control · Mathematics 2024-09-18 Maryam Daryalal , Ayse N. Arslan , Merve Bodur

In this paper we develop optimal algorithms in the binary-forking model for a variety of fundamental problems, including sorting, semisorting, list ranking, tree contraction, range minima, and ordered set union, intersection and difference.…

Data Structures and Algorithms · Computer Science 2020-06-26 Guy E. Blelloch , Jeremy T. Fineman , Yan Gu , Yihan Sun

We consider a step search method for continuous optimization under a stochastic setting where the function values and gradients are available only through inexact probabilistic zeroth- and first-order oracles. Unlike the stochastic gradient…

Optimization and Control · Mathematics 2023-11-03 Billy Jin , Katya Scheinberg , Miaolan Xie

We study a stochastic first order primal-dual method for solving convex-concave saddle point problems over real reflexive Banach spaces using Bregman divergences and relative smoothness assumptions, in which we allow for stochastic error in…

Optimization and Control · Mathematics 2021-12-23 Antonio Silveti-Falls , Cesare Molinari , Jalal Fadili

We introduce a prime number generator in the form of a stochastic algorithm. The character of such algorithm gives rise to a continuous phase transition which distinguishes a phase where the algorithm is able to reduce the whole system of…

Computational Complexity · Computer Science 2009-11-13 Lucas Lacasa , Bartolo Luque , Octavio Miramontes

We consider a multi-objective risk-averse two-stage stochastic programming problem with a multivariate convex risk measure. We suggest a convex vector optimization formulation with set-valued constraints and propose an extended version of…

Optimization and Control · Mathematics 2017-11-20 Çağın Ararat , Özlem Çavuş , Ali İrfan Mahmutoğulları

It seems that in the current age, computers, computation, and data have an increasingly important role to play in scientific research and discovery. This is reflected in part by the rise of machine learning and artificial intelligence,…

Machine Learning · Computer Science 2024-05-15 Ronan Keane

Outer-approximation-based branch-and-bound is a common algorithmic framework for solving MINLPs (mixed-integer nonlinear programs) to global optimality, with branching variable selection critically influencing overall performance. In modern…

Optimization and Control · Mathematics 2026-02-12 Timo Berthold , Fritz Geis

In dual decomposition, the dual to an optimization problem with a specific structure is solved in distributed fashion using (sub)gradient and recently also fast gradient methods. The traditional dual decomposition suffers from two main…

Optimization and Control · Mathematics 2014-04-08 Pontus Giselsson

From an optimizer's perspective, achieving the global optimum for a general nonconvex problem is often provably NP-hard using the classical worst-case analysis. In the case of Cox's proportional hazards model, by taking its statistical…

Statistics Theory · Mathematics 2021-07-07 Jianqing Fan , Wenyan Gong , Qiang Sun

We improve the scalability of Branch and Bound (BaB) algorithms for formally proving input-output properties of neural networks. First, we propose novel bounding algorithms based on Lagrangian Decomposition. Previous works have used…

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

Optimization and Control · Mathematics 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

This paper is concerned with the ordered statistic decoding with local constraints (LC-OSD) of binary linear block codes, which is a near maximum-likelihood decoding algorithm. Compared with the conventional OSD, the LC-OSD significantly…

Information Theory · Computer Science 2024-01-31 Jifan Liang , Xiao Ma

In this paper, we propose a stochastic Primal-Dual Hybrid Gradient (PDHG) approach for solving a wide spectrum of regularized stochastic minimization problems, where the regularization term is composite with a linear function. It has been…

Machine Learning · Computer Science 2018-02-02 Linbo Qiao , Tianyi Lin , Qi Qin , Xicheng Lu

Linear programming has played a crucial role in shaping decision-making, resource allocation, and cost reduction in various domains. In this paper, we investigate the application of overparametrized neural networks and their implicit bias…

Optimization and Control · Mathematics 2023-10-05 Haoyue Wang , Promit Ghosal , Rahul Mazumder

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

Numerical Analysis · Mathematics 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

While standard reinforcement learning optimizes a single reward signal, many applications require optimizing a nonlinear utility $f(J_1^\pi,\dots,J_M^\pi)$ over multiple objectives, where each $J_m^\pi$ denotes the expected discounted…

Machine Learning · Computer Science 2026-03-10 Swetha Ganesh , Vaneet Aggarwal

We consider the branch-length estimation problem on a bifurcating tree: a character evolves along the edges of a binary tree according to a two-state symmetric Markov process, and we seek to recover the edge transition probabilities from…

Computation · Statistics 2025-07-30 David Clancy , Hanbaek Lyu , Sebastien Roch

The Chance-Constrained Parallel Machine Scheduling Problem (CC-PMSP) assigns jobs with uncertain processing times to machines, ensuring that each machine's availability constraints are met with a certain probability. We present a…

Optimization and Control · Mathematics 2025-04-30 Nicolás Casassus , Margarita Castro , Gustavo Angulo