English
Related papers

Related papers: SOCP relaxation bounds for the optimal subset sele…

200 papers

Logic-Based Benders Decomposition (LBBD) and its Branch-and-Cut variant, namely Branch-and-Check, enjoy an extensive applicability on a broad variety of problems, including scheduling. Although LBBD offers problem-specific cuts to impose…

Optimization and Control · Mathematics 2025-04-02 Ioannis Avgerinos , Ioannis Mourtos , Stavros Vatikiotis , Georgios Zois

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

Machine Learning · Statistics 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

A framework is introduced for solving a sequence of slowly changing optimization problems, including those arising in regression and classification applications, using optimization algorithms such as stochastic gradient descent (SGD). The…

Machine Learning · Computer Science 2015-09-25 Craig Wilson , Venugopal V. Veeravalli

Decision tree optimization is fundamental to interpretable machine learning. The most popular approach is to greedily search for the best feature at every decision point, which is fast but provably suboptimal. Recent approaches find the…

Machine Learning · Computer Science 2025-11-19 Varun Babbar , Hayden McTavish , Cynthia Rudin , Margo Seltzer

We analyze the performance of a linear-equality-constrained least-squares (CLS) algorithm and its relaxed version, called rCLS, that is obtained via the method of weighting. The rCLS algorithm solves an unconstrained least-squares problem…

Performance · Computer Science 2023-07-19 Reza Arablouei , Kutluyıl Doğançay

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

Optimization and Control · Mathematics 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant

We study how to construct compressed datasets that suffice to recover optimal decisions in linear programs with an unknown cost vector $c$ lying in a prior set $\mathcal{C}$. Recent work by Bennouna et al. provides an exact geometric…

Optimization and Control · Mathematics 2026-05-25 Yuhan Ye , Saurabh Amin , Asuman Ozdaglar

In this paper we consider a general problem set-up for a wide class of convex and robust distributed optimization problems in peer-to-peer networks. In this set-up convex constraint sets are distributed to the network processors who have to…

Systems and Control · Computer Science 2013-12-02 Mathias Bürger , Giuseppe Notarstefano , Frank Allgöwer

An important step in a multi-sensor surveillance system is to estimate sensor biases from their noisy asynchronous measurements. This estimation problem is computationally challenging due to the highly nonlinear transformation between the…

Information Theory · Computer Science 2018-05-21 Wenqiang Pu , Ya-Feng Liu , Junkun Yan , Hongwei Liu , Zhi-Quan Luo

Densest Subgraph Problem (DSP) is an important primitive problem with a wide range of applications, including fraud detection, community detection and DNA motif discovery. Edge-based density is one of the most common metrics in DSP.…

Databases · Computer Science 2023-10-31 Yugao Zhu , Shenghua Liu , Wenjie Feng , Xueqi Cheng

Instead of minimizing the sum of all $n$ squared residuals as the classical least squares (LS) does, Rousseeuw (1984) proposed to minimize the sum of $h$ ($n/2 \leq h < n$) smallest squared residuals, the resulting estimator is called least…

Computation · Statistics 2022-10-13 Yijun Zuo

In this article we consider the problem of choosing an optimal sampling scheme for the regression problem simultaneously with that of model selection. We consider a batch type approach and an on-line approach following algorithms recently…

Statistics Theory · Mathematics 2018-01-30 Ana Karina Fermin , Carenne Ludeña

We study the problem of deleting the smallest set $S$ of vertices (resp. edges) from a given graph $G$ such that the induced subgraph (resp. subgraph) $G \setminus S$ belongs to some class $\mathcal{H}$. We consider the case where graphs in…

Data Structures and Algorithms · Computer Science 2018-10-24 Anupam Gupta , Euiwoong Lee , Jason Li , Pasin Manurangsi , Michał Włodarczyk

The maximum density still life problem (MDSLP) is a hard constraint optimization problem based on Conway's game of life. It is a prime example of weighted constrained optimization problem that has been recently tackled in the…

Neural and Evolutionary Computing · Computer Science 2008-12-23 Jose E. Gallardo , Carlos Cotta , Antonio J. Fernandez

Regression analysis is an important instrument to determine the effect of the explanatory variables on response variables. When outliers and bias errors are present, the standard weighted least squares estimator may perform poorly. For this…

Computation · Statistics 2025-02-11 Justo Puerto , Alberto Torrejon

Exact solution of hard combinatorial optimization problems often relies on strong convex relaxations, but solving these relaxations repeatedly inside a branch-and-bound algorithm can be prohibitively expensive. Hence, we consider this…

Machine Learning · Computer Science 2026-05-11 Hao Chen , Chendi Qian , Christopher Morris , Andrea Lodi , Can Li

We study data-driven least squares (LS) problems with semidefinite (SD) constraints and derive finite-sample guarantees on the spectrum of their optimal solutions when these constraints are relaxed. In particular, we provide a high…

Systems and Control · Electrical Eng. & Systems 2026-02-11 Filippo Fabiani , Andrea Simonetto

The technique of semidefinite programming (SDP) relaxation can be used to obtain a nontrivial bound on the optimal value of a nonconvex quadratically constrained quadratic program (QCQP). We explore concave quadratic inequalities that hold…

Optimization and Control · Mathematics 2016-09-30 Jaehyun Park , Stephen Boyd

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

We introduce a new estimator for the vector of coefficients $\beta$ in the linear model $y=X\beta+z$, where $X$ has dimensions $n\times p$ with $p$ possibly larger than $n$. SLOPE, short for Sorted L-One Penalized Estimation, is the…