English
Related papers

Related papers: Tri-skill variant Simplex and strongly polynomial-…

200 papers

We analyze the bit complexity of efficient algorithms for fundamental optimization problems, such as linear regression, $p$-norm regression, and linear programming (LP). State-of-the-art algorithms are iterative, and in terms of the number…

Data Structures and Algorithms · Computer Science 2023-04-06 Mehrdad Ghadiri , Richard Peng , Santosh S. Vempala

In this article, we introduce a new variable selection technique through trimming for finite mixture of regression models. Compared to the traditional variable selection techniques, the new method is robust and not sensitive to outliers.…

Methodology · Statistics 2019-05-06 Sijia Xiang , Weixin Yao

We revisit the so-called sampling and discarding approach used to quantify the probability of constraint violation of a solution to convex scenario programs when some of the original samples are allowed to be discarded. Motivated by two…

Optimization and Control · Mathematics 2022-04-05 Licio Romao , Antonis Papachristodoulou , Kostas Margellos

In this paper, we consider the problem of minimizing a linear functional subject to uncertain linear and bilinear matrix inequalities, which depend in a possibly nonlinear way on a vector of uncertain parameters. Motivated by recent results…

Optimization and Control · Mathematics 2015-05-29 Mohammadreza Chamanbaz , Fabrizio Dabbene , Roberto Tempo , Venkatakrishnan Venkataramanan , Qing-Guo Wang

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

In this work we present a quadratic programming approximation of the Semi-Supervised Support Vector Machine (S3VM) problem, namely approximate QP-S3VM, that can be efficiently solved using off the shelf optimization packages. We prove that…

Machine Learning · Computer Science 2011-08-24 Wael Emara , Mehmed Kantardzic

We consider convex optimization problems formulated using dynamic programming equations. Such problems can be solved using the Dual Dynamic Programming algorithm combined with the Level 1 cut selection strategy or the Territory algorithm to…

Optimization and Control · Mathematics 2017-05-26 Vincent Guigues

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

Machine Learning · Statistics 2014-10-14 Talayeh Razzaghi , Ilya Safro

We propose a new polynomial-time algorithm for linear programming. We further extend the ideas used in this new linear programming algorithm for nonlinear programming problems. The new algorithm is based on the idea of treating the…

General Mathematics · Mathematics 2019-03-14 Dhananjay P. Mehendale

Even though it is well known that for most relevant computational problems different algorithms may perform better on different classes of problem instances, most researchers still focus on determining a single best algorithmic…

We present a system and a set of techniques for learning linear predictors with convex losses on terascale datasets, with trillions of features, {The number of features here refers to the number of non-zero entries in the data matrix.}…

Machine Learning · Computer Science 2013-07-15 Alekh Agarwal , Olivier Chapelle , Miroslav Dudik , John Langford

A programming tactic involving polyhedra is reported that has been widely applied in the polyhedral analysis of (constraint) logic programs. The method enables the computations of convex hulls that are required for polyhedral analysis to be…

Programming Languages · Computer Science 2007-05-23 Florence Benoy , Andy King , Fred Mesnard

This paper deals with exploiting symmetry for solving linear and integer programming problems. Basic properties of linear representations of finite groups can be used to reduce symmetric linear programming to solving linear programs of…

Optimization and Control · Mathematics 2015-07-31 Richard Bödi , Katrin Herr , Michael Joswig

We develop algorithms for inner approximating the cone of positive semidefinite matrices via linear programming and second order cone programming. Starting with an initial linear algebraic approximation suggested recently by Ahmadi and…

Optimization and Control · Mathematics 2016-03-14 Amir Ali Ahmadi , Sanjeeb Dash , Georgina Hall

We propose a simple, powerful, and flexible machine learning framework for (i) reducing the search space of computationally difficult enumeration variants of subset problems and (ii) augmenting existing state-of-the-art solvers with…

Machine Learning · Computer Science 2019-02-25 Juho Lauri , Sourav Dutta

Features in machine learning problems are often time-varying and may be related to outputs in an algebraic or dynamical manner. The dynamic nature of these machine learning problems renders current higher order accelerated gradient descent…

Optimization and Control · Mathematics 2019-05-29 Joseph E. Gaudio , Travis E. Gibson , Anuradha M. Annaswamy , Michael A. Bolender

A novel matrix approximation problem is considered herein: observations based on a few fully sampled columns and quasi-polynomial structural side information are exploited. The framework is motivated by quantum chemistry problems wherein…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Jeongmin Chae , Praneeth Narayanamurthy , Selin Bac , Shaama Mallikarjun Sharada , Urbashi Mitra

Sparse linear regression is the well-studied inference problem where one is given a design matrix $\mathbf{A} \in \mathbb{R}^{M\times N}$ and a response vector $\mathbf{b} \in \mathbb{R}^M$, and the goal is to find a solution $\mathbf{x}…

Machine Learning · Computer Science 2022-02-17 Aparna Gupte , Vinod Vaikuntanathan

Column generation (CG) is one of the most successful approaches for solving large-scale linear programming (LP) problems. Given an LP with a prohibitively large number of variables (i.e., columns), the idea of CG is to explicitly consider…

Optimization and Control · Mathematics 2024-04-09 Haofeng Yuan , Lichang Fang , Shiji Song

We develop an algorithmic theory of convex optimization over discrete sets. Using a combination of algebraic and geometric tools we are able to provide polynomial time algorithms for solving broad classes of convex combinatorial…

Optimization and Control · Mathematics 2009-01-24 Shmuel Onn