English
Related papers

Related papers: Best Subset Selection via a Modern Optimization Le…

200 papers

In this paper, we propose a Pre-trained Mixed Integer Optimization framework (PreMIO) that accelerates online mixed integer program (MIP) solving with offline datasets and machine learning models. Our method is based on a data-driven…

Optimization and Control · Mathematics 2025-04-08 Yanguang Chen , Wenzhi Gao , Wanyu Zhang , Dongdong Ge , Huikang Liu , Yinyu Ye

In general, a multi-objective optimization problem does not have a single optimal solution but a set of Pareto optimal solutions, which forms the Pareto front in the objective space. Various evolutionary algorithms have been proposed to…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Hisao Ishibuchi , Lie Meng Pang , Ke Shang

We formulate the sparse classification problem of $n$ samples with $p$ features as a binary convex optimization problem and propose a cutting-plane algorithm to solve it exactly. For sparse logistic regression and sparse SVM, our algorithm…

Optimization and Control · Mathematics 2025-01-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

We study computational aspects of a key problem in robust statistics -- the penalized least trimmed squares (LTS) regression problem, a robust estimator that mitigates the influence of outliers in data by capping residuals with large…

Optimization and Control · Mathematics 2026-04-15 Xiang Meng , Andrés Gómez , Rahul Mazumder

A scoring system is a linear classifier composed of a small number of explanatory variables, each assigned a small integer coefficient. This system is highly interpretable and allows predictions to be made with simple manual calculations…

Machine Learning · Computer Science 2026-01-14 Moe Shiina , Shunnosuke Ikeda , Yuichi Takano

Cutting planes are crucial for the performance of branch-and-cut algorithms for solving mixed-integer programming (MIP) problems, and linear row aggregation has been successfully applied to better leverage the potential of several major…

Optimization and Control · Mathematics 2025-02-05 Liding Xu , Gioni Mexi , Ksenia Bestuzheva

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-convex and NP-hard problem. In this paper, we investigate the dual forms…

Methodology · Statistics 2022-07-06 Shaogang Ren , Guanhua Fang , Ping Li

This paper surveys the trend of leveraging machine learning to solve mixed integer programming (MIP) problems. Theoretically, MIP is an NP-hard problem, and most of the combinatorial optimization (CO) problems can be formulated as the MIP.…

Artificial Intelligence · Computer Science 2022-03-08 Jiayi Zhang , Chang Liu , Junchi Yan , Xijun Li , Hui-Ling Zhen , Mingxuan Yuan

We propose an approach based on machine learning to solve two-stage linear adaptive robust optimization (ARO) problems with binary here-and-now variables and polyhedral uncertainty sets. We encode the optimal here-and-now decisions, the…

Machine Learning · Computer Science 2026-04-21 Dimitris Bertsimas , Cheol Woo Kim

A popular approach to sentence compression is to formulate the task as a constrained optimization problem and solve it with integer linear programming (ILP) tools. Unfortunately, dependence on ILP may make the compressor prohibitively slow,…

Computation and Language · Computer Science 2015-10-29 Katja Filippova , Enrique Alfonseca

The identification of governing equations for dynamical systems is everlasting challenges for the fundamental research in science and engineering. Machine learning has exhibited great success to learn and predict dynamical systems from…

Optimization and Control · Mathematics 2022-09-27 Zhongshun Shi , Hang Ma , Hoang Tran , Guannan Zhang

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-smooth non-convex problem. In this paper, we investigate the dual forms of…

Machine Learning · Computer Science 2024-12-31 Shaogang Ren , Xiaoning Qian

In many applications including integer-forcing linear multiple-input and multiple-output (MIMO) receiver design, one needs to solve a successive minima problem (SMP) on an $n$-dimensional lattice to get an optimal integer coefficient matrix…

Information Theory · Computer Science 2018-11-06 Jinming Wen , Lanping Li , Xiaohu Tang , Wai Ho Mow

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

The two primary approaches for high-dimensional regression problems are sparse methods (e.g., best subset selection, which uses the L0-norm in the penalty) and ensemble methods (e.g., random forests). Although sparse methods typically yield…

Methodology · Statistics 2024-10-31 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

In high-dimensional generalized linear models, it is crucial to identify a sparse model that adequately accounts for response variation. Although the best subset section has been widely regarded as the Holy Grail of problems of this type,…

Machine Learning · Statistics 2023-08-02 Junxian Zhu , Jin Zhu , Borui Tang , Xuanyu Chen , Hongmei Lin , Xueqin Wang

While most methods for solving mixed-integer optimization problems compute a single optimal solution, a diverse set of near-optimal solutions can often lead to improved outcomes. We present a new method for finding a set of diverse…

Discrete Mathematics · Computer Science 2023-02-09 Izuwa Ahanor , Hugh Medal , Andrew C. Trapp

Mixed Integer Programming (MIP) is one of the most widely used modeling techniques for combinatorial optimization problems. In many applications, a similar MIP model is solved on a regular basis, maintaining remarkable similarities in model…

Artificial Intelligence · Computer Science 2019-09-10 Jian-Ya Ding , Chao Zhang , Lei Shen , Shengyin Li , Bing Wang , Yinghui Xu , Le Song

The global optimization literature places large emphasis on reducing intractable optimization problems into more tractable structured optimization forms. In order to achieve this goal, many existing methods are restricted to optimization…

Optimization and Control · Mathematics 2025-04-28 Dimitris Bertsimas , Berk Öztürk

We introduce a stochastic version of the cutting-plane method for a large class of data-driven Mixed-Integer Nonlinear Optimization (MINLO) problems. We show that under very weak assumptions the stochastic algorithm is able to converge to…

Optimization and Control · Mathematics 2021-03-04 Dimitris Bertsimas , Michael Lingzhi Li