English
Related papers

Related papers: MIP-BOOST: Efficient and Effective $L_0$ Feature S…

200 papers

Lifting is a crucial technique in mixed integer programming (MIP) for generating strong valid inequalities, which serve as cutting planes to improve the branch-and-cut algorithm. We first propose an exact sequential lifting algorithm for…

Optimization and Control · Mathematics 2026-02-27 Xintong Wang , Liang Chen , Yu-Hong Dai

Cutting plane selection is a subroutine used in all modern mixed-integer linear programming solvers with the goal of selecting a subset of generated cuts that induce optimal solver performance. These solvers have millions of parameter…

Optimization and Control · Mathematics 2023-02-24 Mark Turner , Thorsten Koch , Felipe Serrano , Michael Winkler

Cutting plane methods play a significant role in modern solvers for tackling mixed-integer programming (MIP) problems. Proper selection of cuts would remove infeasible solutions in the early stage, thus largely reducing the computational…

Optimization and Control · Mathematics 2021-10-11 Zeren Huang , Kerong Wang , Furui Liu , Hui-ling Zhen , Weinan Zhang , Mingxuan Yuan , Jianye Hao , Yong Yu , Jun Wang

Gradient boosting algorithms construct a regression predictor using a linear combination of ``base learners''. Boosting also offers an approach to obtaining robust non-parametric regression estimators that are scalable to applications with…

Methodology · Statistics 2020-08-11 Xiaomeng Ju , Matías Salibián-Barrera

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Azam Asilian Bidgoli , Shahryar Rahnamayan

A critical problem in deep learning is that systems learn inappropriate biases, resulting in their inability to perform well on minority groups. This has led to the creation of multiple algorithms that endeavor to mitigate bias. However, it…

Machine Learning · Computer Science 2024-04-24 Robik Shrestha , Kushal Kafle , Christopher Kanan

Deriving a good variable selection strategy in branch-and-bound is essential for the efficiency of modern mixed-integer programming (MIP) solvers. With MIP branching data collected during the previous solution process, learning to branch…

Machine Learning · Computer Science 2022-07-29 Zeren Huang , Wenhao Chen , Weinan Zhang , Chuhan Shi , Furui Liu , Hui-Ling Zhen , Mingxuan Yuan , Jianye Hao , Yong Yu , Jun Wang

Boosting has garnered significant interest across both machine learning and statistical communities. Traditional boosting algorithms, designed for fully observed random samples, often struggle with real-world problems, particularly with…

Machine Learning · Statistics 2026-02-19 Yuan Bian , Grace Y. Yi , Wenqing He

Solving large-scale Mixed Integer Programs (MIP) can be difficult without advanced algorithms such as decomposition based techniques. Even if a decomposition technique might be appropriate, there are still many possible decompositions for…

Optimization and Control · Mathematics 2022-07-04 Jake Weiner , Andreas T. Ernst , Xiaodong Li , Yuan Sun

In recent advances in solving the problem of transmission network expansion planning, the use of robust optimization techniques has been put forward, as an alternative to stochastic mathematical programming methods, to make the problem…

Computational Engineering, Finance, and Science · Computer Science 2016-09-28 Roberto Minguez , Raquel Garcia-Bertrand

Mixed integer predictive control deals with optimizing integer and real control variables over a receding horizon. The mixed integer nature of controls might be a cause of intractability for instances of larger dimensions. To tackle this…

Optimization and Control · Mathematics 2010-03-16 Dario Bauso

Large Language Models (LLMs) often fail to generate correct code on the first attempt, which requires using generated unit tests as verifiers to validate the solutions. Despite the success of recent verification methods, they remain…

Artificial Intelligence · Computer Science 2026-03-03 Sicheng Zhu , Jiajun Wang , Jiawei Ai , Xin Li

The rapid increase in the parameter counts of Large Language Models (LLMs), which often reach into the billions or even trillions, presents significant challenges for their practical deployment, particularly in resource-constrained…

Machine Learning · Computer Science 2025-11-18 Yi Cao , Wei-Jie Xu , Yucheng Shen , Weijie Shi , Chi-Min Chan , Jianfeng Qu , Jiajie Xu

For classifying digital whole slide images in the absence of pixel level annotation, typically multiple instance learning methods are applied. Due to the generic applicability, such methods are currently of very high interest in the…

This article presents the first mixed-integer linear programming (MILP)-based iterative algorithm to solve factorable mixed-integer nonlinear programs (MINLPs) with bounded, differentiable periodic functions to global optimality with an…

Optimization and Control · Mathematics 2025-10-01 Christopher Montez , Sujeevraja Sanjeevi , Kaarthik Sundar

In this paper, we propose a novel Mixed-Integer Non-Linear Optimization formulation to construct a risk score, where we optimize the logistic loss with sparsity constraints. Previous approaches are typically designed to handle binary…

Optimization and Control · Mathematics 2025-02-13 Cristina Molero-Río , Claudia D'Ambrosio

We propose an algorithm for generating explicit solutions of multiparametric mixed-integer convex programs to within a given suboptimality tolerance. The algorithm is applicable to a very general class of optimization problems, but is most…

Optimization and Control · Mathematics 2019-06-12 Danylo Malyuta , Behcet Acikmese

Sparse model selection by structural risk minimization leads to a set of a few predictors, ideally a subset of the true predictors. This selection clearly depends on the underlying loss function $\tilde L$. For linear regression with square…

Statistics Theory · Mathematics 2019-09-25 Tino Werner , Peter Ruckdeschel

Subset selection for multiple linear regression aims to construct a regression model that minimizes errors by selecting a small number of explanatory variables. Once a model is built, various statistical tests and diagnostics are conducted…

Machine Learning · Statistics 2020-09-04 Seokhyun Chung , Young Woong Park , Taesu Cheong

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes