English
Related papers

Related papers: Optimal binning: mathematical programming formulat…

200 papers

We present a new algorithmic framework for grouped variable selection that is based on discrete mathematical optimization. While there exist several appealing approaches based on convex relaxations and nonconvex heuristics, we focus on…

Methodology · Statistics 2021-10-19 Hussein Hazimeh , Rahul Mazumder , Peter Radchenko

Modern machine learning pipelines are increasingly combining and mixing data from diverse and disparate sources, e.g., pre-training large language models. Yet, finding the optimal data mixture is a challenging and open problem. We formalize…

Machine Learning · Computer Science 2026-01-16 Anvith Thudi , Evianne Rovers , Yangjun Ruan , Tristan Thrush , Chris J. Maddison

The problem of computing an exact experimental design that is optimal for the least-squares estimation of the parameters of a regression model is considered. We show that this problem can be solved via mixed-integer linear programming…

Computation · Statistics 2024-06-18 Radoslav Harman , Samuel Rosa

We present a convex mixed-integer programming formulation for non-rigid shape matching. To this end, we propose a novel shape deformation model based on an efficient low-dimensional discrete model, so that finding a globally optimal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Florian Bernard , Zeeshan Khan Suri , Christian Theobalt

In this work, we develop an adaptive, multivariate partitioning algorithm for solving mixed-integer nonlinear programs (MINLP) with multi-linear terms to global optimality. This iterative algorithm primarily exploits the advantages of…

Optimization and Control · Mathematics 2019-02-05 Harsha Nagarajan , Mowen Lu , Site Wang , Russell Bent , Kaarthik Sundar

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

The Bin Packing Problem (BPP) has attracted enthusiastic research interest recently, owing to widespread applications in logistics and warehousing environments. It is truly essential to optimize the bin packing to enable more objects to be…

Robotics · Computer Science 2024-03-20 Baoying Wang , Huixu Dong

Maximum subarray is a classical problem in computer science that given an array of numbers aims to find a contiguous subarray with the largest sum. We focus on its use for a noisy statistical problem of localizing an interval with a mean…

Methodology · Statistics 2023-10-24 Dennis Wei , Dmitry M. Malioutov

Maximizing monotone submodular functions under cardinality constraints is a classic optimization task with several applications in data mining and machine learning. In this paper we study this problem in a dynamic environment with…

Data Structures and Algorithms · Computer Science 2024-05-31 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Binary optimization is a powerful tool for modeling combinatorial problems, yet scalable and theoretically sound solution methods remain elusive. Conventional solvers often rely on heuristic strategies with weak guarantees or struggle with…

Optimization and Control · Mathematics 2026-05-12 Wenbo Liu , Akang Wang , Dun Ma , Hongyi Jiang , Jianghua Wu , Wenguo Yang

Identifying internal parameters for planning is crucial to maximizing the performance of a planner. However, automatically tuning internal parameters which are conditioned on the problem instance is especially challenging. A recent line of…

Artificial Intelligence · Computer Science 2023-03-15 Yiyuan Lee , Katie Lee , Panpan Cai , David Hsu , Lydia E. Kavraki

The thermal unit commitment (UC) problem often can be formulated as a mixed integer quadratic programming (MIQP), which is difficult to solve efficiently, especially for large-scale instances. In this paper, with projecting unit generation…

Optimization and Control · Mathematics 2017-02-08 Linfeng Yang , Chen Zhang , Jinbao Jian , Ke Meng , Zhaoyang Dong

The maximum-entropy sampling problem is a fundamental and challenging combinatorial-optimization problem, with application in spatial statistics. It asks to find a maximum-determinant order-$s$ principal submatrix of an order-$n$ covariance…

Optimization and Control · Mathematics 2020-02-03 Zhongzhu Chen , Marcia Fampa , Amélie Lambert , Jon Lee

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

Shifted combinatorial optimization is a new nonlinear optimization framework, which is a broad extension of standard combinatorial optimization, involving the choice of several feasible solutions at a time. It captures well studied and…

Optimization and Control · Mathematics 2017-06-08 Martin Koutecky , Asaf Levin , Syed M. Meesum , Shmuel Onn

Designing faster algorithms for solving Mixed-Integer Linear Programming (MILP) problems is highly desired across numerous practical domains, as a vast array of complex real-world challenges can be effectively modeled as MILP formulations.…

Artificial Intelligence · Computer Science 2026-01-23 Ruizhi Liu , Liming Xu , Xulin Huang , Jingyan Sui , Shizhe Ding , Boyang Xia , Chungong Yu , Dongbo Bu

We present two novel applications of symmetries for mixed-integer linear programming. First we propose two variants of a new heuristic to improve the objective value of a feasible solution using symmetries. These heuristics can use either…

Optimization and Control · Mathematics 2014-08-19 Philipp M. Christophel , Menal Güzelsoy , Imre Pólik

Integer and mixed-integer nonlinear programming (INLP, MINLP) are central to logistics, energy, and scheduling, but remain computationally challenging. This survey examines how machine learning and reinforcement learning can enhance exact…

Optimization and Control · Mathematics 2025-11-04 Morteza Kimiaei , Vyacheslav Kungurtsev , Brian Olimba

Predict+Optimize is a recently proposed framework which combines machine learning and constrained optimization, tackling optimization problems that contain parameters that are unknown at solving time. The goal is to predict the unknown…

Artificial Intelligence · Computer Science 2022-09-09 Xinyi Hu , Jasper C. H. Lee , Jimmy H. M. Lee

Semi-infinite programs are a class of mathematical optimization problems with a finite number of decision variables and infinite constraints. As shown by Blankenship and Falk (Blankenship and Falk. "Infinitely constrained optimization…

Optimization and Control · Mathematics 2020-09-21 Stuart M. Harwood , Dimitri J. Papageorgiou , Francisco Trespalacios