English
Related papers

Related papers: Convergence of Parameter Estimates for Regularized…

200 papers

We study a class of generalized linear programs (GLP) in a large-scale setting, which includes simple, possibly nonsmooth convex regularizer and simple convex set constraints. By reformulating (GLP) as an equivalent convex-concave min-max…

Optimization and Control · Mathematics 2023-04-10 Chaobing Song , Cheuk Yin Lin , Stephen J. Wright , Jelena Diakonikolas

In this study, we introduce an innovative deep learning framework that employs a transformer model to address the challenges of mixed-integer programs, specifically focusing on the Capacitated Lot Sizing Problem (CLSP). Our approach, to our…

Artificial Intelligence · Computer Science 2024-05-27 Joshua F. Cooper , Seung Jin Choi , I. Esra Buyuktahtakin

Hypernetworks, neural networks that predict the parameters of another neural network, are powerful models that have been successfully used in diverse applications from image generation to multi-task learning. Unfortunately, existing…

Machine Learning · Computer Science 2023-06-30 Jose Javier Gonzalez Ortiz , John Guttag , Adrian Dalca

Reinforcement Learning with Verifiable Rewards (RLVR) has become a prominent method for post-training Large Language Models (LLMs). However, verifiers are rarely error-free; even deterministic checks can be inaccurate, and the growing…

Machine Learning · Computer Science 2026-04-10 Andreas Plesner , Francisco Guzmán , Anish Athalye

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

Finite Mixture Regression (FMR) refers to the mixture modeling scheme which learns multiple regression models from the training data set. Each of them is in charge of a subset. FMR is an effective scheme for handling sample heterogeneity,…

Machine Learning · Statistics 2020-10-13 Jian Liang , Kun Chen , Ming Lin , Changshui Zhang , Fei Wang

In this paper we provide a computation algorithm to get a global solution for the maximum rank correlation estimator using the mixed integer programming (MIP) approach. We construct a new constrained optimization problem by transforming all…

Econometrics · Economics 2022-08-11 Youngki Shin , Zvezdomir Todorov

This work demonstrates that applying a fixed-effect multiple linear regression (MLR) model to an overparameterized dataset is mathematically equivalent to fitting a hyper-curve parameterized by a single scalar. This reformulation shifts the…

Machine Learning · Statistics 2026-02-26 E. Atza , N. Budko

The problem of computing an exact experimental design that is optimal for the least-squares estimation of the parameters of a regression model is considered. We show that this problem can be solved via mixed-integer linear programming…

Computation · Statistics 2024-06-18 Radoslav Harman , Samuel Rosa

This work introduces a framework to address the computational complexity inherent in Mixed-Integer Programming (MIP) models by harnessing the potential of deep learning. By employing deep learning, we construct problem-specific heuristics…

Optimization and Control · Mathematics 2024-05-13 Niki Triantafyllou , Maria M. Papathanasiou

Lagrangian Relaxation (LR) is a powerful technique for solving large-scale Mixed Integer Linear Programming (MILP), particularly those with decomposable structures, such as vehicle routing or unit commitment problems. By relaxing the…

Machine Learning · Statistics 2026-05-27 Tung Quoc Le , Anh Tuan Nguyen , Viet Anh Nguyen

In the problem of learning mixtures of linear regressions, the goal is to learn a collection of signal vectors from a sequence of (possibly noisy) linear measurements, where each measurement is evaluated on an unknown signal drawn uniformly…

Machine Learning · Computer Science 2019-11-01 Akshay Krishnamurthy , Arya Mazumdar , Andrew McGregor , Soumyabrata Pal

In the Multiple Measurements Vector (MMV) model, measurement vectors are connected to unknown, jointly sparse signal vectors through a linear regression model employing a single known measurement matrix (or dictionary). Typically, the…

Methodology · Statistics 2024-08-05 Esa Ollila

Numerous real-world decision-making problems can be formulated and solved using Mixed-Integer Linear Programming (MILP) models. However, the transformation of these problems into MILP models heavily relies on expertise in operations…

Optimization and Control · Mathematics 2023-11-28 Qingyang Li , Lele Zhang , Vicky Mak-Hau

Mixed Integer Programming (MIP) has been extensively applied in areas requiring mathematical solvers to address complex instances within tight time constraints. However, as the problem scale increases, the complexity of model formulation…

Computation and Language · Computer Science 2024-09-19 Teng Wang , Wing-Yin Yu , Ruifeng She , Wenhan Yang , Taijie Chen , Jianping Zhang

Mixed Integer Linear Programs (MILPs) are essential tools for solving planning and scheduling problems across critical industries such as construction, manufacturing, and logistics. However, their widespread adoption is limited by long…

Machine Learning · Computer Science 2025-06-10 Xiaoke Wang , Batuhan Altundas , Zhaoxin Li , Aaron Zhao , Matthew Gombolay

Mixed integer linear programming (MILP) solvers expose hundreds of parameters that have an outsized impact on performance but are difficult to configure for all but expert users. Existing machine learning (ML) approaches require training on…

Machine Learning · Computer Science 2025-09-25 Connor Lawless , Yingxi Li , Anders Wikum , Madeleine Udell , Ellen Vitercik

Noisy training set usually leads to the degradation of generalization and robustness of neural networks. In this paper, we propose using a theoretically guaranteed noisy label detection framework to detect and remove noisy data for Learning…

Machine Learning · Computer Science 2022-03-22 Yikai Wang , Xinwei Sun , Yanwei Fu

Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current…

Optimization and Control · Mathematics 2022-05-23 Nicolas Sonnerat , Pengming Wang , Ira Ktena , Sergey Bartunov , Vinod Nair

Deep learning has made many remarkable achievements in many fields but suffers from noisy labels in datasets. The state-of-the-art learning with noisy label method Co-teaching and Co-teaching+ confronts the noisy label by mutual-information…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Jiarun Liu , Daguang Jiang , Yukun Yang , Ruirui Li