English
Related papers

Related papers: Fast Continuous and Integer L-shaped Heuristics Th…

200 papers

Among the most famous algorithms for solving classification problems are support vector machines (SVMs), which find a separating hyperplane for a set of labeled data points. In some applications, however, labels are only available for a…

Optimization and Control · Mathematics 2023-10-17 Jan Pablo Burgard , Maria Eduarda Pinheiro , Martin Schmidt

We develop a line-search second-order algorithmic framework for minimizing finite sums. We do not make any convexity assumptions, but require the terms of the sum to be continuously differentiable and have Lipschitz-continuous gradients.…

Optimization and Control · Mathematics 2022-06-28 Daniela di Serafino , Nataša Krejić , Nataša Krklec Jerinkić , Marco Viola

With the development of large language models (LLMs), it has become increasingly important to optimize hardware usage and improve throughput. In this paper, we study the inference optimization of the serving system that deploys LLMs. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-26 Bowen Pang , Kai Li , Ruifeng She , Feifan Wang

Even after fine-tuning and reinforcement learning, large language models (LLMs) can be difficult, if not impossible, to control reliably with prompts alone. We propose a new inference-time approach to enforcing syntactic and semantic…

Artificial Intelligence · Computer Science 2023-11-28 Alexander K. Lew , Tan Zhi-Xuan , Gabriel Grand , Vikash K. Mansinghka

Thanks to the increasing availability of granular, yet high-dimensional, firm level data, machine learning (ML) algorithms have been successfully applied to address multiple research questions related to firm dynamics. Especially supervised…

General Economics · Economics 2021-12-03 Falco J. Bargagli-Stoffi , Jan Niederreiter , Massimo Riccaboni

The rapid advancement of software development practices has introduced challenges in ensuring quality and efficiency across the software engineering (SE) lifecycle. As SE systems grow in complexity, traditional approaches often fail to…

Software Engineering · Computer Science 2025-08-04 Samah Kansab

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

In order to deal with the high development time of exact and approximation algorithms for NP-hard combinatorial optimisation problems and the high running time of exact solvers, deep learning techniques have been used in recent years as an…

Machine Learning · Computer Science 2021-04-20 James Fitzpatrick , Deepak Ajwani , Paula Carroll

This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict expected tactical descriptions of operational solutions (TDOSs). The…

Machine Learning · Computer Science 2022-06-10 Eric Larsen , Sébastien Lachapelle , Yoshua Bengio , Emma Frejinger , Simon Lacoste-Julien , Andrea Lodi

Large language models (LLMs) iteratively generate text token by token, with memory usage increasing with the length of generated token sequences. Since the request generation length is generally unpredictable, it is difficult to estimate…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Ke Cheng , Wen Hu , Zhi Wang , Hongen Peng , Jianguo Li , Sheng Zhang

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

A new technique is proposed for fault-tolerant linear, sesquilinear and bijective (LSB) operations on $M$ integer data streams ($M\geq3$), such as: scaling, additions/subtractions, inner or outer vector products, permutations and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-03 Mohammad Ashraful Anam , Yiannis Andreopoulos

Mixed-Integer Linear Programming (MILP) is a foundational tool for complex decision-making problems. However, the NP-hard nature of MILP presents a significant computational challenge, motivating the development of machine learning-based…

Optimization and Control · Mathematics 2026-03-03 Hongpei Li , Hui Yuan , Han Zhang , Jianghao Lin , Dongdong Ge , Mengdi Wang , Yinyu Ye

This paper presents a novel centroid-based heuristic algorithm, termed Kempe Swap K-Means, for constrained clustering under rigid must-link (ML) and cannot-link (CL) constraints. The algorithm employs a dual-phase iterative process: an…

Machine Learning · Computer Science 2026-03-31 Yuxuan Ren , Shijie Deng

Integer Linear Programs (ILPs) are powerful tools for modeling and solving a large number of combinatorial optimization problems. Recently, it has been shown that Large Neighborhood Search (LNS), as a heuristic algorithm, can find high…

Artificial Intelligence · Computer Science 2024-01-17 Taoan Huang , Aaron Ferber , Yuandong Tian , Bistra Dilkina , Benoit Steiner

Day-ahead operations involves a complex and computationally intensive optimization process to determine the generator commitment schedule and dispatch. The optimization process is a mixed-integer linear program (MILP) also known as…

Systems and Control · Electrical Eng. & Systems 2022-08-16 Arun Venkatesh Ramesh , Xingpeng Li

Mixed Binary Quadratic Programs (MBQPs) are an important and complex set of problems in combinatorial optimization. As solving large-scale combinatorial optimization problems is challenging, primal heuristics have been developed to quickly…

Machine Learning · Computer Science 2026-04-28 Weimin Huang , Natalie M. Isenberg , Ján Drgoňa , Draguna L Vrabie , Bistra Dilkina

This paper addresses aircraft delays, emphasizing their impact on safety and financial losses. To mitigate these issues, an innovative machine learning (ML)-enhanced landing scheduling methodology is proposed, aiming to improve automation…

Artificial Intelligence · Computer Science 2023-11-28 Yutian Pang , Peng Zhao , Jueming Hu , Yongming Liu

Finding optimal join orders is among the most crucial steps to be performed by query optimisers. Though extensively studied in data management research, the problem remains far from solved: While query optimisers rely on exhaustive search…

Databases · Computer Science 2025-10-24 Manuel Schönberger , Immanuel Trummer , Wolfgang Mauerer

Second-order methods are provably faster than first-order methods, and their efficient implementations for large-scale optimization problems have attracted significant attention. Yet, optimization problems in ML often have nonsmooth…

Optimization and Control · Mathematics 2026-02-10 Amal Alphonse , Pavel Dvurechensky , Clemens Sirotenko