English
Related papers

Related papers: Warm-starting Strategies in Scalarization Methods …

200 papers

Linear scalarization, i.e., combining all loss functions by a weighted sum, has been the default choice in the literature of multi-task learning (MTL) since its inception. In recent years, there is a surge of interest in developing…

Machine Learning · Computer Science 2023-09-25 Yuzheng Hu , Ruicheng Xian , Qilong Wu , Qiuling Fan , Lang Yin , Han Zhao

We study a general scalarization approach via utility functions in multi-objective optimization. It consists of maximizing utility which is obtained from the objectives' bargaining with regard to a disagreement reference point. The…

Optimization and Control · Mathematics 2024-01-26 Lorenzo Lampariello , Simone Sagratella , Valerio Giuseppe Sasso , Vladimir Shikhman

We consider the problem of computing the optimal solution and objective of a linear program under linearly changing linear constraints. The problem studied is given by $\min c^t x \text{ s.t } Ax + \lambda Dx \leq b$ where $\lambda$ belongs…

Optimization and Control · Mathematics 2026-03-02 Guillaume Derval , Bardhyl Miftari , Damien Ernst , Quentin Louveaux

An emerging line of work has shown that machine-learned predictions are useful to warm-start algorithms for discrete optimization problems, such as bipartite matching. Previous studies have shown time complexity bounds proportional to some…

Machine Learning · Computer Science 2023-02-03 Shinsaku Sakaue , Taihei Oki

A multiscale optimization framework for problems over a space of Lipschitz continuous functions is developed. The method solves a coarse-grid discretization followed by linear interpolation to warm-start project gradient descent on…

Numerical Analysis · Mathematics 2026-03-05 Nicholas J. E. Richardson , Noah Marusenko , Michael P. Friedlander

Solutions to multi-objective optimization problems can generally not be compared or ordered, due to the lack of orderability of the single objectives. Furthermore, decision-makers are often made to believe that scaled objectives can be…

Optimization and Control · Mathematics 2022-05-31 Sebastian Hönel , Welf Löwe

The unit commitment problem is an important optimization problem in the energy industry used to compute the most economical operating schedules of power plants. Typically, this problem has to be solved repeatedly with different data but…

Optimization and Control · Mathematics 2023-12-18 Nagisa Sugishita , Andreas Grothey , Ken McKinnon

Recent multi-task learning research argues against unitary scalarization, where training simply minimizes the sum of the task losses. Several ad-hoc multi-task optimization algorithms have instead been proposed, inspired by various…

Machine Learning · Computer Science 2023-03-10 Vitaly Kurin , Alessandro De Palma , Ilya Kostrikov , Shimon Whiteson , M. Pawan Kumar

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

In recent years, there has been significant research interest in solving Quadratic Unconstrained Binary Optimisation (QUBO) problems. Physics-inspired optimisation algorithms have been proposed for deriving optimal or sub-optimal solutions…

Artificial Intelligence · Computer Science 2023-09-12 Mayowa Ayodele , Richard Allmendinger , Manuel López-Ibáñez , Matthieu Parizy

A warm start method is developed for efficiently solving complex chance constrained optimal control problems. The warm start method addresses the computational challenges of solving chance constrained optimal control problems using biased…

Optimization and Control · Mathematics 2020-07-22 Rachel E. Kiel , Mrinal Kumar , Anil V. Rao

The performance of many hard combinatorial problem solvers depends strongly on their parameter settings, and since manual parameter tuning is both tedious and suboptimal the AI community has recently developed several algorithm…

Artificial Intelligence · Computer Science 2017-11-29 Marius Lindauer , Frank Hutter

When designing a motion planner for autonomous robots there are usually multiple objectives to be considered. However, a cost function that yields the desired trade-off between objectives is not easily obtainable. A common technique across…

Robotics · Computer Science 2023-12-13 Nils Wilde , Stephen L. Smith , Javier Alonso-Mora

Scalarizing functions have been widely used to convert a multiobjective optimization problem into a single objective optimization problem. However, their use in solving (computationally) expensive multi- and many-objective optimization…

Machine Learning · Computer Science 2019-04-12 Tinkle Chugh

Optimization problems have been the subject of statistical physics approximations. A specially relevant and general scenario is provided by optimization methods considering tradeoffs between cost and efficiency, where optimal solutions…

Statistical Mechanics · Physics 2015-09-16 Luís F. Seoane , Ricard V. Solé

Scaling model sizes to scale performance has worked remarkably well for the current large language models paradigm. The research and empirical findings of various scaling studies led to novel scaling results and laws that guides subsequent…

The simplex method is one of the most fundamental technologies for solving linear programming (LP) problems and has been widely applied to different practical applications. In the past literature, how to improve and accelerate the simplex…

Optimization and Control · Mathematics 2021-11-08 Mengyu Huang , Yuxing Zhong , Huiwen Yang , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

Mixed Integer Linear Programs (MILP) are well known to be NP-hard (Non-deterministic Polynomial-time hard) problems in general. Even though pure optimization-based methods, such as constraint generation, are guaranteed to provide an optimal…

Optimization and Control · Mathematics 2022-07-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

Multicriteria adjustable robust optimization (MARO) problems arise in a wide variety of practical settings, for example, in the design of a building's energy supply. However, no general approaches, neither for the characterization of…

Optimization and Control · Mathematics 2024-06-13 Elisabeth Halser , Elisabeth Finhold , Neele Leithäuser , Jan Schwientek , Katrin Teichert , Karl-Heinz Küfer

This paper describes the computational challenge developed for a computational competition held in 2023 for the $20^{\textrm{th}}$ anniversary of the Mixed Integer Programming Workshop. The topic of this competition was reoptimization, also…