English
Related papers

Related papers: Distributionally Robust Multi-Objective Optimizati…

200 papers

Motivated by energy management for micro-grids, we study convex optimization problems with uncertainty in the objective function and sequential decision making. To solve these problems, we propose a new framework called ``Online…

Optimization and Control · Mathematics 2020-08-25 Martijn H. H. Schoot Uiterkamp , Marco E. T. Gerards , Johann L. Hurink

When working with decomposition-based algorithms, an appropriate set of weights might improve quality of the final solution. A set of uniformly distributed weights usually leads to well-distributed solutions on a Pareto front. However,…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Lucas R. C. de Farias , Pedro H. M. Braga , Hansenclever F. Bassani , Aluizio F. R. Araújo

Large-scale multi-objective optimization poses challenges to existing evolutionary algorithms in maintaining the performances of convergence and diversity because of high dimensional decision variables. Inspired by the motion of particles…

Neural and Evolutionary Computing · Computer Science 2025-09-22 Jia-Cheng Li , Min-Rong Chen , Guo-Qiang Zeng , Jian Weng , Man Wang , Jia-Lin Mai

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

We study episodic reinforcement learning (RL) in non-stationary linear kernel Markov decision processes (MDPs). In this setting, both the reward function and the transition kernel are linear with respect to the given feature maps and are…

Machine Learning · Computer Science 2024-12-24 Han Zhong , Zhongren Chen , Zhuoran Yang , Zhaoran Wang , Csaba Szepesvári

Gasoline blending scheduling uses resource allocation and operation sequencing to meet a refinery's production requirements. The presence of nonlinearity, integer constraints, and a large number of decision variables adds complexity to this…

Artificial Intelligence · Computer Science 2024-02-23 Wenxuan Fang , Wei Du , Renchu He , Yang Tang , Yaochu Jin , Gary G. Yen

Multi-objective optimization is central to many engineering and machine learning applications, where multiple objectives must be optimized in balance. While multi-gradient based optimization methods combine these objectives in each step,…

Optimization and Control · Mathematics 2026-05-13 Trang H. Tran , Luis Nunes Vicente

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

We consider optimal decision-making problems in an uncertain environment. In particular, we consider the case in which the distribution of the input is unknown, yet there is abundant historical data drawn from the distribution. In this…

Optimization and Control · Mathematics 2014-10-03 Zizhuo Wang , Peter Glynn , Yinyu Ye

Derivative-free Riemannian optimization (DFRO) aims to minimize an objective function using only function evaluations, under the constraint that the decision variables lie on a Riemannian manifold. The rapid increase in problem dimensions…

Optimization and Control · Mathematics 2026-01-14 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

We formulate an optimization problem for maximizing the data rate of a common message transmitted from nodes within an airborne network broadcast to a central station receiver while maintaining a set of intra-network rate demands. Assuming…

Optimization and Control · Mathematics 2017-06-08 Theodoros Tsiligkaridis

Multi-objective optimization (MOO) aims at finding a set of optimal configurations for a given set of objectives. A recent line of work applies MOO methods to the typical Machine Learning (ML) setting, which becomes multi-objective if a…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

Machine Learning · Statistics 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Pareto front profiling in multi-objective optimization (MOO), i.e., finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives that require training a neural network. Typically, in MOO for neural…

Machine Learning · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Arber Zela , Benedikt Staffler , Samuel Dooley , Josif Grabocka , Frank Hutter

Seeking to improve model generalization, we consider a new approach based on distributionally robust learning (DRL) that applies stochastic gradient descent to the outer minimization problem. Our algorithm efficiently estimates the gradient…

Machine Learning · Statistics 2020-12-24 Soumyadip Ghosh , Mark Squillante

Smooth minimax optimization problems play a central role in a wide range of applications, including machine learning, game theory, and operations research. However, existing algorithmic frameworks vary significantly depending on the problem…

Optimization and Control · Mathematics 2025-06-10 Taoli Zheng , Anthony Man-Cho So , Jiajin Li

In the era of exceptionally data-hungry models, careful selection of the training data is essential to mitigate the extensive costs of deep learning. Data pruning offers a solution by removing redundant or uninformative samples from the…

Machine Learning · Computer Science 2025-02-11 Artem Vysogorets , Kartik Ahuja , Julia Kempe

An algorithm is proposed to solve robust control problems constrained by partial differential equations with uncertain coefficients, based on the so-called MG/OPT framework. The levels in this MG/OPT hierarchy correspond to discretization…

Numerical Analysis · Mathematics 2021-07-21 Andreas Van Barel , Stefan Vandewalle

Post-training LLMs with Reinforcement Learning, specifically Group Relative Policy Optimization (GRPO), has emerged as a paradigm for enhancing mathematical reasoning. However, standard GRPO relies on scalar correctness rewards that are…

Computation and Language · Computer Science 2026-03-03 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Xuanzhao Dong , Hao Wang , Haiyu Wu , Huayu Li , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi