English
Related papers

Related papers: An adaptive consensus based method for multi-objec…

200 papers

To date, the multi-objective optimization literature has mainly focused on conflicting objectives, studying the Pareto front, or requiring users to balance tradeoffs. Yet, in machine learning practice, there are many scenarios where such…

Machine Learning · Computer Science 2025-03-05 Yonathan Efroni , Ben Kretzu , Daniel Jiang , Jalaj Bhandari , Zheqing , Zhu , Karen Ullrich

The most common approaches for solving multistage stochastic programming problems in the research literature have been to either use value functions ("dynamic programming") or scenario trees ("stochastic programming") to approximate the…

Optimization and Control · Mathematics 2022-01-04 Warren B Powell , Saeed Ghadimi

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

In multi-objective optimization, computing the entire non-dominated set (also known as the Pareto front or the Pareto frontier) is often intractable. However, for any multiplicative factor greater than one, an approximation set can be…

Optimization and Control · Mathematics 2026-04-30 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky

Optimal transport has been used extensively in resource matching to promote the efficiency of resources usages by matching sources to targets. However, it requires a significant amount of computations and storage spaces for large-scale…

Optimization and Control · Mathematics 2019-04-10 Rui Zhang , Quanyan Zhu

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

Machine Learning · Computer Science 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

Traditionally, systems governed by linear Partial Differential Equations (PDEs) are spatially discretized to exploit their algebraic structure and reduce the computational effort for controlling them. Due to beneficial insights of the PDEs,…

Systems and Control · Computer Science 2016-04-05 Saber Jafarizadeh

In this paper, we propose a simple global optimisation algorithm inspired by Pareto's principle. This algorithm samples most of its solutions within prominent search domains and is equipped with a self-adaptive mechanism to control the…

Optimization and Control · Mathematics 2021-03-30 Mahmoud Shaqfa , Katrin Beyer

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

Optimal Experiment Design for parameter estimation in water networks has been traditionally formulated to maximize either hydraulic model accuracy or spatial coverage. Because a unique sensor configuration that optimizes both objectives may…

Optimization and Control · Mathematics 2023-02-08 Filippo Pecci , Ivan Stoianov

For deterministic optimization, line-search methods augment algorithms by providing stability and improved efficiency. We adapt a classical backtracking Armijo line-search to the stochastic optimization setting. While traditional…

Optimization and Control · Mathematics 2018-07-24 Courtney Paquette , Katya Scheinberg

The article proposes a heuristic approximation approach to the bin packing problem under multiple objectives. In addition to the traditional objective of minimizing the number of bins, the heterogeneousness of the elements in each bin is…

Artificial Intelligence · Computer Science 2008-09-05 Martin Josef Geiger

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

This paper studies a class of multi-robot coordination problems where a team of robots aim to reach their goal regions with minimum time and avoid collisions with obstacles and other robots. A novel numerical algorithm is proposed to…

Optimization and Control · Mathematics 2020-09-02 Guoxiang Zhao , Minghui Zhu

A number of optimization approaches have been proposed for optimizing nonconvex objectives (e.g. deep learning models), such as batch gradient descent, stochastic gradient descent and stochastic variance reduced gradient descent. Theory…

Machine Learning · Computer Science 2019-05-15 Jia Bi , Steve R. Gunn

We introduce adaptive sampling methods for stochastic programs with deterministic constraints. First, we propose and analyze a variant of the stochastic projected gradient method where the sample size used to approximate the reduced…

Optimization and Control · Mathematics 2023-02-07 Florian Beiser , Brendan Keith , Simon Urbainczyk , Barbara Wohlmuth

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

Machine Learning · Computer Science 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Population-based evolutionary algorithms have great potential to handle multiobjective optimisation problems. However, these algorithms depends largely on problem characteristics, and there is a need to improve their performance for a wider…

Neural and Evolutionary Computing · Computer Science 2019-10-17 Shouyong Jiang , Hongru Li , Jinglei Guo , Mingjun Zhong , Shengxiang Yang , Marcus Kaiser , Natalio Krasnogor

A method is presented to exploit adaptive integration algorithms using importance sampling, like VEGAS, for the task of scanning theoretical predictions depending on a multi-dimensional parameter space. Usually, a parameter scan is…

High Energy Physics - Phenomenology · Physics 2010-04-05 Oliver Brein