中文
相关论文

相关论文: Multiobjectivization of Local Search: Single-Objec…

200 篇论文

Stochastic Gradient Descent-Ascent (SGDA) is one of the most prominent algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. The success of the method led to…

最优化与控制 · 数学 2023-03-09 Aleksandr Beznosikov , Eduard Gorbunov , Hugo Berard , Nicolas Loizou

This paper considers the problem of online optimization where the objective function is time-varying. In particular, we extend coordinate descent type algorithms to the online case, where the objective function varies after a finite number…

最优化与控制 · 数学 2024-04-26 Yankai Lin , Iman Shames , Dragan Nešić

Accelerated proximal gradient methods, which are also called fast iterative shrinkage-thresholding algorithms (FISTA) are known to be efficient for many applications. Recently, Tanabe et al. proposed an extension of FISTA for multiobjective…

最优化与控制 · 数学 2023-06-02 Yuki Nishimura , Ellen H. Fukuda , Nobuo Yamashita

In practical optimisation the dominant characteristics of the problem are often not known prior. Therefore, there is a need to develop general solvers as it is not always possible to tailor a specialised approach to each application. The…

神经与进化计算 · 计算机科学 2021-04-23 P. A. Grudniewski , A. J. Sobey

Sequential decision-making problems with multiple objectives arise naturally in practice and pose unique challenges for research in decision-theoretic planning and learning, which has largely focused on single-objective settings. This…

人工智能 · 计算机科学 2014-02-05 Diederik Marijn Roijers , Peter Vamplew , Shimon Whiteson , Richard Dazeley

Placement is crucial in the physical design, as it greatly affects power, performance, and area metrics. Recent advancements in analytical methods, such as DREAMPlace, have demonstrated impressive performance in global placement. However,…

机器学习 · 计算机科学 2024-02-29 Ke Xue , Xi Lin , Yunqi Shi , Shixiong Kai , Siyuan Xu , Chao Qian

Momentum Stochastic Gradient Descent (MSGD) algorithm has been widely applied to many nonconvex optimization problems in machine learning, e.g., training deep neural networks, variational Bayesian inference, and etc. Despite its empirical…

机器学习 · 计算机科学 2021-03-09 Tianyi Liu , Zhehui Chen , Enlu Zhou , Tuo Zhao

In this paper, we investigate the possibility of improving the performance of multi-objective optimization solution approaches using machine learning techniques. Specifically, we focus on multi-objective binary linear programs and employ…

机器学习 · 统计学 2019-01-31 Alvaro Sierra-Altamiranda , Hadi Charkhgard , Iman Dayarian , Ali Eshragh , Sorna Javadi

Learning to optimize - the idea that we can learn from data algorithms that optimize a numerical criterion - has recently been at the heart of a growing number of research efforts. One of the most challenging issues within this approach is…

机器学习 · 计算机科学 2018-02-21 Louis Faury , Flavian Vasile

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

神经与进化计算 · 计算机科学 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

We propose a descent subgradient algorithm for unconstrained nonsmooth nonconvex multiobjective optimization problems. To find a descent direction, we present an iterative process that efficiently approximates the Goldstein subdifferential…

最优化与控制 · 数学 2024-06-24 Morteza Maleknia , Majid Soleimani-damaneh

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

最优化与控制 · 数学 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

Real-world problems are often comprised of many objectives and require solutions that carefully trade-off between them. Current approaches to many-objective optimization often require challenging assumptions, like knowledge of the…

神经与进化计算 · 计算机科学 2023-07-07 Jackson Dean , Nick Cheney

Distributed optimization often requires finding the minimum of a global objective function written as a sum of local functions. A group of agents work collectively to minimize the global function. We study a continuous-time decentralized…

最优化与控制 · 数学 2020-11-25 Youbang Sun , Shahin Shahrampour

Multi-objective optimization is a common problem in practical applications, and multi-objective evolutionary algorithm (MOEA) is considered as one of the effective methods to solve these problems. However, their randomness sometimes…

神经与进化计算 · 计算机科学 2024-10-04 Wanyi Liu , Long Chen , Zhenzhou Tang

Neural networks have recently been employed as material discretizations within adjoint optimization frameworks for inverse problems and topology optimization. While advantageous regularization effects and better optima have been found for…

机器学习 · 计算机科学 2024-07-26 Leon Herrmann , Ole Sigmund , Viola Muning Li , Christian Vogl , Stefan Kollmannsberger

Multi-objective optimization problems whose objectives have different evaluation costs are commonly seen in the real world. Such problems are now known as multi-objective optimization problems with heterogeneous objectives (HE-MOPs). So…

神经与进化计算 · 计算机科学 2022-08-26 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

Following the introduction of Adam, several novel adaptive optimizers for deep learning have been proposed. These optimizers typically excel in some tasks but may not outperform Adam uniformly across all tasks. In this work, we introduce…

机器学习 · 计算机科学 2024-06-18 Kaan Ozkara , Can Karakus , Parameswaran Raman , Mingyi Hong , Shoham Sabach , Branislav Kveton , Volkan Cevher

The paper considers the problem of network-based computation of global minima in smooth nonconvex optimization problems. It is known that distributed gradient-descent-type algorithms can achieve convergence to the set of global minima by…

最优化与控制 · 数学 2019-10-24 Brian Swenson , Anirudh Sridhar , H. Vincent Poor

Multiobjective optimization problems (MOPs) are prevalent in machine learning, with applications in multi-task learning, learning under fairness or robustness constraints, etc. Instead of reducing multiple objective functions into a scalar…

数学软件 · 计算机科学 2024-10-14 Xiaoyuan Zhang , Liang Zhao , Yingying Yu , Xi Lin , Yifan Chen , Han Zhao , Qingfu Zhang