English
Related papers

Related papers: Follow the bisector: a simple method for multi-obj…

200 papers

Support vector machines (SVMs) are popular learning algorithms to deal with binary classification problems. They traditionally assume equal misclassification costs for each class; however, real-world problems may have an uneven class…

Machine Learning · Computer Science 2022-04-22 Alejandro Rosales-Pérez , Salvador García , Francisco Herrera

Multi-label learning studies the problem where an instance is associated with a set of labels. By treating single-label learning problem as one task, the multi-label learning problem can be casted as solving multiple related tasks…

Machine Learning · Computer Science 2019-11-20 Lu Bai , Yew-Soon Ong , Tiantian He , Abhishek Gupta

Optimizing machine learning algorithms that are used to solve the objective function has been of great interest. Several approaches to optimize common algorithms, such as gradient descent and stochastic gradient descent, were explored. One…

Machine Learning · Computer Science 2022-10-06 Hilal AlQuabeh , Farha AlBreiki , Dilshod Azizov

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

Optimization problems in disciplines such as machine learning are commonly solved with iterative methods. Gradient descent algorithms find local minima by moving along the direction of steepest descent while Newton's method takes into…

Quantum Physics · Physics 2018-08-20 Patrick Rebentrost , Maria Schuld , Leonard Wossnig , Francesco Petruccione , Seth Lloyd

We study the problem of learning similarity by using nonlinear embedding models (e.g., neural networks) from all possible pairs. This problem is well-known for its difficulty of training with the extreme number of pairs. For the special…

Machine Learning · Statistics 2021-06-16 Bowen Yuan , Yu-Sheng Li , Pengrui Quan , Chih-Jen Lin

Deep learning approaches, known for their ability to model complex relationships and fast execution, are increasingly being applied to solve large optimization problems. However, existing methods often face challenges in simultaneously…

Optimization and Control · Mathematics 2025-12-16 Zisheng Zhou , Dengyu Zheng , Zirui Chen , Shixiang Chen

In this paper, the elliptic PDE-constrained optimization problem with box constraints on the control is studied. To numerically solve the problem, we apply the 'optimize-discretize-optimize' strategy. Specifically, the alternating direction…

Optimization and Control · Mathematics 2019-08-14 Xiaotong Chen , Xiaoliang Song , Zixuan Chen , Bo Yu

Approximation of subdifferentials is one of the main tasks when computing descent directions for nonsmooth optimization problems. In this article, we propose a bisection method for weakly lower semismooth functions which is able to compute…

Optimization and Control · Mathematics 2024-02-07 Bennet Gebken

We propose an Adagrad-like algorithm for multi-objective unconstrained optimization that relies on the computation of a common descent direction only. Unlike classical local algorithms for multi-objective optimization, our approach does not…

Optimization and Control · Mathematics 2026-02-06 Marianna De Santis , Gabriele Eichfelder , Margherita Porcelli

This paper considers decentralized dynamic optimization problems where nodes of a network try to minimize a sequence of time-varying objective functions in a real-time scheme. At each time slot, nodes have access to different summands of an…

Optimization and Control · Mathematics 2016-03-29 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

Multi-objective optimization (MOO) has become an influential framework in many machine learning problems with multiple objectives such as learning with multiple criteria and multi-task learning (MTL). In this paper, we propose a new…

Machine Learning · Computer Science 2023-11-30 Peiyao Xiao , Hao Ban , Kaiyi Ji

Mixed linear regression involves the recovery of two (or more) unknown vectors from unlabeled linear measurements; that is, where each sample comes from exactly one of the vectors, but we do not know which one. It is a classic problem, and…

Machine Learning · Statistics 2014-02-10 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

Recently, a deep reinforcement learning method is proposed to solve multiobjective optimization problem. In this method, the multiobjective optimization problem is decomposed to a number of single-objective optimization subproblems and all…

Neural and Evolutionary Computing · Computer Science 2020-02-14 Hong Wu , Jiahai Wang , Zizhen Zhang

In this article we develop a gradient-based algorithm for the solution of multiobjective optimization problems with uncertainties. To this end, an additional condition is derived for the descent direction in order to account for…

Optimization and Control · Mathematics 2018-08-02 Sebastian Peitz , Michael Dellnitz

In this paper, we develop a new decomposition technique for solving bi-objective linear programming problems. The proposed methodology combines the bi-objective simplex algorithm with Benders decomposition and can be used to obtain a…

Optimization and Control · Mathematics 2024-09-02 Andrea Raith , Richard Lusby , Ali Akbar Sohrabi Yousefkhan

Solving constrained optimization problems by multi-objective evolutionary algorithms has scored tremendous achievements in the last decade. Standard multi-objective schemes usually aim at minimizing the objective function and also the…

Neural and Evolutionary Computing · Computer Science 2015-10-02 Tao Xu , Jun He

In this paper, we develop a global descent method for non-convex multi-objective optimization problems. The proposed approach builds upon foundational concepts from single-objective global descent techniques while removing the need for…

Optimization and Control · Mathematics 2025-07-31 Bikram Adhikary , Md Abu Talhamainuddin Ansary , Savin Treanta

Recent literature has demonstrated promising results for training Generative Adversarial Networks by employing a set of discriminators, in contrast to the traditional game involving one generator against a single adversary. Such methods…

Machine Learning · Computer Science 2019-01-28 Isabela Albuquerque , João Monteiro , Thang Doan , Breandan Considine , Tiago Falk , Ioannis Mitliagkas

We introduce the first learning-based dense matching algorithm, termed Equirectangular Projection-Oriented Dense Kernelized Feature Matching (EDM), specifically designed for omnidirectional images. Equirectangular projection (ERP) images,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dongki Jung , Jaehoon Choi , Yonghan Lee , Somi Jeong , Taejae Lee , Dinesh Manocha , Suyong Yeon