English
Related papers

Related papers: Three-Way Trade-Off in Multi-Objective Learning: O…

200 papers

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

Transmission grid congestion increases as the electrification of various sectors requires transmitting more power. Topology control, through substation reconfiguration, can reduce congestion but its potential remains under-exploited in…

Machine Learning · Computer Science 2025-05-02 Thomas Lautenbacher , Ali Rajaei , Davide Barbieri , Jan Viebahn , Jochen L. Cremer

Recent multimodal large language models (MLLMs) perform strongly on general visual understanding, diagram and chart reasoning, and document-centric perception. However, these abilities are learned from heterogeneous supervision sources with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Guowei Tang

One common approach to solve multi-objective reinforcement learning (MORL) problems is to extend conventional Q-learning by using vector Q-values in combination with a utility function. However issues can arise with this approach in the…

Machine Learning · Computer Science 2024-01-09 Kewen Ding , Peter Vamplew , Cameron Foale , Richard Dazeley

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

Machine Learning · Computer Science 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

Multimodal Domain Generalization (MMDG) leverages the complementary strengths of multiple modalities to enhance model generalization on unseen domains. A central challenge in multimodal learning is optimization imbalance, where modalities…

Machine Learning · Computer Science 2026-03-17 Hongzhao Li , Guohao Shen , Shupan Li , Mingliang Xu , Muhammad Haris Khan

Multi-Objective Reinforcement Learning (MORL) is a generalization of traditional Reinforcement Learning (RL) that aims to optimize multiple, often conflicting objectives simultaneously rather than focusing on a single reward. This approach…

Machine Learning · Computer Science 2025-08-15 Davide Guidobene , Lorenzo Benedetti , Diego Arapovic

Real world problems always have different multiple solutions. For instance, optical engineers need to tune the recording parameters to get as many optimal solutions as possible for multiple trials in the varied-line-spacing holographic…

Neural and Evolutionary Computing · Computer Science 2015-08-04 Ka-Chun Wong

Multi-objective optimization studies the process of seeking multiple competing desiderata in some operation. Solution techniques highlight marginal tradeoffs associated with weighing one objective over others. In this paper, we consider…

Optimization and Control · Mathematics 2026-01-05 Allahkaram Shafiei , Jakub Marecek

Many advances that have improved the robustness and efficiency of deep reinforcement learning (RL) algorithms can, in one way or another, be understood as introducing additional objectives or constraints in the policy optimization step.…

The goal of multi-task learning is to enable more efficient learning than single task learning by sharing model structures for a diverse set of tasks. A standard multi-task learning objective is to minimize the average loss across all…

Machine Learning · Computer Science 2024-02-22 Bo Liu , Xingchao Liu , Xiaojie Jin , Peter Stone , Qiang Liu

Multimodal learning (MML) is significantly constrained by modality imbalance, leading to suboptimal performance in practice. While existing approaches primarily focus on balancing the learning of different modalities to address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 QingYuan Jiang , Longfei Huang , Yang Yang

With the continuous improvement of the performance of object detectors via advanced model architectures, imbalance problems in the training process have received more attention. It is a common paradigm in object detection frameworks to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yihao Luo , Xiang Cao , Juntao Zhang , Peng Cheng , Tianjiang Wang , Qi Feng

Multi-Modal Learning (MML) integrates information from diverse modalities to improve predictive accuracy. While existing optimization strategies have made significant strides by mitigating gradient direction conflicts, we revisit MML from a…

Machine Learning · Computer Science 2026-02-09 Peizheng Guo , Jingyao Wang , Wenwen Qiang , Jiahuan Zhou , Changwen Zheng , Gang Hua

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Reinforcement Learning (RL) robot controllers usually aggregate many task objectives into one scalar reward. While large-scale proximal policy optimisation (PPO) has enabled impressive results such as robust robot locomotion in the real…

Robotics · Computer Science 2025-09-19 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard

Adapting model parameters to incoming streams of data is a crucial factor to deep learning scalability. Interestingly, prior continual learning strategies in online settings inadvertently anchor their updated parameters to a local parameter…

Machine Learning · Computer Science 2022-09-30 Siddhartha Datta , Nigel Shadbolt

Multimodal learning, while contributing to numerous success stories across various fields, faces the challenge of prohibitively expensive manual annotation. To address the scarcity of annotated data, a popular solution is unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jun Sun , Xinxin Zhang , Simin Hong , Jian Zhu , Xiang Gao

The Quality-Diversity (QD) optimization aims to discover a collection of high-performing solutions that simultaneously exhibit diverse behaviors within a user-defined behavior space. This paradigm has stimulated significant research…

Machine Learning · Computer Science 2026-02-03 Xi Lin , Ping Guo , Yilu Liu , Qingfu Zhang , Jianyong Sun

A multi-modal multi-objective optimization problem is a special kind of multi-objective optimization problem with multiple Pareto subsets. In this paper, we propose an efficient multi-modal multi-objective optimization algorithm based on…

Neural and Evolutionary Computing · Computer Science 2020-04-22 Yiming Peng , Hisao Ishibuchi