English
Related papers

Related papers: Bi-Level Decision-Focused Causal Learning for Larg…

200 papers

In machine learning, the goal of multi-task learning (MTL) is to optimize multiple objectives together. Recent works, for example, Multiple Gradient Descent Algorithm (MGDA) and its variants, show promising results with dynamically adjusted…

Machine Learning · Computer Science 2026-03-10 Xuxing Chen , Yun He , Jiayi Xu , Minhui Huang , Xiaoyi Liu , Boyang Liu , Fei Tian , Xiaohan Wei , Rong Jin , Sem Park , Bo Long , Xue Feng

This paper deals with optimal policy learning (OPL) with observational data, i.e. data-driven optimal decision-making, in multi-action (or multi-arm) settings, where a finite set of decision options is available. It is organized in three…

Machine Learning · Statistics 2024-04-01 Giovanni Cerulli

Multimodal Contrastive Learning (MCL) advances in aligning different modalities and generating multimodal representations in a joint space. By leveraging contrastive learning across diverse modalities, large-scale multimodal data enhances…

Machine Learning · Computer Science 2025-09-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Multi-objective reinforcement learning (MORL) is effective for multi-echelon combinatorial supply chain optimisation, where tasks involve high dimensionality, uncertainty, and competing objectives. However, its deployment in dynamic…

Machine Learning · Computer Science 2026-03-09 Rifny Rachman , Josh Tingey , Richard Allmendinger , Wei Pan , Pradyumn Shukla , Bahrul Ilmi Nasution

Bilevel optimization recently has attracted increased interest in machine learning due to its many applications such as hyper-parameter optimization and meta learning. Although many bilevel methods recently have been proposed, these methods…

Optimization and Control · Mathematics 2023-02-21 Feihu Huang , Junyi Li , Shangqian Gao

Recent years have witnessed enormous progress of online learning. However, a major challenge on the road to artificial agents is concept drift, that is, the data probability distribution would change where the data instance arrives…

Machine Learning · Computer Science 2022-01-26 Ya-nan Han , Jian-wei Liu , Bing-biao Xiao , Xin-Tan Wang , Xiong-lin Luo

In this paper, we consider a Bayesian bi-level variable selection problem in high-dimensional regressions. In many practical situations, it is natural to assign group membership to each predictor. Examples include that genetic variants can…

Applications · Statistics 2018-03-29 Mingxuan Cai , Mingwei Dai , Jingsi Ming , Heng Peng , Jin Liu , Can Yang

Multi-task learning (MTL) has been widely adopted for its ability to simultaneously learn multiple tasks. While existing gradient manipulation methods often yield more balanced solutions than simple scalarization-based approaches, they…

Machine Learning · Computer Science 2025-09-29 Peiyao Xiao , Chaosheng Dong , Shaofeng Zou , Kaiyi Ji

Bilevel optimization is a popular two-level hierarchical optimization, which has been widely applied to many machine learning tasks such as hyperparameter learning, meta learning and continual learning. Although many bilevel optimization…

Optimization and Control · Mathematics 2023-11-21 Feihu Huang

Learning algorithms can be significantly improved by routing complex or uncertain inputs to specialized experts, balancing accuracy with computational cost. This approach, known as learning to defer, is essential in domains like natural…

Machine Learning · Computer Science 2026-05-01 Corinna Cortes , Anqi Mao , Mehryar Mohri , Yutao Zhong

Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to…

Optimization and Control · Mathematics 2021-03-22 Farzad Yousefian

Bi-level optimization (BO) has become a fundamental mathematical framework for addressing hierarchical machine learning problems. As deep learning models continue to grow in size, the demand for scalable bi-level optimization solutions has…

Machine Learning · Computer Science 2024-12-25 Qianli Shen , Yezhen Wang , Zhouhao Yang , Xiang Li , Haonan Wang , Yang Zhang , Jonathan Scarlett , Zhanxing Zhu , Kenji Kawaguchi

Marketing optimization, commonly formulated as an online budget allocation problem, has emerged as a pivotal factor in driving user growth. Most existing research addresses this problem by following the principle of 'first predict then…

Machine Learning · Computer Science 2025-06-03 Xiaohan Wang , Yu Zhang , Guibin Jiang , Bing Cheng , Wei Lin

Recently, Optimization-Derived Learning (ODL) has attracted attention from learning and vision areas, which designs learning models from the perspective of optimization. However, previous ODL approaches regard the training and…

Machine Learning · Computer Science 2022-06-17 Risheng Liu , Xuan Liu , Shangzhi Zeng , Jin Zhang , Yixuan Zhang

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

We consider the problem of learning fair policies for multi-stage selection problems from observational data. This problem arises in several high-stakes domains such as company hiring, loan approval, or bail decisions where outcomes (e.g.,…

Machine Learning · Computer Science 2023-12-21 Zhuangzhuang Jia , Grani A. Hanasusanto , Phebe Vayanos , Weijun Xie

In contrast to offline working fashions, two research paradigms are devised for online learning: (1) Online Meta Learning (OML) learns good priors over model parameters (or learning to learn) in a sequential setting where tasks are revealed…

Machine Learning · Computer Science 2021-08-24 Chen Zhao , Feng Chen , Bhavani Thuraisingham

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva

Task Free online continual learning (TF-CL) is a challenging problem where the model incrementally learns tasks without explicit task information. Although training with entire data from the past, present as well as future is considered as…

Machine Learning · Computer Science 2024-02-20 Byung Hyun Lee , Min-hwan Oh , Se Young Chun

Multi-view clustering has shown to be an effective method for analyzing underlying patterns in multi-view data. The performance of clustering can be improved by learning the consistency and complementarity between multi-view features,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shihao Dong , Yuhui Zheng , Huiying Xu , Xinzhong Zhu