English
Related papers

Related papers: Expert-Calibrated Learning for Online Optimization…

200 papers

In this paper, we investigate the framework of Online Convex Optimization (OCO) for online learning. OCO offers a very powerful online learning framework for many applications. In this context, we study a specific framework of OCO called…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

This paper presents an evolutionary framework for the training of large language models(LLM). The models are divided into several experts(sub-networks), which have the same structure but different parameter values. Only one expert is…

Machine Learning · Computer Science 2025-09-30 Yingshi Chen

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-24 Qing Han , Shusen Yang , Xuebin Ren , Cong Zhao , Jingqi Zhang , Xinyu Yang

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

Machine Learning · Computer Science 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

Many problems, such as online ad display, can be formulated as online bipartite matching. The crucial challenge lies in the nature of sequentially-revealed online item information, based on which we make irreversible matching decisions at…

Machine Learning · Computer Science 2023-06-02 Pengfei Li , Jianyi Yang , Shaolei Ren

A compelling use case of offline reinforcement learning (RL) is to obtain a policy initialization from existing datasets followed by fast online fine-tuning with limited interaction. However, existing offline RL methods tend to behave…

Machine Learning · Computer Science 2024-01-23 Mitsuhiko Nakamoto , Yuexiang Zhai , Anikait Singh , Max Sobol Mark , Yi Ma , Chelsea Finn , Aviral Kumar , Sergey Levine

Learning to Optimize (L2O) approaches, including algorithm unrolling, plug-and-play methods, and hyperparameter learning, have garnered significant attention and have been successfully applied to the Alternating Direction Method of…

Optimization and Control · Mathematics 2024-09-27 Ling Liang , Cameron Austin , Haizhao Yang

Learned optimizers are powerful alternatives to hand-designed update rules like Adam, yet they have seen limited practical adoption since they often fail to meta-generalize beyond their training distribution and incur high meta-training…

Machine Learning · Computer Science 2026-02-24 Abhinav Moudgil , Boris Knyazev , Eugene Belilovsky

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

Machine Learning · Computer Science 2023-06-21 Jun Yuan , Rui Zhang

Learning to optimize (L2O) is an emerging technique to solve mathematical optimization problems with learning-based methods. Although with great success in many real-world scenarios such as wireless communications, computer networks, and…

Machine Learning · Computer Science 2025-06-18 Qingyu Song , Wei Lin , Juncheng Wang , Hong Xu

Resource allocation in distributed and networked systems such as the Cloud is becoming increasingly flexible, allowing these systems to dynamically adjust toward the workloads they serve, in a demand-aware manner. Online balanced…

Data Structures and Algorithms · Computer Science 2024-10-24 Harald Räcke , Stefan Schmid , Ruslan Zabrodin

Calibration allows predictions to be reliably interpreted as probabilities by decision makers. We propose a decision-theoretic calibration error, the Calibration Decision Loss (CDL), defined as the maximum improvement in decision payoff…

Machine Learning · Computer Science 2024-10-14 Lunjia Hu , Yifan Wu

Online optimization with multiple budget constraints is challenging since the online decisions over a short time horizon are coupled together by strict inventory constraints. The existing manually-designed algorithms cannot achieve…

Machine Learning · Computer Science 2023-03-08 Jianyi Yang , Shaolei Ren

Machine Learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption by the level of trust that models afford users. Human vs. machine performance…

We consider the online convex optimization (OCO) problem with quadratic and linear switching cost in the limited information setting, where an online algorithm can choose its action using only gradient information about the previous…

Machine Learning · Computer Science 2023-10-19 Spandan Senapati , Rahul Vaze

Recent years have witnessed a rapid growth of distributed machine learning (ML) frameworks, which exploit the massive parallelism of computing clusters to expedite ML training. However, the proliferation of distributed ML frameworks also…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-16 Menglu Yu , Jia Liu , Chuan Wu , Bo Ji , Elizabeth S. Bentley

A critical factor in adopting machine learning for time-sensitive financial tasks is computational speed, including model training and inference. This paper demonstrates that a broad class of such problems, especially those previously…

Computational Finance · Quantitative Finance 2025-05-27 Liexin Cheng , Xue Cheng , Shuaiqiang Liu

We consider Online Convex Optimization (OCO) in the setting where the costs are $m$-strongly convex and the online learner pays a switching cost for changing decisions between rounds. We show that the recently proposed Online Balanced…

Machine Learning · Computer Science 2019-04-05 Gautam Goel , Adam Wierman

Real-world applications involve various discrete optimization problems. Designing a specialized optimizer for each of these problems is challenging, typically requiring significant domain knowledge and human efforts. Hence, developing…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Shengcai Liu , Zhiyuan Wang , Yew-Soon Ong , Xin Yao , Ke Tang