English
Related papers

Related papers: Online Learning for Incentive-Based Demand Respons…

200 papers

We study the online traveling repairperson problem on a line within the recently proposed learning-augmented framework, which provides predictions on the requests to be served via machine learning. In the original model (with no…

Data Structures and Algorithms · Computer Science 2026-01-21 Swapnil Guragain , Gokarna Sharma

Demand Response (DR) has a widely recognized potential for improving grid stability and reliability while reducing customers energy bills. However, the conventional DR techniques come with several shortcomings, such as inability to handle…

Systems and Control · Electrical Eng. & Systems 2020-09-24 Amin Shojaeighadikolaei , Arman Ghasemi , Kailani R. Jones , Alexandru G. Bardas , Morteza Hashemi , Reza Ahmadi

We address the problem of simultaneously learning and control in an online receding horizon control setting. We consider the control of an unknown linear dynamical system with general cost functions and affine constraints on the control…

Optimization and Control · Mathematics 2022-11-02 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

Machine Learning · Computer Science 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Offline reinforcement learning algorithms promise to be applicable in settings where a fixed dataset is available and no new experience can be acquired. However, such formulation is inevitably offline-data-hungry and, in practice,…

Machine Learning · Computer Science 2022-03-15 Jinxin Liu , Hongyin Zhang , Donglin Wang

The significant presence of demand charges in electric bills motivates large-load customers to utilize energy storage to reduce the peak procurement from the grid. We herein study the problem of energy storage allocation for peak…

Data Structures and Algorithms · Computer Science 2022-09-20 Yanfang Mo , Qiulin Lin , Minghua Chen , Si-Zhao Joe Qin

In order for an e-commerce platform to maximize its revenue, it must recommend customers items they are most likely to purchase. However, the company often has business constraints on these items, such as the number of each item in stock.…

Optimization and Control · Mathematics 2019-11-19 Andrea Boskovic , Qinyi Chen , Dominik Kufel , Zijie Zhou

We study the problem of online learning and online regret minimization when samples are drawn from a general unknown non-stationary process. We introduce the concept of a dynamic changing process with cost $K$, where the conditional…

Machine Learning · Computer Science 2023-11-14 Changlong Wu , Ananth Grama , Wojciech Szpankowski

We adopt the perspective of an aggregator, which seeks to coordinate its purchase of demand reductions from a fixed group of residential electricity customers, with its sale of the aggregate demand reduction in a two-settlement wholesale…

Systems and Control · Computer Science 2017-12-29 Kia Khezeli , Eilyan Bitar

The rise of big data analytics has automated the decision-making of companies and increased supply chain agility. In this paper, we study the supply chain contract design problem faced by a data-driven supplier who needs to respond to the…

Machine Learning · Computer Science 2022-11-10 Xuejun Zhao , Ruihao Zhu , William B. Haskell

Preference-based reinforcement learning (PbRL) can help avoid sophisticated reward designs and align better with human intentions, showing great promise in various real-world applications. However, obtaining human feedback for preferences…

Machine Learning · Computer Science 2026-04-06 Yiqin Yang , Hao Hu , Yihuan Mao , Jin Zhang , Chengjie Wu , Yuhua Jiang , Xu Yang , Runpeng Xie , Yi Fan , Bo Liu , Yang Gao , Bo Xu , Chongjie Zhang

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

We define an online learning and optimization problem with discrete and irreversible decisions contributing toward a coverage target. In each period, a decision-maker selects facilities to open, receives information on the success of each…

Machine Learning · Computer Science 2026-03-06 Alexandre Jacquillat , Michael Lingzhi Li

We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a…

Machine Learning · Computer Science 2021-04-21 Alfonso Lobos , Paul Grigas , Zheng Wen

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

Machine Learning · Computer Science 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

Demand-Response (DR) programs, whereby users of an electricity network are encouraged by economic incentives to rearrange their consumption in order to reduce production costs, are envisioned to be a key feature of the smart grid paradigm.…

Optimization and Control · Mathematics 2016-12-15 Alberto Benegiamo , Patrick Loiseau , Giovanni Neglia

In this work, we propose an adversarial learning method for reward estimation in reinforcement learning (RL) based task-oriented dialog models. Most of the current RL based task-oriented dialog systems require the access to a reward signal…

Computation and Language · Computer Science 2018-05-31 Bing Liu , Ian Lane

We study offline-online reinforcement learning in linear mixture Markov decision processes (MDPs) under environment shift. In the offline phase, data are collected by an unknown behavior policy and may come from a mismatched environment,…

Machine Learning · Computer Science 2026-04-15 Zhongjun Zhang , Sean R. Sinclair

Demand Response (DR) programs serve to reduce the consumption of electricity at times when the supply is scarce and expensive. The utility informs the aggregator of an anticipated DR event. The aggregator calls on a subset of its pool of…

Computer Science and Game Theory · Computer Science 2019-05-01 Deepan Muthirayan , Dileep Kalathil , Kameshwar Poolla , Pravin Varaiya