English
Related papers

Related papers: Reinforcement Learning Based Bidding Framework wit…

200 papers

The battery energy storage system (BESS) has immense potential for enhancing grid reliability and security through its participation in the electricity market. BESS often seeks various revenue streams by taking part in multiple markets to…

Systems and Control · Electrical Eng. & Systems 2024-03-01 Jinhao Li , Changlong Wang , Yanru Zhang , Hao Wang

This paper develops a novel multi-agent reinforcement learning (MARL) framework for reinsurance treaty bidding, addressing long-standing inefficiencies in traditional broker-mediated placement processes. We pose the core research question:…

Artificial Intelligence · Computer Science 2026-03-24 Stella C. Dong , James R. Finlay

This paper explores the application of a reinforcement learning (RL) framework using the Q-Learning algorithm to enhance dynamic pricing strategies in the retail sector. Unlike traditional pricing methods, which often rely on static demand…

Machine Learning · Computer Science 2024-11-28 Mohit Apte , Ketan Kale , Pranav Datar , Pratiksha Deshmukh

Real-time bidding (RTB) has become a major paradigm of display advertising. Each ad impression generated from a user visit is auctioned in real time, where demand-side platform (DSP) automatically provides bid price usually relying on the…

Information Retrieval · Computer Science 2022-12-26 Zhimeng Jiang , Kaixiong Zhou , Mi Zhang , Rui Chen , Xia Hu , Soo-Hyun Choi

This paper proposes a novel computationally efficient algorithm for optimal sizing of Battery Energy Storage Systems (BESS) considering renewable energy bidding strategies. Unlike existing two-stage methods, our algorithm enables the…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Taiyo Mantani , Hikaru Hoshino , Tomonari Kanazawa , Eiko Furutani

In display ad auctions of Real-Time Bid-ding (RTB), a typical Demand-Side Platform (DSP)bids based on the predicted probability of click and conversion right after an ad impression. Recent studies find such a strategy is suboptimal and…

Information Retrieval · Computer Science 2022-03-01 Daisuke Moriwaki , Yuta Hayakawa , Akira Matsui , Yuta Saito , Isshu Munemasa , Masashi Shibata

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existing approaches are…

Artificial Intelligence · Computer Science 2022-09-14 Yining Lu , Changjie Lu , Naina Bandyopadhyay , Manoj Kumar , Gaurav Gupta

Maximizing utility with a budget constraint is the primary goal for advertisers in real-time bidding (RTB) systems. The policy maximizing the utility is referred to as the optimal bidding strategy. Earlier works on optimal bidding strategy…

Machine Learning · Computer Science 2020-04-02 Aritra Ghosh , Saayan Mitra , Somdeb Sarkhel , Viswanathan Swaminathan

The realm of High-Frequency Trading (HFT) is characterized by rapid decision-making processes that capitalize on fleeting market inefficiencies. As the financial markets become increasingly competitive, there is a pressing need for…

Trading and Market Microstructure · Quantitative Finance 2023-11-21 Soumyadip Sarkar

Real-time bidding (RTB) plays a pivotal role in online advertising ecosystems. Advertisers employ strategic bidding to optimize their advertising impact while adhering to various financial constraints, such as the return-on-investment (ROI)…

Artificial Intelligence · Computer Science 2024-12-30 Shenghong He , Chao Yu

Finding optimal bidding strategies for generation units in electricity markets would result in higher profit. However, it is a challenging problem due to the system uncertainty which is due to the unknown other generation units' strategies.…

Artificial Intelligence · Computer Science 2022-08-15 Pegah Rokhforoz , Olga Fink

In replacing fossil fuels with renewable energy resources for carbon neutrality, the unbalanced resource production of intermittent wind and photovoltaic (PV) power is a critical issue for peer-to-peer (P2P) power trading. To address this…

Machine Learning · Computer Science 2023-01-03 Sangkeum Lee , Sarvar Hussain Nengroo , Hojun Jin , Taewook Heo , Yoonmee Doh , Chungho Lee , Dongsoo Har

In real time electricity markets, the objective of generation companies while bidding is to maximize their profit. The strategies for learning optimal bidding have been formulated through game theoretical approaches and stochastic…

Artificial Intelligence · Computer Science 2021-01-08 Jahnvi Patel , Devika Jay , Balaraman Ravindran , K. Shanti Swarup

This paper addresses a critical challenge in the high-speed passenger railway industry: designing effective dynamic pricing strategies in the context of competing and cooperating operators. To address this, a multi-agent reinforcement…

Traditional bulk load flexibility options, such as load shifting and load curtailment, for managing uncertainty in power markets limit the diversity of options and ignore the preferences of the individual loads, thus reducing efficiency and…

Systems and Control · Electrical Eng. & Systems 2021-12-20 Majid Majidi , Deepan Muthirayan , Masood Parvania , Pramod P. Khargonekar

The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the…

Networking and Internet Architecture · Computer Science 2025-04-23 Michael Doherty , Robin Matzner , Rasoul Sadeghi , Polina Bayvel , Alejandra Beghelli

Real-time bidding (RTB) has become one of the largest online advertising markets in the world. Today the bid price per ad impression is typically decided by the expected value of how it can lead to a desired action event (e.g., registering…

Computer Science and Game Theory · Computer Science 2016-02-16 Jian Xu , Xuhui Shao , Jianjie Ma , Kuang-chih Lee , Hang Qi , Quan Lu

We study the allocation of reconfigurable intelligent surfaces (RISs) in a multi-cell wireless network, where base stations compete for control of shared RIS units deployed at the cell edges. These RISs, provided by an independent operator,…

Networking and Internet Architecture · Computer Science 2026-03-06 Martin Mark Zan , Stefan Schwarz

Reinforcement learning agent-based simulation (RL-ABS) has become an important tool for electricity market mechanism analysis and evaluation. In the modeling of monotone, bounded, multi-segment stepwise bids, existing methods typically let…

Artificial Intelligence · Computer Science 2026-04-14 Zunnan Xu , Zhaoxia Jing , Zhanhua Pan

The increase in renewable energy on the consumer side gives place to new dynamics in the energy grids. Participants in a microgrid can produce energy and trade it with their peers (peer-to-peer) with the permission of the energy provider.…

Machine Learning · Computer Science 2022-10-26 Nicolas Avila , Shahad Hardan , Elnura Zhalieva , Moayad Aloqaily , Mohsen Guizani