English
Related papers

Related papers: Learning Best Response Policies in Dynamic Auction…

200 papers

We study reserve price optimization in multi-phase second price auctions, where the seller's prior actions affect the bidders' later valuations through a Markov Decision Process (MDP). Compared to the bandit setting in existing works, the…

Machine Learning · Computer Science 2026-03-04 Rui Ai , Boxiang Lyu , Zhaoran Wang , Zhuoran Yang , Michael I. Jordan

We consider the problem of online dynamic mechanism design for sequential auctions in unknown environments, where the underlying market and, thus, the bidders' values vary over time as interactions between the seller and the bidders…

Computer Science and Game Theory · Computer Science 2025-10-27 Vincent Leon , S. Rasoul Etesami

In a day-ahead market, energy buyers and sellers submit their bids for a particular future time, including the amount of energy they wish to buy or sell and the price they are prepared to pay or receive. However, the dynamic for forming the…

Optimization and Control · Mathematics 2024-11-26 Luca Di Persio , Matteo Garbelli , Luca M. Giordano

Optimal sensor placement enhances the efficiency of a variety of applications for monitoring dynamical systems. It has been established that deterministic solutions to the sensor placement problem are insufficient due to the many…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Amin Jabini , Erik A. Johnson

We consider some classical optimization problems in path planning and network transport, and we introduce new auction-based algorithms for their optimal and suboptimal solution. The algorithms are based on mathematical ideas that are…

Optimization and Control · Mathematics 2022-07-21 Dimitri Bertsekas

In this paper we explore the usage of deep reinforcement learning algorithms to automatically generate consistently profitable, robust, uncorrelated trading signals in any general financial market. In order to do this, we present a novel…

Computational Finance · Quantitative Finance 2019-12-17 Souradeep Chakraborty

We study the problem of a buyer (aka auctioneer) who gains stochastic rewards by procuring multiple units of a service or item from a pool of heterogeneous strategic agents. The reward obtained for a single unit from an allocated agent…

Computer Science and Game Theory · Computer Science 2015-04-30 Satyanath Bhat , Shweta Jain , Sujit Gujar , Y. Narahari

Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of…

Portfolio Management · Quantitative Finance 2020-10-12 Miquel Noguer i Alonso , Sonam Srivastava

We consider the issue of a market maker acting at the same time in the lit and dark pools of an exchange. The exchange wishes to establish a suitable make-take fees policy to attract transactions on its venues. We first solve the stochastic…

Mathematical Finance · Quantitative Finance 2019-12-04 Bastien Baldacci , Iuliia Manziuk , Thibaut Mastrolia , Mathieu Rosenbaum

Evolutionary algorithms, such as Differential Evolution, excel in solving real-parameter optimization challenges. However, the effectiveness of a single algorithm varies across different problem instances, necessitating considerable efforts…

Neural and Evolutionary Computing · Computer Science 2024-03-08 Hongshu Guo , Yining Ma , Zeyuan Ma , Jiacheng Chen , Xinglin Zhang , Zhiguang Cao , Jun Zhang , Yue-Jiao Gong

Assigning resources in business processes execution is a repetitive task that can be effectively automated. However, different automation methods may give varying results that may not be optimal. Proper resource allocation is crucial as it…

Machine Learning · Computer Science 2021-04-02 Kamil Żbikowski , Michał Ostapowicz , Piotr Gawrysiak

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

Machine Learning · Computer Science 2019-01-23 Reazul Hasan Russel

In many reinforcement learning applications, the underlying environment reward and transition functions are explicitly known differentiable functions. This enables us to use recent research which applies machine learning tools to stochastic…

Portfolio Management · Quantitative Finance 2022-04-08 Thibault Jaisson

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existing approaches are…

Artificial Intelligence · Computer Science 2022-09-14 Yining Lu , Changjie Lu , Naina Bandyopadhyay , Manoj Kumar , Gaurav Gupta

This paper presents a multi-agent reinforcement learning algorithm to represent strategic bidding behavior in freight transport markets. Using this algorithm, we investigate whether feasible market equilibriums arise without any central…

Machine Learning · Computer Science 2021-02-19 Wouter van Heeswijk

We present a novel negotiation model that allows an agent to learn how to negotiate during concurrent bilateral negotiations in unknown and dynamic e-markets. The agent uses an actor-critic architecture with model-free reinforcement…

Multiagent Systems · Computer Science 2020-02-04 Pallavi Bagga , Nicola Paoletti , Bedour Alrayes , Kostas Stathis

Designing an incentive compatible auction that maximizes expected revenue is an intricate task. The single-item case was resolved in a seminal piece of work by Myerson in 1981, but more than 40 years later a full analytical understanding of…

Computer Science and Game Theory · Computer Science 2022-10-17 Paul Dütting , Zhe Feng , Harikrishna Narasimhan , David C. Parkes , Sai Srivatsa Ravindranath

In a sequential auction with multiple bidding agents, it is highly challenging to determine the ordering of the items to sell in order to maximize the revenue due to the fact that the autonomy and private information of the agents heavily…

Artificial Intelligence · Computer Science 2018-10-16 Sicco Verwer , Yingqian Zhang , Qing Chuan Ye

This paper tackles the challenge of learning non-Markovian optimal execution strategies in dynamic financial markets. We introduce a novel actor-critic algorithm based on Deep Deterministic Policy Gradient (DDPG) to address this issue, with…

Machine Learning · Computer Science 2024-10-18 Alessandro Micheli , Mélodie Monod