English
Related papers

Related papers: Adaptive Constraint Satisfaction for Markov Decisi…

200 papers

Credit-based congestion pricing (CBCP) has emerged as a mechanism to alleviate the social inequity concerns of road congestion pricing - a promising strategy for traffic congestion mitigation - by providing low-income users with travel…

Computer Science and Game Theory · Computer Science 2022-10-31 Devansh Jalota , Jessica Lazarus , Alexandre Bayen , Marco Pavone

This work analyzes the minimum tollbooth problem in atomic network congestion games with unsplittable flows. The goal is to place tolls on edges, such that there exists a pure Nash equilibrium in the tolled game that is a social optimum in…

Computer Science and Game Theory · Computer Science 2021-04-01 Julian Nickerl

The goal of traffic management is efficiently utilizing network resources via adapting of source sending rates and routes selection. Traditionally, this problem is formulated into a utilization maximization problem. The single-path routing…

Networking and Internet Architecture · Computer Science 2015-03-19 Ying Liu , Hongying Liu , Ke Xu , Meng Shen , Yifeng Zhong

Traffic management by applying congestion pricing is a measure for mitigating congestion in protected city corridors. As a promising tool, pricing improves the level of service in a network and reduces travel delays. However, real-world…

Robotics · Computer Science 2021-12-14 Alexander Genser , Anastasios Kouvelas

In many social dilemmas, individuals tend to generate a situation with low payoffs instead of a system optimum ("tragedy of the commons"). Is the routing of traffic a similar problem? In order to address this question, we present…

Physics and Society · Physics 2007-05-23 Dirk Helbing , Martin Schonhof , Hans-Ulrich Stark , Janusz A. Holyst

How to design tolls that induce socially optimal traffic loads with dynamically arriving travelers who make selfish routing decisions? We propose a two-timescale discrete-time stochastic dynamics that adaptively adjusts the toll prices on a…

Systems and Control · Electrical Eng. & Systems 2021-10-19 Chinmay Maheshwari , Kshitij Kulkarni , Manxi Wu , Shankar Sastry

The long-run average payoff per transition (mean payoff) is the main tool for specifying the performance and dependability properties of discrete systems. The problem of constructing a controller (strategy) simultaneously optimizing several…

Artificial Intelligence · Computer Science 2024-12-19 David Klaška , Antonín Kučera , Vojtěch Kůr , Vít Musil , Vojtěch Řehák

We consider controller synthesis for stochastic and partially unknown environments in which safety is essential. Specifically, we abstract the problem as a Markov decision process in which the expected performance is measured using a cost…

Software Engineering · Computer Science 2015-10-21 Sebastian Junges , Nils Jansen , Christian Dehnert , Ufuk Topcu , Joost-Pieter Katoen

Highway vehicular traffic is an inherently multi-agent problem. Traffic jams can appear and disappear mysteriously. We develop a method for traffic flow control that is applied at the vehicular level via mean-field games. We begin this work…

Optimization and Control · Mathematics 2023-06-06 Amoolya Tirumalai , John S. Baras

Achieving a socially desirable operating point for a multimodal transportation system is challenging when Autonomous Mobility-on-Demand (AMoD) and Public Transit (PT) operators pursue selfish objectives alongside endogenous passenger…

Optimization and Control · Mathematics 2026-05-19 Xinling Li , Runyu Zhang , Gioele Zardini

We consider the interaction among agents engaging in a driving task and we model it as general-sum game. This class of games exhibits a plurality of different equilibria posing the issue of equilibrium selection. While selecting the most…

In this paper, we consider a large class of constrained non-cooperative stochastic Markov games with countable state spaces and discounted cost criteria. In one-player case, i.e., constrained discounted Markov decision models, it is…

Optimization and Control · Mathematics 2021-12-16 Anna Jaśkiewicz , Andrzej S. Nowak

In this work, we study discrete-time Markov decision processes (MDPs) under constraints with Borel state and action spaces and where all the performance functions have the same form of the expected total reward (ETR) criterion over the…

Probability · Mathematics 2019-05-10 F. Dufour , Alexandre Genadot

This paper studies an important rate allocation problem that arises in many networked and distributed systems: steady-state traffic rate allocation from multiple sources to multiple service nodes when both (i) the access-path delay on each…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-04 Tamoghna Sarkar , Bhaskar Krishnamachari

Despite measures to reduce congestion, occurrences of both recurrent and non-recurrent congestion cause large delays in road networks with important economic implications. Educated use of Intelligent Transportation Systems (ITS) can…

Optimization and Control · Mathematics 2021-11-23 Nikki Levering , Marko Boon , Michel Mandjes , Rudesindo Núñez-Queija

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

Machine Learning · Computer Science 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

In multiplayer games, self-interested behavior among the players can harm the social welfare. Tax mechanisms are a common method to alleviate this issue and induce socially optimal behavior. In this work, we take the initial step of…

Computer Science and Game Theory · Computer Science 2025-01-16 Qiwen Cui , Maryam Fazel , Simon S. Du

We introduce a new framework for efficient sampling from complex probability distributions, using a combination of optimal transport maps and the Metropolis-Hastings rule. The core idea is to use continuous transportation to transform…

Computation · Statistics 2019-06-11 Matthew Parno , Youssef Marzouk

Recent advancements in vehicle autonomy have drawn interest in understanding the impact of autonomous vehicles on traffic systems. In this paper, we study a traffic assignment problem in a mixed-autonomy setting where both human-driven and…

Computer Science and Game Theory · Computer Science 2026-05-25 Lihui Yi , Ermin Wei

Markov decision processes (MDPs) are the defacto frame-work for sequential decision making in the presence ofstochastic uncertainty. A classical optimization criterion forMDPs is to maximize the expected discounted-sum pay-off, which…

Artificial Intelligence · Computer Science 2020-02-28 Tomas Brazdil , Krishnendu Chatterjee , Petr Novotny , Jiri Vahala