English
Related papers

Related papers: Enforcing Regulation Under Illicit Adaptation

200 papers

Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the…

Machine Learning · Computer Science 2019-09-26 David Venuto , Leonard Boussioux , Junhao Wang , Rola Dali , Jhelum Chakravorty , Yoshua Bengio , Doina Precup

High false-positive rate is a long-standing challenge for anomaly detection algorithms, especially in high-stake applications. To identify the true anomalies, in practice, analysts or domain experts will be employed to investigate the top…

Machine Learning · Computer Science 2020-09-17 Daochen Zha , Kwei-Herng Lai , Mingyang Wan , Xia Hu

Online interactions with the environment to collect data samples for training a Reinforcement Learning (RL) agent is not always feasible due to economic and safety concerns. The goal of Offline Reinforcement Learning is to address this…

Machine Learning · Computer Science 2021-10-05 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

Strategic agents in incomplete-information environments have a conflicted relationship with uncertainty: it can keep them unpredictable to their opponents, but it must also be overcome to predict the actions of those opponents. We use a…

Computer Science and Game Theory · Computer Science 2016-05-16 Seth Frey , Paul L. Williams , Dominic K. Albino

Many studies have shown that humans are "predictably irrational": they do not act in a fully rational way, but their deviations from rational behavior are quite systematic. Our goal is to see the extent to which we can explain and justify…

Computer Science and Game Theory · Computer Science 2023-07-27 Xinming Liu , Joseph Y. Halpern

Human decision-making in real-life deviates significantly from the optimal decisions made by fully rational agents, primarily due to computational limitations or psychological biases. While existing studies in behavioral finance have…

Artificial Intelligence · Computer Science 2024-03-12 Penghang Liu , Kshama Dwarakanath , Svitlana S Vyetrenko , Tucker Balch

We study the regulation of a monopolistic firm using a robust-design approach. We solve for the policy that minimizes the regulator's worst-case regret, where the regret is the difference between his complete-information payoff minus his…

Theoretical Economics · Economics 2019-10-11 Yingni Guo , Eran Shmaya

In this paper, we propose a novel Reinforcement Learning approach for solving the Active Information Acquisition problem, which requires an agent to choose a sequence of actions in order to acquire information about a process of interest…

Machine Learning · Computer Science 2019-10-25 Heejin Jeong , Brent Schlotfeldt , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

Most methods for decision-theoretic online learning are based on the Hedge algorithm, which takes a parameter called the learning rate. In most previous analyses the learning rate was carefully tuned to obtain optimal worst-case…

Machine Learning · Statistics 2015-03-04 Tim van Erven , Peter Grünwald , Wouter M. Koolen , Steven de Rooij

We propose a framework for ensuring safe behavior of a reinforcement learning agent when the reward function may be difficult to specify. In order to do this, we rely on the existence of demonstrations from expert policies, and we provide a…

Machine Learning · Computer Science 2018-11-22 Jessie Huang , Fa Wu , Doina Precup , Yang Cai

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Machine Learning · Computer Science 2018-09-25 Tu-Hoa Pham , Giovanni De Magistris , Don Joven Agravante , Subhajit Chaudhury , Asim Munawar , Ryuki Tachibana

When sales of a product are affected by randomness in demand, retailers can use dynamic pricing strategies to maximise their profits. In this article the pricing problem is formulated as a stochastic optimal control problem, where the…

Optimization and Control · Mathematics 2017-10-17 Asbjørn N. Riseth , Jeff N. Dewynne , Chris L. Farmer

This paper investigates the performance of a legitimate surveillance system, where a legitimate monitor aims to eavesdrop on a dubious decode-and-forward relaying communication link. In order to maximize the effective eavesdropping rate,…

Information Theory · Computer Science 2017-06-07 Xin Jiang , Hai Lin , Caijun Zhong , Xiaoming Chen , Zhaoyang Zhang

Recent AI algorithms are black box models whose decisions are difficult to interpret. eXplainable AI (XAI) is a class of methods that seek to address lack of AI interpretability and trust by explaining to customers their AI decisions. The…

Artificial Intelligence · Computer Science 2024-04-02 Behnam Mohammadi , Nikhil Malik , Tim Derdenger , Kannan Srinivasan

In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices. However, during deployment, these agents trade in live markets where their own transactions…

Machine Learning · Computer Science 2026-01-27 Shaocong Ma , Heng Huang

Encouraged by decision makers' appetite for future information on topics ranging from elections to pandemics, and enabled by the explosion of data and computational methods, model based forecasts have garnered increasing influence on a…

Applications · Statistics 2022-07-22 Carl Boettiger

A significant portion of a consumer's annual electrical costs can be made up of coincident peak charges: a transmission surcharge for power consumed when the entire system is at peak demand. This charge occurs only a few times annually, but…

Optimization and Control · Mathematics 2019-08-05 Chase P. Dowling , Baosen Zhang

This paper studies a dynamic model of information acquisition, in which information might be secretly manipulated. A principal must choose between a safe action with known payoff and a risky action with uncertain payoff, favoring the safe…

Theoretical Economics · Economics 2023-04-14 Raphael Boleslavsky

Robots operating alongside humans often encounter unfamiliar environments that make autonomous task completion challenging. Though improving models and increasing dataset size can enhance a robot's performance in unseen environments, data…

Robotics · Computer Science 2024-06-10 Ifueko Igbinedion , Sertac Karaman

The use of reinforcement learning to dynamically adapt and evade detection is now well-documented in several cybersecurity settings including Covert Social Influence Operations (CSIOs), in which bots try to spread disinformation. While AI…

Social and Information Networks · Computer Science 2026-03-26 Valerio La Gatta , Nathan Subrahmanian , Kaitlyn Wang , Larry Birnbaum , V. S. Subrahmanian