English
Related papers

Related papers: Agent Behavior Prediction and Its Generalization A…

200 papers

Traditional approaches to training agents have generally involved a single, deterministic environment of minimal complexity to solve various tasks such as robot locomotion or computer vision. However, agents trained in static environments…

Robotics · Computer Science 2025-10-01 Kevin Godin-Dubois , Karine Miras , Anna V. Kononova

Predicting human motion in unstructured and dynamic environments is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose to encode…

Robotics · Computer Science 2019-07-01 Philipp Kratzer , Marc Toussaint , Jim Mainprice

We develop an approach to training generative models based on unrolling a variational auto-encoder into a Markov chain, and shaping the chain's trajectories using a technique inspired by recent work in Approximate Bayesian computation. We…

Machine Learning · Computer Science 2017-08-03 Philip Bachman , Doina Precup

The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…

Optimization and Control · Mathematics 2026-02-09 Nicole Bäuerle , Athanasios Vasileiadis

Time-inconsistent behavior, such as procrastination or abandonment of long-term goals, arises when agents evaluate immediate outcomes disproportionately higher than future ones. This leads to globally suboptimal behavior, where plans are…

Computer Science and Game Theory · Computer Science 2026-01-13 Tatiana Belova , Yuriy Dementiev , Artur Ignatiev , Danil Sagunov

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

Machine Learning · Computer Science 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

We believe that agents for automated incident response based on machine learning need to handle changes in network structure. Computer networks are dynamic, and can naturally change in structure over time. Retraining agents for small…

Artificial Intelligence · Computer Science 2024-07-09 Jakob Nyberg , Pontus Johnson

Simulating how organized groups (e.g., corporations) make decisions (e.g., responding to a competitor's move) is essential for understanding real-world dynamics and could benefit relevant applications (e.g., market prediction). In this…

Computation and Language · Computer Science 2026-04-14 Xinkai Zou , Yiming Huang , Zhuohang Wu , Jian Sha , Nan Huang , Longfei Yun , Jingbo Shang , Letian Peng

Individual cooperative strategy influences the surrounding dynamic population, which in turn affects cooperative strategy. To better model this phenomenon, we develop a Markov decision chain based game transitions model and examine the…

Physics and Society · Physics 2025-12-30 Chaoyang Luo , Yuji Zhang , Minyu Feng , Attila Szolnoki

Representations are internal models of the environment that can provide guidance to a behaving agent, even in the absence of sensory information. It is not clear how representations are developed and whether or not they are necessary or…

Neurons and Cognition · Quantitative Biology 2013-08-07 Lars Marstaller , Arend Hintze , Christoph Adami

In this work we introduce an approach for modeling and analyzing collective behavior of a group of agents using moments. We represent the group of agents via their distribution and derive a method to estimate the dynamics of the moments. We…

Optimization and Control · Mathematics 2020-04-30 Silun Zhang , Axel Ringh , Xiaoming Hu , Johan Karlsson

Designing artificial cyber-agents able to interact with human safely, smartly and in a natural way is a current open problem in control. Solving such an issue will allow the design of cyber-agents capable of co-operatively interacting with…

Systems and Control · Computer Science 2020-06-18 Maria Lombardi , Davide Liuzza , Mario di Bernardo

Accurate prediction of human behavior is essential for robust and safe human-AI collaboration. However, existing approaches for modeling people are often data-hungry and brittle because they either make unrealistic assumptions about…

Artificial Intelligence · Computer Science 2025-10-03 Kunal Jha , Aydan Yuenan Huang , Eric Ye , Natasha Jaques , Max Kleiman-Weiner

We propose a novel approach to address one aspect of the non-stationarity problem in multi-agent reinforcement learning (RL), where the other agents may alter their policies due to environment changes during execution. This violates the…

Machine Learning · Computer Science 2019-12-03 Yixiang Wang , Feng Wu

Learning collaborative behaviors is essential for multi-agent systems. Traditionally, multi-agent reinforcement learning solves this implicitly through a joint reward and centralized observations, assuming collaborative behavior will…

Robotics · Computer Science 2025-02-27 Zhengran Ji , Lingyu Zhang , Paul Sajda , Boyuan Chen

The dynamics of protection processes has been a fundamental challenge in systemic risk analysis. The conceptual principle and methodological techniques behind the mechanisms involved [in such dynamics] have been harder to grasp than…

Social and Information Networks · Computer Science 2019-07-29 Chulwook Park

Motivated by techniques developed in recent progress on lower bounds for sublinear time algorithms (Behnezhad, Roghani and Rubinstein, STOC 2023, FOCS 2023, and STOC 2024) we introduce and study a new class of randomized algorithmic…

Data Structures and Algorithms · Computer Science 2026-03-19 Amir Azarmehr , Soheil Behnezhad , Alma Ghafari , Madhu Sudan

There are two common approaches for optimizing the performance of a machine: genetic algorithms and machine learning. A genetic algorithm is applied over many generations whereas machine learning works by applying feedback until the system…

Artificial Intelligence · Computer Science 2017-09-01 Leigh Sheneman , Arend Hintze

Improved communication systems, shrinking battery sizes and the price drop of tracking devices have led to an increasing availability of trajectory tracking data. These data are often analyzed to understand animal behavior. In this work, we…

Applications · Statistics 2019-09-12 Gianluca Mastrantonio , Clara Grazian , Sara Mancinelli , Enrico Bibbona

Natural behavior consists of dynamics that are complex and unpredictable, especially when trying to predict many steps into the future. While some success has been found in building representations of behavior under constrained or…

Machine Learning · Computer Science 2023-03-16 Mehdi Azabou , Michael Mendelson , Nauman Ahad , Maks Sorokin , Shantanu Thakoor , Carolina Urzay , Eva L. Dyer