English
Related papers

Related papers: Strongly reinforced P\'olya urns with graph-based …

200 papers

This is a research endeavor in two parts. We study a class of balanced urn schemes on balls of two colours (say white and black). At each drawing, a sample of size $m\ge 1$ is drawn from the urn, and ball addition rules are applied. We…

Probability · Mathematics 2015-04-01 Markus Kuba , Hosam M. Mahmoud

Humans and other animals can adapt their social behavior in response to environmental cues including the feedback obtained through experience. Nevertheless, the effects of the experience-based learning of players in evolution and…

Populations and Evolution · Quantitative Biology 2011-04-05 Naoki Masuda , Mitsuhiro Nakamura

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

We propose an approach to analyze the asymptotic behavior of P\'olya urns based on the contraction method. For this, a new combinatorial discrete time embedding of the evolution of the urn into random rooted trees is developed. A…

Probability · Mathematics 2019-02-20 Margarete Knape , Ralph Neininger

We introduce a multi-agent meta-modeling game to generate data, knowledge, and models that make predictions on constitutive responses of elasto-plastic materials. We introduce a new concept from graph theory where a modeler agent is tasked…

Machine Learning · Computer Science 2020-04-15 Kun Wang , WaiChing Sun , Qiang Du

A policy is said to be robust if it maximizes the reward while considering a bad, or even adversarial, model. In this work we formalize two new criteria of robustness to action uncertainty. Specifically, we consider two scenarios in which…

Machine Learning · Computer Science 2019-05-08 Chen Tessler , Yonathan Efroni , Shie Mannor

We study the problem of experiment design to learn causal structures from interventional data. We consider an active learning setting in which the experimenter decides to intervene on one of the variables in the system in each step and uses…

Artificial Intelligence · Computer Science 2020-09-09 Amir Amirinezhad , Saber Salehkaleybar , Matin Hashemi

Game-theoretic resource allocation on graphs (GRAG) involves two players competing over multiple steps to control nodes of interest on a graph, a problem modeled as a multi-step Colonel Blotto Game (MCBG). Finding optimal strategies is…

Machine Learning · Computer Science 2025-05-13 Zijian An , Lifeng Zhou

We prove that a random graph $G(n,p)$, with $p$ above the Hamiltonicity threshold, is typically such that for any $r$-colouring of its edges there exists a Hamilton cycle with at least $(2/(r+ 1)-o(1))n$ edges of the same colour. This…

Combinatorics · Mathematics 2021-04-22 Lior Gishboliner , Michael Krivelevich , Peleg Michaeli

We consider a context-dependent Reinforcement Learning (RL) setting, which is characterized by: a) an unknown finite number of not directly observable contexts; b) abrupt (discontinuous) context changes occurring during an episode; and c)…

Machine Learning · Computer Science 2022-02-15 Hang Ren , Aivar Sootla , Taher Jafferjee , Junxiao Shen , Jun Wang , Haitham Bou-Ammar

A first-order theory is equational if every definable set is a Boolean combination of instances of equations, that is, of formulae such that the family of finite intersections of instances has the descending chain condition. Equationality…

Logic · Mathematics 2020-09-21 Amador Martin-Pizarro , Martin Ziegler

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both…

Machine Learning · Computer Science 2012-08-07 Riad Akrour , Marc Schoenauer , Michèle Sebag

Consider an undirected graph G, representing a social network, where each node is blue or red, corresponding to positive or negative opinion on a topic. In the voter model, in discrete time rounds, each node picks a neighbour uniformly at…

Social and Information Networks · Computer Science 2025-06-03 Abhiram Manohara , Ahad N. Zehmakan

Financial markets investors are involved in many games -- they must interact with other agents to achieve their goals. Among them are those directly connected with their activity on markets but one cannot neglect other aspects that…

Trading and Market Microstructure · Quantitative Finance 2008-12-02 Edward W. Piotrowski , Jan Sladkowski , Anna Szczypinska

This study addresses the challenge of forming effective groups in collaborative problem-solving environments. Recognizing the complexity of human interactions and the necessity for efficient collaboration, we propose a novel approach…

Computers and Society · Computer Science 2024-03-18 Zheng Fang , Fucai Ke , Jae Young Han , Zhijie Feng , Toby Cai

Despite the growing interest in robot control utilizing the computation of biological neurons, context-dependent behavior by neuron-connected robots remains a challenge. Context-dependent behavior here is defined as behavior that is not the…

A big challenge in branch and bound lies in identifying the optimal node within the search tree from which to proceed. Current state-of-the-art selectors utilize either hand-crafted ensembles that automatically switch between naive sub-node…

Machine Learning · Computer Science 2024-06-06 Alexander Mattick , Christopher Mutschler

We consider the problem of maintaining a proper $(\Delta + 1)$-vertex coloring in a graph on $n$-vertices and maximum degree $\Delta$ undergoing edge insertions and deletions. We give a randomized algorithm with amortized update time…

Data Structures and Algorithms · Computer Science 2025-07-08 Maxime Flin , Magnús M. Halldórsson

Knowing the strategy of an opponent in a competitive environment conveys obvious evolutionary advantages. But this information is costly, and the benefit of being informed may not necessarily offset the additional cost. Here we introduce…

Physics and Society · Physics 2015-05-19 Attila Szolnoki , Matjaz Perc