English
Related papers

Related papers: Exploration-exploitation trade-off features a salt…

200 papers

In recent years, we have seen scientists attempt to model and explain human dynamics and, in particular, human movement. Many aspects of our complex life are affected by human movements such as disease spread and epidemics modeling, city…

Physics and Society · Physics 2018-11-05 Hugo Barbosa , Fernando Buarque de Lima Neto , Alexandre Evsukoff , Ronaldo Menezes

Exploitation universally emerges in various decision-making contexts, e.g., animals foraging, web surfing, the evolution of scientists' research topics, and our daily lives. Despite its ubiquity, exploitation, which refers to the behavior…

Statistical Mechanics · Physics 2022-08-12 Youngkyoung Bae , Gangmin Son , Hawoong Jeong

A common phenomena in modern recommendation systems is the use of feedback from one user to infer the `value' of an item to other users. This results in an exploration vs. exploitation trade-off, in which items of possibly low value have to…

Machine Learning · Computer Science 2014-11-11 Siddhartha Banerjee , Sujay Sanghavi , Sanjay Shakkottai

The L\'evy walk, a type of random walk characterized by linear step lengths that follow a power-law distribution, is observed in the migratory behaviors of various organisms, ranging from bacteria to humans. Notably, L\'evy walks with power…

Essential to each other, growth and exploration are jointly observed in populations, be it alive such as animals and cells or inanimate such as goods and money. But their ability to move, crucial to cope with uncertainty and optimize…

Statistical Mechanics · Physics 2020-10-06 Thomas Gueudré , David Martin

How to best exploit patchy resources? This long-standing question belongs to the extensively studied class of explore/exploit problems that arise in a wide range of situations, from animal foraging, to robotic exploration, and to human…

Populations and Evolution · Quantitative Biology 2017-01-31 M. Chupeau , O. Benichou , S. Redner

We consider a ubiquitous scenario in the Internet economy when individual decision-makers (henceforth, agents) both produce and consume information as they make strategic choices in an uncertain environment. This creates a three-way…

Computer Science and Game Theory · Computer Science 2021-04-09 Yishay Mansour , Aleksandrs Slivkins , Vasilis Syrgkanis , Zhiwei Steven Wu

We explore how strategic leaps alter the classic rock-paper-scissors dynamics in spatially structured populations. In our model, individuals can expend energy reserves to jump toward regions with a high density of individuals of the species…

Populations and Evolution · Quantitative Biology 2025-06-23 J. Menezes , R. Barbalho , Y. Sun

We consider a model of nomadic agents exploring and competing for time-varying location-specific resources, arising in crowdsourced transportation services, online communities, and in traditional location based economic activity. This model…

Computer Science and Game Theory · Computer Science 2016-02-23 Pu Yang , Krishnamurthy Iyer , Peter Frazier

Explore-and-exploit tradeoffs play a key role in recommendation systems (RSs), aiming at serving users better by learning from previous interactions. Despite their commercial success, the societal effects of explore-and-exploit mechanisms…

Computer Science and Game Theory · Computer Science 2025-02-19 Omer Ben-Porat , Yotam Gafni , Or Markovetzki

We develop a coherent framework for integrative simultaneous analysis of the exploration-exploitation and model order selection trade-offs. We improve over our preceding results on the same subject (Seldin et al., 2011) by combining…

Machine Learning · Computer Science 2015-03-19 Yevgeny Seldin , Nicolò Cesa-Bianchi , François Laviolette , Peter Auer , John Shawe-Taylor , Jan Peters

Situations where people have to decide between hurting themselves or another person are at the core of many individual and global conflicts. Yet little is known about how people behave when facing these situations in the lab. Here we report…

Populations and Evolution · Quantitative Biology 2014-12-23 Valerio Capraro

Cooperation underlies many natural and artificial systems. While voluntary participation can sustain cooperation without informational assumptions, real interactions are rarely anonymous, leaving the joint effects of participation and…

Physics and Society · Physics 2026-01-27 Chen Shen , Zhao Song , Xinyu Wang , Lei Shi , Matjaž Perc , Zhen Wang , Jun Tanimoto

How to promote the innovative activities is an important problem for modern society. In this paper, combining with the evolutionary games and information spreading, we propose a lattice model to investigate dynamics of human innovative…

Physics and Society · Physics 2013-03-05 Ying-Ting Lin , Xiao-Pu Han , Bing-Hong Wang

In natural foraging, many organisms seem to perform two different types of motile search: directed search (taxis) and random search. The former is observed when the environment provides cues to guide motion towards a target. The latter…

Statistical Mechanics · Physics 2017-12-27 Łukasz Kuśmierz , Taro Toyoizumi

Many studies on animal and human movement patterns report the existence of scaling laws and power-law distributions. Whereas a number of random walk models have been proposed to explain observations, in many situations individuals actually…

Disordered Systems and Neural Networks · Physics 2015-05-13 D. Boyer , O. Miramontes , H. Larralde

L\'evy walks are found in the migratory behaviour patterns of various organisms, and the reason for this phenomenon has been much discussed. We use simulations to demonstrate that learning causes the changes in confidence level during…

The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to…

Machine Learning · Computer Science 2019-09-10 Lior Shani , Yonathan Efroni , Shie Mannor

Population dynamics of individuals undergoing birth and death and diffusing by short or long ranged twodimensional spatial excursions (Gaussian jumps or L\'{e}vy flights) is studied. Competitive interactions are considered in a global case,…

Statistical Mechanics · Physics 2013-10-25 E. Heinsalu , E. Hernandez-Garcia , C. Lopez

A model of the mechanisms underlying exploratory behaviour, based on empirical research and refined using a computer simulation, is presented. The behaviour of killifish from two lakes, one with killifish predators and one without, was…

Populations and Evolution · Quantitative Biology 2019-07-11 Liane Gabora , Patrick Colgan