Related papers: Exploration-exploitation trade-off features a salt…
We investigate a stochastic search process in one dimension under the competing roles of mortality, redundancy, and diversity of the searchers. This picture represents a toy model for the fertilization of an oocyte by sperm. A population of…
Stochastic processes time-changed by an inverse subordinator have been suggested as a way to model the price of assets in illiquid markets, where the jumps of the subordinator correspond to periods of time where one is unable to sell an…
Compared to the well-studied topic of human mobility in real geographic space, very few studies focus on human mobility in virtual space, such as interests, knowledge, ideas, and so forth. However, it relates to the issues of management of…
In this paper, we conduct a literature review of laws of motion based on stochastic search strategies which are mainly focused on exploring highly dynamic environments. In this regard, stochastic search strategies represent an interesting…
Chaotic itinerancy is a universal dynamical concept that describes itinerant motion among many different ordered states through chaotic transition in dynamical systems. Unlike the expectation of the prevalence of chaotic itinerancy in…
Suppose that females choose males based on attributes that do not signal any genetic quality that is not related to the choice itself. Can being choosy confer selective advantage in this situation? We introduce correlated strategies, which…
In times of plenty expectations rise, just as in times of crisis they fall. This can be mathematically described as a Win-Stay-Lose-Shift strategy with dynamic aspiration levels, where individuals aspire to be as wealthy as their average…
We investigate a group choice problem of agents pursuing social status. We assume heterogeneous agents want to signal their private information (ability, income, patience, altruism, etc.) to others, facing tradeoff between "outside status"…
In search engines, online marketplaces and other human-computer interfaces large collectives of individuals sequentially interact with numerous alternatives of varying quality. In these contexts, trial and error (exploration) is crucial for…
We study a lattice model of ``commons'', where a resource is shared locally among the agents of various cooperative tendency. The payoff function of an agent is proportional to the fraction of his operation rate and the net output of the…
Recent advances in human mobility research have revealed consistent pairwise characteristics in movement behavior, yet existing mobility models often overlook the spatial and topological structure of mobility networks. By analyzing millions…
The dynamics of human mobility characterizes the trajectories humans follow during their daily activities and is the foundation of processes from epidemic spreading to traffic prediction and information recommendation. In this paper, we…
We discuss various features of the trajectories of spider monkeys looking for food in a tropical forest, as observed recently in an extensive {\it in situ} study. Some of the features observed can be interpreted as the result of social…
Experimental studies have shown the ubiquity of altruistic behavior in human societies. The social structure is a fundamental ingredient to understand the degree of altruism displayed by the members of a society, in contrast to…
Cooperative behavior among unrelated individuals in human and animal societies represents a most intriguing puzzle to scientists in various disciplines. Here we present a simple yet effective mechanism promoting cooperation under full…
In this paper, we develop a dynamic exploration/ exploitation (exr/exp) strategy for contextual recommender systems (CRS). Specifically, our methods can adaptively balance the two aspects of exr/exp by automatically learning the optimal…
Exploration is a crucial skill for in-context reinforcement learning in unknown environments. However, it remains unclear if large language models can effectively explore a partially hidden state space. This work isolates exploration as the…
In the optional prisoner's dilemma (OPD), players can choose to cooperate and defect as usual, but can also abstain as a third possible strategy. This strategy models the players' participation in the game and is a relevant aspect in many…
In this paper, we consider the replicator-mutator dynamics for pairwise social dilemmas where the payoff entries are random variables. The randomness is incorporated to take into account the uncertainty, which is inevitable in practical…
We propose a safe exploration algorithm for deterministic Markov Decision Processes with unknown transition models. Our algorithm guarantees safety by leveraging Lipschitz-continuity to ensure that no unsafe states are visited during…