English
Related papers

Related papers: Risk-utility tradeoff shapes memory strategies for…

200 papers

Memory is fundamental to intelligence, enabling learning, reasoning, and adaptability across biological and artificial systems. While Transformer architectures excel at sequence modeling, they face critical limitations in long-range context…

Machine Learning · Computer Science 2025-08-19 Parsa Omidi , Xingshuai Huang , Axel Laborieux , Bahareh Nikpour , Tianyu Shi , Armaghan Eshaghi

Reinforcement Learning faces an important challenge in partial observable environments that has long-term dependencies. In order to learn in an ambiguous environment, an agent has to keep previous perceptions in a memory. Earlier memory…

Machine Learning · Computer Science 2023-02-22 Alper Demir

We propose to reformulate the payoff matrix structure of Prisoner's Dilemma Game, by introducing threat and greed factors, and show their effect on the co-evolution of memory and cooperation. Our findings are as follows. (i) Memory protects…

Physics and Society · Physics 2017-04-20 Uzay Cetin , Haluk O. Bingol

We show that there may exist an inherent tension between the goal of adversarial robustness and that of standard generalization. Specifically, training robust models may not only be more resource-consuming, but also lead to a reduction of…

Machine Learning · Statistics 2019-09-10 Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Alexander Turner , Aleksander Madry

People make strategic decisions many times a day - during negotiations, when coordinating actions with others, or when choosing partners for cooperation. The resulting dynamics can be studied with learning theory and evolutionary game…

Populations and Evolution · Quantitative Biology 2026-03-26 Marta C. Couto , Fernando P. Santos , Christian Hilbe

In a co-evolutionary context, the survive probability of individual elements of a system depends on their relation with their neighbors. The natural selection process depends on the whole population, which is determined by local events…

Biological Physics · Physics 2009-11-13 Juan G. Diaz Ochoa

Current techniques in machine learning are so far are unable to learn classifiers that are robust to adversarial perturbations. However, they are able to learn non-robust classifiers with very high accuracy, even in the presence of random…

Machine Learning · Computer Science 2019-01-04 Preetum Nakkiran

Biological flow networks adapt their network morphology to optimise flow while being exposed to external stimuli from different spatial locations in their environment. These adaptive flow networks retain a memory of the stimulus location in…

Soft Condensed Matter · Physics 2023-04-12 Komal Bhattacharyya , David Zwicker , Karen Alim

Modern machine learning models are deployed in diverse, non-stationary environments where they must continually adapt to new tasks and evolving knowledge. Continual fine-tuning and in-context learning are costly and brittle, whereas neural…

Machine Learning · Computer Science 2026-03-04 Max S. Bennett , Thomas P. Zollo , Richard Zemel

We consider a lifelong learning scenario in which a learner faces a neverending and arbitrary stream of facts and has to decide which ones to retain in its limited memory. We introduce a mathematical model based on the online learning…

Machine Learning · Computer Science 2022-01-13 Robi Bhattacharjee , Gaurav Mahajan

Evolutionary game theory classically investigates which behavioral patterns are evolutionarily successful in a single game. More recently, a number of contributions have studied the evolution of preferences instead: which subjective…

Computer Science and Game Theory · Computer Science 2015-05-27 Paolo Galeazzi , Michael Franke

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

Populations evolving in fluctuating environments face the fundamental challenge of balancing adaptation to current conditions against preparation for uncertain futures. Here, we study microbial evolution in partially predictable…

Populations and Evolution · Quantitative Biology 2025-08-04 Roaa Mohmmed Yagb Omer , Onofrio Mazzarisi , Martina Dal Bello , Jacopo Grilli

Machine learning algorithms enable advanced decision making in contemporary intelligent systems. Research indicates that there is a tradeoff between their model performance and explainability. Machine learning models with higher performance…

Machine Learning · Computer Science 2022-06-23 Lukas-Valentin Herm , Kai Heinrich , Jonas Wanner , Christian Janiesch

We study the problem of learning associative memory -- a system which is able to retrieve a remembered pattern based on its distorted or incomplete version. Attractor networks provide a sound model of associative memory: patterns are stored…

Machine Learning · Statistics 2021-04-21 Sergey Bartunov , Jack W Rae , Simon Osindero , Timothy P Lillicrap

In this paper we consider multi-objective reinforcement learning where the objectives are balanced using preferences. In practice, the preferences are often given in an adversarial manner, e.g., customers can be picky in many applications.…

Machine Learning · Computer Science 2021-10-29 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

Despite breakthrough performance, modern learning models are known to be highly vulnerable to small adversarial perturbations in their inputs. While a wide variety of recent \emph{adversarial training} methods have been effective at…

Machine Learning · Computer Science 2020-02-26 Adel Javanmard , Mahdi Soltanolkotabi , Hamed Hassani

We study learning in a dynamically evolving environment modeled as a Markov game between a learner and a strategic opponent that can adapt to the learner's strategies. While most existing works in Markov games focus on external regret as…

Machine Learning · Computer Science 2024-12-11 Thanh Nguyen-Tang , Raman Arora

Direct reciprocity is a mechanism for the evolution of cooperation based on repeated interactions. When individuals meet repeatedly, they can use conditional strategies to enforce cooperative outcomes that would not be feasible in one-shot…

Populations and Evolution · Quantitative Biology 2016-05-24 Seung Ki Baek , Hyeong-Chai Jeong , Christian Hilbe , Martin A. Nowak

The memory hierarchy has a high impact on the performance and power consumption in the system. Moreover, current embedded systems, included in mobile devices, are specifically designed to run multimedia applications, which are memory…

Hardware Architecture · Computer Science 2023-03-29 Josefa Díaz Álvarez , José L. Risco-Martín , J. Manuel Colmenar