English
Related papers

Related papers: Intermittent localization and fast spatial learnin…

200 papers

We consider a branching random walk on the lattice, where the branching rates are given by an i.i.d. Pareto random potential. We show a very strong form of intermittency, where with high probability most of the mass of the system is…

Probability · Mathematics 2016-05-02 Marcel Ortgiese , Matthew I. Roberts

Large language models (LLMs) can adapt to new tasks via in-context learning (ICL) without parameter updates, making them powerful learning engines for fast adaptation. While extensive research has examined ICL as a few-shot learner, whether…

Machine Learning · Computer Science 2025-09-30 Liuwang Kang , Fan Wang , Shaoshan Liu , Hung-Chyun Chou , Chuan Lin , Ning Ding

We consider the dynamics of lattice random walks with resetting. The walker moving randomly on a lattice of arbitrary dimensions resets at every time step to a given site with a constant probability $r$. We construct a discrete renewal…

Statistical Mechanics · Physics 2022-11-01 Debraj Das , Luca Giuggioli

The distribution of information is essential for living system's ability to coordinate and adapt. Random walkers are often used to model this distribution process and, in doing so, one effectively assumes that information maintains its…

Statistical Mechanics · Physics 2010-03-12 Ludvig Lizana , Martin Rosvall , Kim Sneppen

Non-Markovian quantum effects are typically observed in systems interacting with structured reservoirs. Discrete-time quantum walks are prime example of such systems in which, quantum memory arises due to the controlled interaction between…

Quantum Physics · Physics 2018-07-18 N. Pradeep Kumar , Subhashish Banerjee , C. M. Chandrashekar

Reinforcement Learning (RL) agents typically learn memoryless policies---policies that only consider the last observation when selecting actions. Learning memoryless policies is efficient and optimal in fully observable environments.…

The study of diffusion with preferential returns to places visited in the past has attracted an increased attention in recent years. In these highly non-Markov processes, a standard diffusive particle intermittently resets at a given rate…

Statistical Mechanics · Physics 2024-05-08 Denis Boyer , Satya N. Majumdar

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

Machine Learning · Computer Science 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Memories in neural system are shaped through the interplay of neural and learning dynamics under external inputs. By introducing a simple local learning rule to a neural network, we found that the memory capacity is drastically increased by…

Adaptation and Self-Organizing Systems · Physics 2020-07-01 Tomoki Kurikawa , Omri Barak , Kunihiko Kaneko

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Cristiano Capone , Paolo Muratore

Animal movement studies have become ubiquitous in animal ecology for estimation of space use and analysis of movement behavior. In these studies, animal movement data are primarily collected at regular time intervals. We propose an…

Applications · Statistics 2019-11-13 Elizabeth Eisenhauer , Ephraim Hanks

We consider a discrete-time Markovian random walk with resets on a connected undirected network. The resets, in which the walker is relocated to randomly chosen nodes, are governed by an independent discrete-time renewal process. Some nodes…

Random walks are a fundamental primitive used in many machine learning algorithms with several applications in clustering and semi-supervised learning. Despite their relevance, the first efficient parallel algorithm to compute random walks…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-02 Michael Kapralov , Silvio Lattanzi , Navid Nouri , Jakab Tardos

An analytic effective medium theory is constructed to study the mean access times for random walks on hybrid disordered structures formed by embedding complex networks into regular lattices, considering transition rates $F$ that are…

Disordered Systems and Neural Networks · Physics 2009-11-13 Paul E. Parris , Julián Candia , V. M. Kenkre

Denoising score matching plays a pivotal role in the performance of diffusion-based generative models. However, the empirical optimal score--the exact solution to the denoising score matching--leads to memorization, where generated samples…

Machine Learning · Statistics 2025-05-07 Yu-Han Wu , Pierre Marion , Gérard Biau , Claire Boyer

In tasks aiming for long-term returns, planning becomes essential. We study generative modeling for planning with datasets repurposed from offline reinforcement learning. Specifically, we identify temporal consistency in the absence of…

Machine Learning · Computer Science 2025-08-19 Deqian Kong , Dehong Xu , Minglu Zhao , Bo Pang , Jianwen Xie , Andrew Lizarraga , Yuhao Huang , Sirui Xie , Ying Nian Wu

We study discrete-time random walks on arbitrary networks with first-passage resetting processes. To the end, a set of nodes are chosen as observable nodes, and the walker is reset instantaneously to a given resetting node whenever it hits…

Statistical Mechanics · Physics 2021-06-30 Feng Huang , Hanshuang Chen

Continual learning approaches help deep neural network models adapt and learn incrementally by trying to solve catastrophic forgetting. However, whether these existing approaches, applied traditionally to image-based tasks, work with the…

Machine Learning · Computer Science 2022-06-27 Young D. Kwon , Jagmohan Chauhan , Abhishek Kumar , Pan Hui , Cecilia Mascolo

In recent years, neural networks have demonstrated an outstanding ability to achieve complex learning tasks across various domains. However, they suffer from the "catastrophic forgetting" problem when they face a sequence of learning tasks,…

Machine Learning · Computer Science 2020-04-27 Seyed-Iman Mirzadeh , Mehrdad Farajtabar , Hassan Ghasemzadeh

Memorization impacts the performance of deep learning algorithms. Prior works have studied memorization primarily in the context of generalization and privacy. This work studies the memorization effect on incremental learning scenarios.…

Machine Learning · Computer Science 2025-05-26 Jędrzej Kozal , Jan Wasilewski , Alif Ashrafee , Bartosz Krawczyk , Michał Woźniak