English
Related papers

Related papers: Memory-cognizant generalization to Simon's random-…

200 papers

We consider a basic model of digital memory where each cell is composed of a reflecting medium with two possible reflectivities. By fixing the mean number of photons irradiated over each memory cell, we show that a non-classical source of…

Quantum Physics · Physics 2015-03-19 Stefano Pirandola

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this…

Computation and Language · Computer Science 2026-04-08 Alexandros Christoforos

We present a novel task that measures how people generalize objects' causal powers based on observing a single (Experiment 1) or a few (Experiment 2) causal interactions between object pairs. We propose a computational modeling framework…

Artificial Intelligence · Computer Science 2021-11-25 Bonan Zhao , Christopher G. Lucas , Neil R. Bramley

In physics we often use very simple models to describe systems with many degrees of freedom, but it is not clear why or how this success can be transferred to the more complex biological context. We consider models for the joint…

Neurons and Cognition · Quantitative Biology 2024-12-06 Luisa Ramirez , William Bialek , Stephanie E. Palmer , David J. Schwab

How do people acquire rich, flexible knowledge about their environment from others despite limited cognitive capacity? Humans are often thought to rely on computationally costly mentalizing, such as inferring others' beliefs. In contrast,…

Artificial Intelligence · Computer Science 2026-05-11 Silja Keßler , Miriam Bautista-Salinero , Claudio Tennie , Charley M. Wu

Selective rationalization has become a common mechanism to ensure that predictive models reveal how they use any available features. The selection may be soft or hard, and identifies a subset of input features relevant for prediction. The…

Computation and Language · Computer Science 2019-12-17 Mo Yu , Shiyu Chang , Yang Zhang , Tommi S. Jaakkola

The evolution of sequence modeling architectures, from recurrent neural networks and convolutional models to Transformers and structured state-space models, reflects ongoing efforts to address the diverse temporal dependencies inherent in…

Machine Learning · Computer Science 2025-06-10 Haotian Jiang , Zeyu Bao , Shida Wang , Qianxiao Li

We extend the capabilities of neural networks by coupling them to external memory resources, which they can interact with by attentional processes. The combined system is analogous to a Turing Machine or Von Neumann architecture but is…

Neural and Evolutionary Computing · Computer Science 2014-12-11 Alex Graves , Greg Wayne , Ivo Danihelka

From genomes and ecosystems to bureaucracies and cities, the growth of complex systems occurs by adding new types of functions and expanding existing ones. We present a simple generative model that generalizes the Yule-Simon process by…

We consider problems of making sequences of decisions to accomplish tasks, interacting via the medium of language. These problems are often tackled with reinforcement learning approaches. We find that these models do not generalize well…

Computation and Language · Computer Science 2020-10-07 Xusen Yin , Ralph Weischedel , Jonathan May

Generative modeling using samples drawn from the probability distribution constitutes a powerful approach for unsupervised machine learning. Quantum mechanical systems can produce probability distributions that exhibit quantum correlations…

Quantum Physics · Physics 2022-10-07 Xun Gao , Eric R. Anschuetz , Sheng-Tao Wang , J. Ignacio Cirac , Mikhail D. Lukin

Continuous-time stochastic processes pervade everyday experience, and the simulation of models of these processes is of great utility. Classical models of systems operating in continuous-time must typically track an unbounded amount of…

Quantum Physics · Physics 2018-03-05 Thomas J. Elliott , Mile Gu

Simon's problem is one of the most important problems demonstrating the power of quantum algorithms, as it greatly inspired the proposal of Shor's algorithm. The generalized Simon's problem is a natural extension of Simon's problem, and…

Quantum Physics · Physics 2023-07-27 Hao Li , Daowen Qiu , Le Luo , Mateus Paulo

The review paper presents generalization of d'Alembert's variational principle: the dynamics of a quantum system for an external observer is defined by the exact equilibrium of all acting in the system forces, including the random quantum…

High Energy Physics - Theory · Physics 2015-05-20 J. Manjavidze

Generative models have recently been explored for synthesizing neural network weights. These approaches take neural network checkpoints as training data and aim to generate high-performing weights during inference. In this work, we examine…

Machine Learning · Computer Science 2025-10-06 Boya Zeng , Yida Yin , Zhiqiu Xu , Zhuang Liu

Since its introduction Boson Sampling has been the subject of intense study in the world of quantum computing. The task is to sample independently from the set of all $n \times n$ submatrices built from possibly repeated rows of a larger $m…

Quantum Physics · Physics 2020-05-27 Peter Clifford , Raphaël Clifford

Simultaneous localization and mapping (SLAM) with implicit neural representations has received extensive attention due to the expressive representation power and the innovative paradigm of continual learning. However, deploying such a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Baicheng Li , Zike Yan , Dong Wu , Hanqing Jiang , Hongbin Zha

Energy-based probabilistic models learned by maximizing the likelihood of the data are limited by the intractability of the partition function. A widely used workaround is to maximize the pseudo-likelihood, which replaces the global…

Statistical Mechanics · Physics 2026-03-31 Francesco D'Amico , Dario Bocchi , Luca Maria Del Bono , Saverio Rossi , Matteo Negri

Humans can learn a variety of concepts and skills incrementally over the course of their lives while exhibiting many desirable properties, such as continual learning without forgetting, forward transfer and backward transfer of knowledge,…

Machine Learning · Computer Science 2020-06-17 Charles X. Ling , Tanner Bohn

Continual learning methods used to force neural networks to process sequential tasks in isolation, preventing them from leveraging useful inter-task relationships and causing them to repeatedly relearn similar features or overly…

Machine Learning · Computer Science 2025-11-14 Hyung-Jun Moon , Sung-Bae Cho