English
Related papers

Related papers: Predictive Associative Memory: Retrieval Beyond Si…

200 papers

Collaborative perception (CP) is a critical technology in applications like autonomous driving and smart cities. It involves the sharing and fusion of information among sensors to overcome the limitations of individual perception, such as…

Machine Learning · Computer Science 2026-01-09 Mengmeng Zhu , Yuxuan Sun , Yukuan Jia , Wei Chen , Bo Ai , Sheng Zhou

Memory is inherently entangled with prediction and planning. Flexible behavior in biological and artificial agents depends on the interplay of learning from the past and predicting the future in ever-changing environments. This chapter…

Artificial Intelligence · Computer Science 2024-02-21 Ida Momennejad

Retrieval-augmented generation (RAG) systems commonly improve robustness via query-time adaptations such as query expansion and iterative retrieval. While effective, these approaches are inherently stateless: adaptations are recomputed for…

Information Retrieval · Computer Science 2026-02-06 Yuntong Hu , Sha Li , Naren Ramakrishnan , Liang Zhao

We study the Bayesian approach to variable selection in the context of linear regression. Motivated by a recent work by Rockova and George (2014), we propose an EM algorithm that returns the MAP estimate of the set of relevant variables.…

Computation · Statistics 2016-03-15 Jin Wang , Feng Liang , Yuan Ji

Structural magnetic resonance imaging studies have shown that brain anatomical abnormalities are associated with cognitive deficits in preterm infants. Brain maturation and geometric features can be used with machine learning models for…

Machine Learning · Computer Science 2022-08-10 Zhiyuan Li , Hailong Li , Adebayo Braimah , Jonathan R. Dillman , Nehal A. Parikh , Lili He

Although deep learning has demonstrated remarkable capability in learning from unstructured data, modern tree-based ensemble models remain superior in extracting relevant information and learning from structured datasets. While several…

Machine Learning · Computer Science 2026-02-05 Yi-Chun Liao , Chieh-Lin Tsai , Yuan-Hao Chang , Camélia Slimani , Jalil Boukhobza , Tei-Wei Kuo

Recent advances in deep neural networks have been developed via architecture search for stronger representational power. In this work, we focus on the effect of attention in general deep neural networks. We propose a simple and effective…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jongchan Park , Sanghyun Woo , Joon-Young Lee , In So Kweon

Prioritized Experience Replay (PER) is a technical means of deep reinforcement learning by selecting experience samples with more knowledge quantity to improve the training rate of neural network. However, the non-uniform sampling used in…

Machine Learning · Computer Science 2023-10-10 Zhuoying Chen , Huiping Li , Rizhong Wang

Computation methods for solving entropy-regularized reward optimization -- a class of problems widely used for fine-tuning generative models -- have advanced rapidly. Among those, Adjoint Matching (AM, Domingo-Enrich et al., 2025) has…

Machine Learning · Statistics 2026-02-17 Oswin So , Brian Karrer , Chuchu Fan , Ricky T. Q. Chen , Guan-Horng Liu

Generalized approximate message passing (GAMP) is a promising technique for unknown signal reconstruction of generalized linear models (GLM). However, it requires that the transformation matrix has independent and identically distributed…

Information Theory · Computer Science 2021-10-18 Feiyan Tian , Lei Liu , Xiaoming Chen

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper,…

Machine Learning · Computer Science 2022-08-16 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Self-supervised learning has emerged as a major technique for the task of learning from unlabeled data, where the current methods mostly revolve around alignment of representations and input recon struction. Although such approaches have…

Machine Learning · Computer Science 2026-04-16 Mintu Dutta , Ritesh Vyas , Mohendra Roy

In-memory computing is an emerging computing paradigm that overcomes the limitations of exiting Von-Neumann computing architectures such as the memory-wall bottleneck. In such paradigm, the computations are performed directly on the data…

Emerging Technologies · Computer Science 2022-04-14 Mohammed E. Fouda , Hasan Erdem Yantir , Ahmed M. Eltawil , Fadi Kurdahi

We explore a new class of brain encoding model by adding memory-related information as input. Memory is an essential brain mechanism that works alongside visual stimuli. During a vision-memory cognitive task, we found the non-visual brain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Huzheng Yang , James Gee , Jianbo Shi

We present EB-JEPA, an open-source library for learning representations and world models using Joint-Embedding Predictive Architectures (JEPAs). JEPAs learn to predict in representation space rather than pixel space, avoiding the pitfalls…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Basile Terver , Randall Balestriero , Megi Dervishi , David Fan , Quentin Garrido , Tushar Nagarajan , Koustuv Sinha , Wancong Zhang , Mike Rabbat , Yann LeCun , Amir Bar

Memory is an essential element in people's daily life based on experience. So far, many studies have analyzed electroencephalogram (EEG) signals at encoding to predict later remembered items, but few studies have predicted long-term memory…

Neural and Evolutionary Computing · Computer Science 2020-12-08 Gi-Hwan Shin , Young-Seok Kweon , Minji Lee

Clinical time-series data are difficult to model with methods designed for regular sequences because they exhibit irregular sampling, frequent missing values, and heterogeneous observation patterns across variables. Existing approaches…

Machine Learning · Computer Science 2026-05-19 Jinwoong Kim , Sangjin Park

Joint-Embedding Predictive Architectures (JEPAs) provide a simpleframework for learning world models by predicting future latent representations.However, JEPA training is subject to a bias-variance tradeoff.Without sufficient structural…

Machine Learning · Computer Science 2026-05-12 Kai Zhao , Dongliang Nie , Yuchen Lin , Zhehan Luo , Yixiao Gu , Deng-Ping Fan , Dan Zeng

Both the human brain and artificial learning agents operating in real-world or comparably complex environments are faced with the challenge of online model selection. In principle this challenge can be overcome: hierarchical Bayesian…

Machine Learning · Computer Science 2017-12-05 David G. Nagy , Gergő Orbán

Associative memory, a form of content-addressable memory, facilitates information storage and retrieval in many biological and physical systems. In statistical mechanics models, associative memory at equilibrium is represented through…

Disordered Systems and Neural Networks · Physics 2022-03-08 Agnish Kumar Behera , Madan Rao , Srikanth Sastry , Suriyanarayanan Vaikuntanathan