English
Related papers

Related papers: Finding ReMO (Related Memory Object): A Simple Neu…

200 papers

In the domain of sequence modelling, Recurrent Neural Networks (RNN) have been capable of achieving impressive results in a variety of application areas including visual question answering, part-of-speech tagging and machine translation.…

Machine Learning · Computer Science 2018-05-22 Tharindu Fernando , Simon Denman , Aaron McFadyen , Sridha Sridharan , Clinton Fookes

Memorization is a fundamental ability of Transformer-based Large Language Models, achieved through learning. In this paper, we propose a paradigm shift by designing an architecture to memorize text directly, bearing in mind the principle…

Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE. Most existing efforts largely focused on directly extracting potentially useful…

Computation and Language · Computer Science 2022-12-06 Xinyu Wang , Jiong Cai , Yong Jiang , Pengjun Xie , Kewei Tu , Wei Lu

This article proposes a biologically inspired neurocomputational architecture which learns associations between words and referents in different contexts, considering evidence collected from the literature of Psycholinguistics and…

Machine Learning · Computer Science 2019-05-29 Hansenclever F. Bassani , Aluizio F. R. Araujo

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Cheng Tan , Jingxuan Wei , Linzhuang Sun , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Question Answering (QA) is fundamental to natural language processing in that most nlp problems can be phrased as QA (Kumar et al., 2015). Current weakly supervised memory network models that have been proposed so far struggle at answering…

Neural and Evolutionary Computing · Computer Science 2015-12-24 Ethan Caballero

Incorporating relational reasoning in neural networks for object recognition remains an open problem. Although many attempts have been made for relational reasoning, they generally only consider a single type of relationship. For example,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Hao Chen , Abhinav Shrivastava

Machine comprehension plays an essential role in NLP and has been widely explored with dataset like MCTest. However, this dataset is too simple and too small for learning true reasoning abilities. \cite{hermann2015teaching} therefore…

Computation and Language · Computer Science 2016-05-16 Tian Tian , Yuezhang Li

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

Despite recent progress in memory augmented neural network (MANN) research, associative memory networks with a single external memory still show limited performance on complex relational reasoning tasks. Especially the content-based…

Machine Learning · Computer Science 2021-08-30 Taewon Park , Inchul Choi , Minho Lee

A critical component to enabling intelligent reasoning in partially observable environments is memory. Despite this importance, Deep Reinforcement Learning (DRL) agents have so far used relatively simple memory architectures, with the main…

Machine Learning · Computer Science 2017-02-28 Emilio Parisotto , Ruslan Salakhutdinov

The success of recommender systems in modern online platforms is inseparable from the accurate capture of users' personal tastes. In everyday life, large amounts of user feedback data are created along with user-item online interactions in…

Machine Learning · Computer Science 2019-06-25 Xiao Zhou , Danyang Liu , Jianxun Lian , Xing Xie

Our goal is to combine the rich multistep inference of symbolic logical reasoning with the generalization capabilities of neural networks. We are particularly interested in complex reasoning about entities and relations in text and…

Computation and Language · Computer Science 2017-05-02 Rajarshi Das , Arvind Neelakantan , David Belanger , Andrew McCallum

Recent breakthroughs in reasoning language models have significantly advanced text-based reasoning. On the other hand, Multi-modal Large Language Models (MLLMs) still lag behind, hindered by their outdated internal LLMs. Upgrading these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Xin Jin , Zhenguo Li , James T. Kwok , Yu Zhang

Multi-relation Question Answering is a challenging task, due to the requirement of elaborated analysis on questions and reasoning over multiple fact triples in knowledge base. In this paper, we present a novel model called Interpretable…

Computation and Language · Computer Science 2018-06-04 Mantong Zhou , Minlie Huang , Xiaoyan Zhu

Integrating robotics into everyday scenarios like tutoring or physical training requires robots capable of adaptive, socially engaging, and goal-oriented interactions. While Large Language Models show promise in human-like communication,…

Robotics · Computer Science 2025-04-03 Luca Garello , Giulia Belgiovine , Gabriele Russo , Francesco Rea , Alessandra Sciutti

We consider the task of KBP slot filling -- extracting relation information from newswire documents for knowledge base construction. We present our pipeline, which employs Relational Dependency Networks (RDNs) to learn linguistic patterns…

Artificial Intelligence · Computer Science 2016-07-05 Dileep Viswanathan , Ameet Soni , Jude Shavlik , Sriraam Natarajan

LLM-based conversational AI agents struggle to maintain coherent behavior over long horizons due to limited context. While RAG-based approaches are increasingly adopted to overcome this limitation by storing interactions in external memory…

Artificial Intelligence · Computer Science 2026-05-13 Jiazhou Liang , Armin Toroghi , Yifan Simon Liu , Faeze Moradi Kalarde , Liam Gallagher , Scott Sanner