English
Related papers

Related papers: Memory-Centric Embodied Question Answering

200 papers

Embodied AI (EAI) agents continuously interact with the physical world, generating vast, heterogeneous multimodal data streams that traditional management systems are ill-equipped to handle. In this survey, we first systematically evaluate…

Robotics · Computer Science 2025-08-20 Yihao Lu , Hao Tang

Answering questions asked from instructional corpora such as E-manuals, recipe books, etc., has been far less studied than open-domain factoid context-based question answering. This can be primarily attributed to the absence of standard…

Computation and Language · Computer Science 2021-09-15 Abhilash Nandy , Soumya Sharma , Shubham Maddhashiya , Kapil Sachdeva , Pawan Goyal , Niloy Ganguly

To complete assignments provided by humans in natural language, robots must interpret commands, generate and answer relevant questions for scene understanding, and manipulate target objects. Real-world deployments often require multiple…

Robotics · Computer Science 2026-02-06 Xiaopan Zhang , Zejin Wang , Zhixu Li , Jianpeng Yao , Jiachen Li

Visual Question Answering (VQA) has emerged as a Visual Turing Test to validate the reasoning ability of AI agents. The pivot to existing VQA models is the joint embedding that is learned by combining the visual features from an image and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Moshiur R. Farazi , Salman H. Khan , Nick Barnes

Reducing the key-value (KV) cache size is a crucial step toward enabling efficient inference in large language models (LLMs), especially under latency and memory constraints. While Multi-Head Attention (MHA) offers strong representational…

Computation and Language · Computer Science 2025-09-23 Zhengge Cai , Haowen Hou

Autonomous agents operating in dynamic and safety-critical environments require decision-making frameworks that are both computationally efficient and physically grounded. However, many existing approaches rely on end-to-end learning, which…

Machine Learning · Computer Science 2026-05-01 Zhaowen Fan , Rongchao Zhang

We introduce Interactive Question Answering (IQA), the task of answering questions that require an autonomous agent to interact with a dynamic visual environment. IQA presents the agent with a scene and a question, like: "Are there any…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Daniel Gordon , Aniruddha Kembhavi , Mohammad Rastegari , Joseph Redmon , Dieter Fox , Ali Farhadi

To address the hallucination in generative question answering (GQA) where the answer can not be derived from the document, we propose a novel evidence-enhanced triplet generation framework, EATQA, encouraging the model to predict all the…

Computation and Language · Computer Science 2024-08-28 Haowei Du , Huishuai Zhang , Dongyan Zhao

Question answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in languages other than English,…

Computation and Language · Computer Science 2020-05-05 Patrick Lewis , Barlas Oğuz , Ruty Rinott , Sebastian Riedel , Holger Schwenk

Biomedical Question Answering (BQA) has attracted increasing attention in recent years due to its promising application prospect. It is a challenging task because the biomedical questions are professional and usually vary widely. Existing…

Computation and Language · Computer Science 2022-04-18 Damai Dai , Wenbin Jiang , Jiyuan Zhang , Weihua Peng , Yajuan Lyu , Zhifang Sui , Baobao Chang , Yong Zhu

Question answering (QA) aims to understand questions and find appropriate answers. In real-world QA systems, Frequently Asked Question (FAQ) based QA is usually a practical and effective solution, especially for some complicated questions…

Computation and Language · Computer Science 2020-10-23 Ruobing Xie , Yanan Lu , Fen Lin , Leyu Lin

Long-Form Question Answering (LFQA) involves generating comprehensive, paragraph-level responses to open-ended questions, which poses a significant challenge for evaluation due to the richness of information and flexible response format.…

Computation and Language · Computer Science 2026-02-03 Yuchen Fan , Chen Lin , Xin Zhong , Shuo Zhang , Heng Zhou , Yuchen Zhang , Mingyu Liang , Chengxing Xie , Ermo Hua , Gang Chen , Zhizhou He , Cheng Huang , Ning Ding , Bowen Zhou

Question Answering (QA) systems have traditionally relied on structured text data, but the rapid growth of multimedia content (images, audio, video, and structured metadata) has introduced new challenges and opportunities for…

Information Retrieval · Computer Science 2025-10-24 Rahul Raja , Arpita Vats

Long-term agent memory is increasingly multimodal, yet existing evaluations rarely test whether agents preserve the visual evidence needed for later reasoning. In prior work, many visually grounded questions can be answered using only…

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Computation and Language · Computer Science 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

This study focuses on Embodied Complex-Question Answering task, which means the embodied robot need to understand human questions with intricate structures and abstract semantics. The core of this task lies in making appropriate plans based…

Robotics · Computer Science 2025-04-02 Ning Lan , Baoshan Ou , Xuemei Xie , Guangming Shi

Memes have evolved as a prevalent medium for diverse communication, ranging from humour to propaganda. With the rising popularity of image-focused content, there is a growing need to explore its potential harm from different aspects.…

Computation and Language · Computer Science 2024-05-21 Siddhant Agarwal , Shivam Sharma , Preslav Nakov , Tanmoy Chakraborty

Human-AI conversation frequently relies on quoting earlier text-"check it with the formula I just highlighted"-yet today's large language models (LLMs) lack an explicit mechanism for locating and exploiting such spans. We formalise the…

Artificial Intelligence · Computer Science 2025-06-02 Yueqi Zhang , Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Jiayi Shi , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

Modern language agents must operate over long-horizon, multi-turn interactions, where they retrieve external information, adapt to observations, and answer interdependent queries. Yet, most LLM systems rely on full-context prompting,…

Computation and Language · Computer Science 2025-07-18 Zijian Zhou , Ao Qu , Zhaoxuan Wu , Sunghwan Kim , Alok Prakash , Daniela Rus , Jinhua Zhao , Bryan Kian Hsiang Low , Paul Pu Liang

Multimodal semantic learning plays a critical role in embodied intelligence, especially when robots perceive their surroundings, understand human instructions, and make intelligent decisions. However, the field faces technical challenges…

Robotics · Computer Science 2025-09-24 Zeyi Kang , Liang He , Yanxin Zhang , Zuheng Ming , Kaixing Zhao