English
Related papers

Related papers: ConEQsA: Concurrent and Asynchronous Embodied Ques…

200 papers

Visual Question Answering (VQA) models employ attention mechanisms to discover image locations that are most relevant for answering a specific question. For this purpose, several multimodal fusion strategies have been proposed, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Moshiur R Farazi , Salman H Khan , Nick Barnes

The creation and support of Embodied Conversational Agents (ECAs) has been quite challenging, as features required might not be straight-forward to implement and to integrate in a single application. Furthermore, ECAs as desktop…

Human-Computer Interaction · Computer Science 2018-11-15 Gerard Llorach , Josep Blat

The goal of the Acoustic Question Answering (AQA) task is to answer a free-form text question about the content of an acoustic scene. It was inspired by the Visual Question Answering (VQA) task. In this paper, based on the previously…

Computation and Language · Computer Science 2024-01-15 Jerome Abdelnour , Jean Rouat , Giampiero Salvi

Visual events are a composition of temporal actions involving actors spatially interacting with objects. When developing computer vision models that can reason about compositional spatio-temporal events, we need benchmarks that can analyze…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Madeleine Grunde-McLaughlin , Ranjay Krishna , Maneesh Agrawala

Embodied agents capable of complex physical skills can improve productivity, elevate life quality, and reshape human-machine collaboration. We aim at autonomous training of embodied agents for various tasks involving mainly large foundation…

Robotics · Computer Science 2024-02-14 Sizhe Yang , Qian Luo , Anumpam Pani , Yanchao Yang

The EmbodiedQA is a task of training an embodied agent by intelligently navigating in a simulated environment and gathering visual information to answer questions. Existing approaches fail to explicitly model the mental imagery function of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Juncheng Li , Siliang Tang , Fei Wu , Yueting Zhuang

Egocentric augmented reality devices such as wearable glasses passively capture visual data as a human wearer tours a home environment. We envision a scenario wherein the human communicates with an AI agent powering such a device by asking…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Samyak Datta , Sameer Dharur , Vincent Cartillier , Ruta Desai , Mukul Khanna , Dhruv Batra , Devi Parikh

Embodied agents are evolving from passive reasoning systems into active executors that interact with tools, robots, and physical environments. Once granted execution authority, the central challenge becomes how to keep actions governable at…

Robotics · Computer Science 2026-05-22 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Embodied AI development significantly lags behind large foundation models due to three critical challenges: (1) lack of systematic understanding of core capabilities needed for Embodied AI, making research lack clear objectives; (2) absence…

We present ECG-Expert-QA, a comprehensive multimodal dataset for evaluating diagnostic capabilities in electrocardiogram (ECG) interpretation. It combines real-world clinical ECG data with systematically generated synthetic cases, covering…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Xu Wang , Jiaju Kang , Puyu Han , Yubao Zhao , Qian Liu , Liwenfei He , Lingqiong Zhang , Lingyun Dai , Yongcheng Wang , Jie Tao

In this paper, we present a general response-time analysis and schedulability-test framework, called k2Q (k to Q). It provides automatic constructions of closed-form quadratic bounds or utilization bounds for a wide range of applications in…

Data Structures and Algorithms · Computer Science 2016-09-26 Jian-Jia Chen , Wen-Hung Huang , Cong Liu

In spoken question answering, QA systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that human seek or test their knowledge is via human conversations.…

Computation and Language · Computer Science 2020-10-20 Chenyu You , Nuo Chen , Fenglin Liu , Dongchao Yang , Yuexian Zou

A question answering (QA) system is a type of conversational AI that generates natural language answers to questions posed by human users. QA systems often form the backbone of interactive dialogue systems, and have been studied extensively…

Software Engineering · Computer Science 2021-01-12 Aakash Bansal , Zachary Eberhart , Lingfei Wu , Collin McMillan

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

Computation and Language · Computer Science 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

Modern QA systems entail retrieval-augmented generation (RAG) for accurate and trustworthy responses. However, the inherent gap between user queries and relevant documents hinders precise matching. We introduce QAEncoder, a training-free…

Computation and Language · Computer Science 2025-07-03 Zhengren Wang , Qinhan Yu , Shida Wei , Zhiyu Li , Feiyu Xiong , Xiaoxing Wang , Simin Niu , Hao Liang , Wentao Zhang

Embodied artificial intelligence emphasizes the role of an agent's body in generating human-like behaviors. The recent efforts on EmbodiedAI pay a lot of attention to building up machine learning models to possess perceiving, planning, and…

Artificial Intelligence · Computer Science 2024-10-15 Chen Gao , Baining Zhao , Weichen Zhang , Jinzhu Mao , Jun Zhang , Zhiheng Zheng , Fanhang Man , Jianjie Fang , Zile Zhou , Jinqiang Cui , Xinlei Chen , Yong Li

We present Task 5 of the DCASE 2025 Challenge: an Audio Question Answering (AQA) benchmark spanning multiple domains of sound understanding. This task defines three QA subsets (Bioacoustics, Temporal Soundscapes, and Complex QA) to test…

We introduce DeepSearchQA, a 900-prompt benchmark for evaluating agents on difficult multi-step information-seeking tasks across 17 different fields. Unlike traditional benchmarks that target single answer retrieval or broad-spectrum…

In this work, we study Cooperative Spatial Intelligence, the ability of decentralized embodied agents to coordinate effectively under dynamic environmental constraints across city-scale outdoor domains. We introduce Sentinel Challenge, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiangye Lin , Hongxin Zhang , Ruxi Deng , Qinhong Zhou , Chuang Gan

Question answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in languages other than English,…

Computation and Language · Computer Science 2020-05-05 Patrick Lewis , Barlas Oğuz , Ruty Rinott , Sebastian Riedel , Holger Schwenk