English
Related papers

Related papers: Multi-Step Reasoning for Embodied Question Answeri…

200 papers

Business documents often contain substantial tabular and textual information with numerical values, requiring mathematical reasoning for effective document understanding. While Small Language Models (SLMs) still struggle at this task,…

Machine Learning · Computer Science 2025-08-22 Vishnou Vinayagame , Gregory Senay , Luis Martí

In this paper we present a new dataset and user simulator e-QRAQ (explainable Query, Reason, and Answer Question) which tests an Agent's ability to read an ambiguous text; ask questions until it can answer a challenge question; and explain…

Machine Learning · Computer Science 2017-08-08 Clemens Rosenbaum , Tian Gao , Tim Klinger

Large Language Models (LLMs), acting as a powerful reasoner and generator, exhibit extraordinary performance across various natural language tasks, such as question answering (QA). Among these tasks, Multi-Hop Question Answering (MHQA)…

Computation and Language · Computer Science 2023-09-25 Yin Zhu , Zhiling Luo , Gong Cheng

Question answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in languages other than English,…

Computation and Language · Computer Science 2020-05-05 Patrick Lewis , Barlas Oğuz , Ruty Rinott , Sebastian Riedel , Holger Schwenk

Unsupervised question answering is an attractive task due to its independence on labeled data. Previous works usually make use of heuristic rules as well as pre-trained models to construct data and train QA models. However, most of these…

Computation and Language · Computer Science 2022-08-24 Yuxiang Nie , Heyan Huang , Zewen Chi , Xian-Ling Mao

The immense diversity in the culture and culinary of Indian cuisines calls attention to the major shortcoming of the existing Visual Question Answering(VQA) systems which are inclined towards the foods from Western region. Recent attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Riddhi Jain , Manasi Patwardhan , Parijat Deshpande , Venkataramana Runkana

Tourism and travel planning increasingly rely on digital assistance, yet existing multimodal AI systems often lack specialized knowledge and contextual understanding of urban environments. We present TraveLLaMA, a specialized multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Meng Chu , Yukang Chen , Haokun Gui , Shaozuo Yu , Yi Wang , Jiaya Jia

Entity matching is a fundamental task in data cleaning and data integration. With the rapid adoption of large language models (LLMs), recent studies have explored zero-shot and few-shot prompting to improve entity matching accuracy.…

Databases · Computer Science 2025-12-01 Rohan Bopardikar , Jin Wang , Jia Zou

Visual Question Answering (VQA) has witnessed tremendous progress in recent years. However, most efforts only focus on the 2D image question answering tasks. In this paper, we present the first attempt at extending VQA to the 3D domain,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Shuquan Ye , Dongdong Chen , Songfang Han , Jing Liao

Extractive Question Answering (EQA) is one of the most important tasks in Machine Reading Comprehension (MRC), which can be solved by fine-tuning the span selecting heads of Pre-trained Language Models (PLMs). However, most existing…

Computation and Language · Computer Science 2022-05-09 Jianing Wang , Chengyu Wang , Minghui Qiu , Qiuhui Shi , Hongbin Wang , Jun Huang , Ming Gao

Emotional Support Conversation requires not only affective expression but also grounded instrumental support to provide trustworthy guidance. However, existing ESC systems and benchmarks largely focus on affective support in text-only…

Artificial Intelligence · Computer Science 2026-05-11 Xingyu Sui , Yanyan Zhao , Yulin Hu , Jiahe Guo , Weixiang Zhao , Bing Qin

As general intelligent agents are poised for widespread deployment in diverse households, evaluation tailored to each unique unseen 3D environment has become a critical prerequisite. However, existing benchmarks suffer from severe data…

Artificial Intelligence · Computer Science 2026-02-06 Xinyi He , Ying Yang , Chuanjian Fu , Sihan Guo , Songchun Zhu , Lifeng Fan , Zhenliang Zhang , Yujia Peng

Situation awareness is essential for understanding and reasoning about 3D scenes in embodied AI agents. However, existing datasets and benchmarks for situated understanding are limited in data modality, diversity, scale, and task scope. To…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Xiongkun Linghu , Jiangyong Huang , Xuesong Niu , Xiaojian Ma , Baoxiong Jia , Siyuan Huang

With strong capabilities of reasoning and a broad understanding of the world, Large Language Models (LLMs) have demonstrated immense potential in building versatile embodied decision-making agents capable of executing a wide array of tasks.…

Artificial Intelligence · Computer Science 2024-04-17 Xiaoyu Chen , Shenao Zhang , Pushi Zhang , Li Zhao , Jianyu Chen

Embodied Question Answering (EQA) has traditionally been evaluated in temporally stable environments where visual evidence can be accumulated reliably. However, in dynamic, human-populated scenes, human activities and occlusions introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xin Lu , Rui Li , Xun Huang , Weixin Li , Chuanqing Zhuang , Jiayuan Li , Zhengda Lu , Jun Xiao , Yunhong Wang

Effective human-agent collaboration in physical environments requires understanding not only what to act upon, but also where the actionable elements are and how to interact with them. Existing approaches often operate at the object level…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinyi Wang , Xun Yang , Yanlong Xu , Yuchen Wu , Zhen Li , Na Zhao

The increase in available computing power and the Deep Learning revolution have allowed the exploration of new topics and frontiers in Artificial Intelligence research. A new field called Embodied Artificial Intelligence, which places at…

Robotics · Computer Science 2025-05-05 Roberto Bigazzi

Embodied conversational agents (ECAs) are increasingly more realistic and capable of dynamic conversations. In online surveys, anthropomorphic agents could help address issues like careless responding and satisficing, which originate from…

Human-Computer Interaction · Computer Science 2025-08-05 Matus Krajcovic , Peter Demcak , Eduard Kuric

Healthcare question answering assistance aims to provide customer healthcare information, which widely appears in both Web and mobile Internet. The questions usually require the assistance to have proficient healthcare background knowledge…

Artificial Intelligence · Computer Science 2020-09-29 Ye Liu , Shaika Chowdhury , Chenwei Zhang , Cornelia Caragea , Philip S. Yu

Existing benchmarks for visual question answering lack in visual grounding and complexity, particularly in evaluating spatial reasoning skills. We introduce FlowVQA, a novel benchmark aimed at assessing the capabilities of visual…

Computation and Language · Computer Science 2024-07-01 Shubhankar Singh , Purvi Chaurasia , Yerram Varun , Pranshu Pandya , Vatsal Gupta , Vivek Gupta , Dan Roth