English
Related papers

Related papers: TempTabQA: Temporal Question Answering for Semi-St…

200 papers

Large Language Models (LLMs) have demonstrated impressive performance in various NLP tasks, but they still suffer from challenges such as hallucination and weak numerical reasoning. To overcome these challenges, external tools can be used…

Computation and Language · Computer Science 2023-06-26 Yuchen Zhuang , Yue Yu , Kuan Wang , Haotian Sun , Chao Zhang

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

The abundant semi-structured data on the Web, such as HTML-based tables and lists, provide commercial search engines a rich information source for question answering (QA). Different from plain text passages in Web documents, Web tables and…

Computation and Language · Computer Science 2020-10-15 Xingyao Zhang , Linjun Shou , Jian Pei , Ming Gong , Lijie Wen , Daxin Jiang

Advances in natural language processing tasks have gained momentum in recent years due to the increasingly popular neural network methods. In this paper, we explore deep learning techniques for answering multi-step reasoning questions that…

Computation and Language · Computer Science 2018-03-23 Till Haug , Octavian-Eugen Ganea , Paulina Grnarova

Temporal reasoning about historical events is a critical skill for NLP tasks like event extraction, historical entity linking, temporal question answering, timeline summarization, temporal event clustering and temporal natural language…

Computation and Language · Computer Science 2025-09-17 Biswadip Mandal , Anant Khandelwal , Manish Gupta

Knowledge in the real world is being updated constantly. However, it is costly to frequently update large language models (LLMs). Therefore, it is crucial for LLMs to understand the concept of temporal knowledge. However, prior works on…

Computation and Language · Computer Science 2024-07-15 Qingyu Tan , Hwee Tou Ng , Lidong Bing

The problem of verifying whether a textual hypothesis holds based on the given evidence, also known as fact verification, plays an important role in the study of natural language understanding and semantic representation. However, existing…

Computation and Language · Computer Science 2020-06-16 Wenhu Chen , Hongmin Wang , Jianshu Chen , Yunkai Zhang , Hong Wang , Shiyang Li , Xiyou Zhou , William Yang Wang

This paper introduces DateLogicQA, a benchmark with 190 questions covering diverse date formats, temporal contexts, and reasoning types. We propose the Semantic Integrity Metric to assess tokenization quality and analyse two biases:…

Computation and Language · Computer Science 2025-05-20 Gagan Bhatia , MingZe Tang , Cristina Mahanta , Madiha Kazi

We study a new problem setting of question answering (QA), referred to as DocTabQA. Within this setting, given a long document, the goal is to respond to questions by organizing the answers into structured tables derived directly from the…

Computation and Language · Computer Science 2024-08-22 Haochen Wang , Kai Hu , Haoyu Dong , Liangcai Gao

Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain. This study explores LLMs'…

Computation and Language · Computer Science 2025-10-10 Pragya Srivastava , Manuj Malik , Vivek Gupta , Tanuja Ganu , Dan Roth

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

Process reward models (PRMs) enhance complex reasoning in large language models (LLMs) by evaluating candidate solutions step-by-step and selecting answers based on aggregated step scores. While effective in domains such as mathematics,…

Computation and Language · Computer Science 2026-01-26 Lei Tang , Wei Zhou , Mohsen Mesgar

Time-Sensitive Question Answering (TSQA) demands the effective utilization of specific temporal contexts, encompassing multiple time-evolving facts, to address time-sensitive questions. This necessitates not only the parsing of temporal…

Computation and Language · Computer Science 2024-10-01 Wanqi Yang , Yanda Li , Meng Fang , Ling Chen

Semantic parsing methods for converting text to SQL queries enable question answering over structured data and can greatly benefit analysts who routinely perform complex analytics on vast data stored in specialized relational databases.…

Databases · Computer Science 2025-09-25 Mounica Maddela , Lingjue Xie , Daniel Preotiuc-Pietro , Mausam

Question answering on free-form tables (a.k.a. TableQA) is a challenging task because of the flexible structure and complex schema of tables. Recent studies use Large Language Models (LLMs) for this task, exploiting their capability in…

Computation and Language · Computer Science 2025-06-17 Yuxiang Wang , Jianzhong Qi , Junhao Gan

Existing table question answering datasets contain abundant factual questions that primarily evaluate the query and schema comprehension capability of a system, but they fail to include questions that require complex reasoning and…

Temporal logical understanding, a core facet of human cognition, plays a pivotal role in capturing complex sequential events and their temporal relationships within videos. This capability is particularly crucial in tasks like Video…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Sirnam Swetha , Hilde Kuehne , Mubarak Shah

In the last few years, open-domain question answering (ODQA) has advanced rapidly due to the development of deep learning techniques and the availability of large-scale QA datasets. However, the current datasets are essentially designed for…

Computation and Language · Computer Science 2022-02-23 Jiexin Wang , Adam Jatowt , Masatoshi Yoshikawa

This paper presents MobQA, a benchmark dataset designed to evaluate the semantic understanding capabilities of large language models (LLMs) for human mobility data through natural language question answering. While existing models excel at…

Computation and Language · Computer Science 2025-08-18 Hikaru Asano , Hiroki Ouchi , Akira Kasuga , Ryo Yonetani

We introduce ChronoQA, a large-scale benchmark dataset for Chinese question answering, specifically designed to evaluate temporal reasoning in Retrieval-Augmented Generation (RAG) systems. ChronoQA is constructed from over 300,000 news…

Computation and Language · Computer Science 2025-08-19 Ziyang Chen , Erxue Min , Xiang Zhao , Yunxin Li , Xin Jia , Jinzhi Liao , Jichao Li , Shuaiqiang Wang , Baotian Hu , Dawei Yin