English
Related papers

Related papers: A Benchmark for Generalizable and Interpretable Te…

200 papers

Existing Knowledge Base Question Answering (KBQA) architectures are hungry for annotated data, which make them costly and time-consuming to deploy. We introduce the problem of few-shot transfer learning for KBQA, where the target domain…

Computation and Language · Computer Science 2024-06-14 Mayur Patidar , Riya Sawhney , Avinash Singh , Biswajit Chatterjee , Mausam , Indrajit Bhattacharya

Temporal Knowledge Graph Question Answering (TKGQA) is inherently challenging, as it requires sophisticated reasoning over dynamic facts with multi-hop dependencies and complex temporal constraints. Existing methods rely on fixed workflows…

Computation and Language · Computer Science 2026-04-22 Zhaoyan Gong , Zhiqiang Liu , Songze Li , Xiaoke Guo , Yuanxiang Liu , Xinle Deng , Zhizhen Liu , Lei Liang , Huajun Chen , Wen Zhang

We introduce NExT-QA, a rigorously designed video question answering (VideoQA) benchmark to advance video understanding from describing to explaining the temporal actions. Based on the dataset, we set up multi-choice and open-ended QA tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Junbin Xiao , Xindi Shang , Angela Yao , Tat-Seng Chua

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

The advent of large language models (LLMs) has unlocked great opportunities in complex data management tasks, particularly in question answering (QA) over complicated multi-table relational data. Despite significant progress, systematically…

Artificial Intelligence · Computer Science 2024-12-02 Zipeng Qiu , You Peng , Guangxin He , Binhang Yuan , Chen Wang

Multi-modal language model has made advanced progress in vision and audio, but still faces significant challenges in dealing with complex reasoning tasks in the time series domain. The reasons are twofold. First, labels for multi-modal time…

Machine Learning · Computer Science 2025-03-10 Haochuan Zhang , Chunhua Yang , Jie Han , Liyang Qin , Xiaoli Wang

Existing question answering methods infer answers either from a knowledge base or from raw text. While knowledge base (KB) methods are good at answering compositional questions, their performance is often affected by the incompleteness of…

Computation and Language · Computer Science 2017-04-28 Rajarshi Das , Manzil Zaheer , Siva Reddy , Andrew McCallum

With social media becoming increasingly pop-ular on which lots of news and real-time eventsare reported, developing automated questionanswering systems is critical to the effective-ness of many applications that rely on real-time knowledge.…

Computation and Language · Computer Science 2019-07-16 Wenhan Xiong , Jiawei Wu , Hong Wang , Vivek Kulkarni , Mo Yu , Shiyu Chang , Xiaoxiao Guo , William Yang Wang

Open domain question answering (ODQA) is a longstanding task aimed at answering factual questions from a large knowledge corpus without any explicit evidence in natural language processing (NLP). Recent works have predominantly focused on…

Computation and Language · Computer Science 2022-11-16 Qin Zhang , Shangsi Chen , Dongkuan Xu , Qingqing Cao , Xiaojun Chen , Trevor Cohn , Meng Fang

A key limitation in current datasets for multi-hop reasoning is that the required steps for answering the question are mentioned in it explicitly. In this work, we introduce StrategyQA, a question answering (QA) benchmark where the required…

Computation and Language · Computer Science 2021-01-08 Mor Geva , Daniel Khashabi , Elad Segal , Tushar Khot , Dan Roth , Jonathan Berant

Given an image and an associated textual question, the purpose of Knowledge-Based Visual Question Answering (KB-VQA) is to provide a correct answer to the question with the aid of external knowledge bases. Prior KB-VQA models are usually…

Machine Learning · Computer Science 2023-10-13 Jingru Gan , Xinzhe Han , Shuhui Wang , Qingming Huang

In the wake of the recent resurgence of the Datalog language of databases, together with its extensions for ontological reasoning settings, this work aims to bridge the gap between the theoretical studies of DatalogMTL (Datalog extended…

Databases · Computer Science 2025-06-11 Luigi Bellomarini , Livia Blasi , Markus Nissl , Emanuel Sallinger

Relation detection is a core component for many NLP applications including Knowledge Base Question Answering (KBQA). In this paper, we propose a hierarchical recurrent neural network enhanced by residual learning that detects KB relations…

Computation and Language · Computer Science 2017-05-30 Mo Yu , Wenpeng Yin , Kazi Saidul Hasan , Cicero dos Santos , Bing Xiang , Bowen Zhou

Question answering over temporal knowledge graphs (KGs) efficiently uses facts contained in a temporal KG, which records entity relations and when they occur in time, to answer natural language questions (e.g., "Who was the president of the…

Computation and Language · Computer Science 2022-03-02 Chao Shang , Guangtao Wang , Peng Qi , Jing Huang

Large Language Models (LLMs) have led to significant improvements in the Knowledge Base Question Answering (KBQA) task. However, datasets used in KBQA studies do not capture the true complexity of KBQA tasks. They either have simple…

Computation and Language · Computer Science 2024-10-22 Shicheng Liu , Sina J. Semnani , Harold Triedman , Jialiang Xu , Isaac Dan Zhao , Monica S. Lam

Event forecasting is a challenging, yet important task, as humans seek to constantly plan for the future. Existing automated forecasting studies rely mostly on structured data, such as time-series or event-based knowledge graphs, to help…

Machine Learning · Computer Science 2021-06-09 Woojeong Jin , Rahul Khanna , Suji Kim , Dong-Ho Lee , Fred Morstatter , Aram Galstyan , Xiang Ren

We present SemanticQA, an evaluation suite designed to assess language models (LMs) in semantic phrase processing tasks. The benchmark consolidates existing multiword expression (MwE) resources and reorganizes them into a unified testbed.…

Computation and Language · Computer Science 2026-05-20 Yang Liu , Hongming Li , Melissa Xiaohui Qin , Qiankun Liu , Chao Huang

Knowledge-based question answering (KBQA) is widely used in many scenarios that necessitate domain knowledge. Large language models (LLMs) bring opportunities to KBQA, while their costs are significantly higher and absence of…

Computation and Language · Computer Science 2024-05-28 Junnan Dong , Qinggang Zhang , Chuang Zhou , Hao Chen , Daochen Zha , Xiao Huang

Temporal Knowledge Graph Question Answering (TKGQA) is challenging because it requires multi-hop reasoning under complex temporal constraints. Recent LLM-based approaches have improved semantic modeling for this task, but many still rely on…

Computation and Language · Computer Science 2026-03-26 Xufei Lv , Jiahui Yang , Haoyuan Sun , Xialin Su , Zhiliang Tian , Yifu Gao , Linbo Qiao , Houde Liu

Charts are very popular for analyzing data. When exploring charts, people often ask a variety of complex reasoning questions that involve several logical and arithmetic operations. They also commonly refer to visual features of a chart in…

Computation and Language · Computer Science 2022-03-22 Ahmed Masry , Do Xuan Long , Jia Qing Tan , Shafiq Joty , Enamul Hoque