English
Related papers

Related papers: A Dataset for Answering Time-Sensitive Questions

200 papers

Reasoning about temporal causality, particularly irreversible transformations of objects governed by real-world knowledge (e.g., fruit decay and human aging), is a fundamental aspect of human visual understanding. Unlike temporal perception…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Zeqing Wang , Shiyuan Zhang , Chengpei Tang , Keze Wang

Many facts come with an expiration date, from the name of the President to the basketball team Lebron James plays for. But language models (LMs) are trained on snapshots of data collected at a specific moment in time, and this can limit…

Computation and Language · Computer Science 2022-04-26 Bhuwan Dhingra , Jeremy R. Cole , Julian Martin Eisenschlos , Daniel Gillick , Jacob Eisenstein , William W. Cohen

Sensitivity to false assumptions (or false premises) in information-seeking questions is critical for robust question-answering (QA) systems. Recent work has shown that false assumptions in naturally occurring questions pose challenges to…

Computation and Language · Computer Science 2024-03-20 Ashwin Daswani , Rohan Sawant , Najoung Kim

Subjectivity is the expression of internal opinions or beliefs which cannot be objectively observed or verified, and has been shown to be important for sentiment analysis and word-sense disambiguation. Furthermore, subjectivity is an…

Computation and Language · Computer Science 2020-10-07 Johannes Bjerva , Nikita Bhutani , Behzad Golshan , Wang-Chiew Tan , Isabelle Augenstein

Readers of academic research papers often read with the goal of answering specific questions. Question Answering systems that can answer those questions can make consumption of the content much more efficient. However, building such tools…

Computation and Language · Computer Science 2021-05-10 Pradeep Dasigi , Kyle Lo , Iz Beltagy , Arman Cohan , Noah A. Smith , Matt Gardner

State-of-the-art conversational agents have advanced significantly in conjunction with the use of large transformer-based language models. However, even with these advancements, conversational agents still lack the ability to produce…

Computation and Language · Computer Science 2020-10-21 Sashank Santhanam , Wei Ping , Raul Puri , Mohammad Shoeybi , Mostofa Patwary , Bryan Catanzaro

Recent years have witnessed an increasing interest in training machines with reasoning ability, which deeply relies on accurately and clearly presented clue forms. The clues are usually modeled as entity-aware knowledge in existing studies.…

Computation and Language · Computer Science 2023-05-29 Siru Ouyang , Zhuosheng Zhang , Hai Zhao

Question-answering (QA) on hybrid scientific tabular and textual data deals with scientific information, and relies on complex numerical reasoning. In recent years, while tabular QA has seen rapid progress, understanding their robustness on…

Computation and Language · Computer Science 2024-04-02 Akash Ghosh , B Venkata Sahith , Niloy Ganguly , Pawan Goyal , Mayank Singh

A fundamental challenge in the current NLP context, dominated by language models, comes from the inflexibility of current architectures to 'learn' new information. While model-centric solutions like continual learning or parameter-efficient…

Computation and Language · Computer Science 2023-08-21 Hsuvas Borkakoty , Luis Espinosa-Anke

Learning how to predict future events from patterns of past events is difficult when the set of possible event types is large. Training an unrestricted neural model might overfit to spurious patterns. To exploit domain-specific knowledge of…

Machine Learning · Computer Science 2020-08-18 Hongyuan Mei , Guanghui Qin , Minjie Xu , Jason Eisner

Automated reasoning with unstructured natural text is a key requirement for many potential applications of NLP and for developing robust AI systems. Recently, Language Models (LMs) have demonstrated complex reasoning capacities even without…

Computation and Language · Computer Science 2023-06-14 Mehran Kazemi , Quan Yuan , Deepti Bhatia , Najoung Kim , Xin Xu , Vaiva Imbrasaite , Deepak Ramachandran

LLMs acquire knowledge from massive data snapshots collected at different timestamps. Their knowledge is then commonly evaluated using static benchmarks. However, factual knowledge is generally subject to time-sensitive changes, and static…

Computation and Language · Computer Science 2024-10-03 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

Everyday conversations require understanding everyday events, which in turn, requires understanding temporal commonsense concepts interwoven with those events. Despite recent progress with massive pre-trained language models (LMs) such as…

Computation and Language · Computer Science 2021-06-09 Lianhui Qin , Aditya Gupta , Shyam Upadhyay , Luheng He , Yejin Choi , Manaal Faruqui

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

Computation and Language · Computer Science 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

Existing temporal QA benchmarks focus on simple fact-seeking queries from news corpora, while reasoning-intensive retrieval benchmarks lack temporal grounding. However, real-world information needs often require reasoning about temporal…

Information Retrieval · Computer Science 2026-01-15 Abdelrahman Abdallah , Mohammed Ali , Muhammad Abdul-Mageed , Adam Jatowt

Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we…

Computation and Language · Computer Science 2025-07-01 Yaxuan Kong , Yiyuan Yang , Yoontae Hwang , Wenjie Du , Stefan Zohren , Zhangyang Wang , Ming Jin , Qingsong Wen

Language use changes over time, and this impacts the effectiveness of NLP systems. This phenomenon is even more prevalent in social media data during crisis events where meaning and frequency of word usage may change over the course of…

Computation and Language · Computer Science 2022-11-10 Aniket Pramanick , Tilman Beck , Kevin Stowe , Iryna Gurevych

The dynamic nature of knowledge in an ever-changing world presents challenges for language models trained on static data; the model in the real world often requires not only acquiring new knowledge but also overwriting outdated information…

Computation and Language · Computer Science 2024-04-23 Yujin Kim , Jaehong Yoon , Seonghyeon Ye , Sangmin Bae , Namgyu Ho , Sung Ju Hwang , Se-young Yun

LLMs often fail to handle temporal knowledge conflicts--contradictions arising when facts evolve over time within their training data. Existing studies evaluate this phenomenon through benchmarks built on structured knowledge bases like…

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

Computation and Language · Computer Science 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti