中文
相关论文

相关论文: A Dataset for Answering Time-Sensitive Questions

200 篇论文

Reasoning about temporal causality, particularly irreversible transformations of objects governed by real-world knowledge (e.g., fruit decay and human aging), is a fundamental aspect of human visual understanding. Unlike temporal perception…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Zeqing Wang , Shiyuan Zhang , Chengpei Tang , Keze Wang

Many facts come with an expiration date, from the name of the President to the basketball team Lebron James plays for. But language models (LMs) are trained on snapshots of data collected at a specific moment in time, and this can limit…

Sensitivity to false assumptions (or false premises) in information-seeking questions is critical for robust question-answering (QA) systems. Recent work has shown that false assumptions in naturally occurring questions pose challenges to…

计算与语言 · 计算机科学 2024-03-20 Ashwin Daswani , Rohan Sawant , Najoung Kim

Subjectivity is the expression of internal opinions or beliefs which cannot be objectively observed or verified, and has been shown to be important for sentiment analysis and word-sense disambiguation. Furthermore, subjectivity is an…

计算与语言 · 计算机科学 2020-10-07 Johannes Bjerva , Nikita Bhutani , Behzad Golshan , Wang-Chiew Tan , Isabelle Augenstein

Readers of academic research papers often read with the goal of answering specific questions. Question Answering systems that can answer those questions can make consumption of the content much more efficient. However, building such tools…

计算与语言 · 计算机科学 2021-05-10 Pradeep Dasigi , Kyle Lo , Iz Beltagy , Arman Cohan , Noah A. Smith , Matt Gardner

State-of-the-art conversational agents have advanced significantly in conjunction with the use of large transformer-based language models. However, even with these advancements, conversational agents still lack the ability to produce…

计算与语言 · 计算机科学 2020-10-21 Sashank Santhanam , Wei Ping , Raul Puri , Mohammad Shoeybi , Mostofa Patwary , Bryan Catanzaro

Recent years have witnessed an increasing interest in training machines with reasoning ability, which deeply relies on accurately and clearly presented clue forms. The clues are usually modeled as entity-aware knowledge in existing studies.…

计算与语言 · 计算机科学 2023-05-29 Siru Ouyang , Zhuosheng Zhang , Hai Zhao

Question-answering (QA) on hybrid scientific tabular and textual data deals with scientific information, and relies on complex numerical reasoning. In recent years, while tabular QA has seen rapid progress, understanding their robustness on…

计算与语言 · 计算机科学 2024-04-02 Akash Ghosh , B Venkata Sahith , Niloy Ganguly , Pawan Goyal , Mayank Singh

A fundamental challenge in the current NLP context, dominated by language models, comes from the inflexibility of current architectures to 'learn' new information. While model-centric solutions like continual learning or parameter-efficient…

计算与语言 · 计算机科学 2023-08-21 Hsuvas Borkakoty , Luis Espinosa-Anke

Learning how to predict future events from patterns of past events is difficult when the set of possible event types is large. Training an unrestricted neural model might overfit to spurious patterns. To exploit domain-specific knowledge of…

机器学习 · 计算机科学 2020-08-18 Hongyuan Mei , Guanghui Qin , Minjie Xu , Jason Eisner

Automated reasoning with unstructured natural text is a key requirement for many potential applications of NLP and for developing robust AI systems. Recently, Language Models (LMs) have demonstrated complex reasoning capacities even without…

计算与语言 · 计算机科学 2023-06-14 Mehran Kazemi , Quan Yuan , Deepti Bhatia , Najoung Kim , Xin Xu , Vaiva Imbrasaite , Deepak Ramachandran

LLMs acquire knowledge from massive data snapshots collected at different timestamps. Their knowledge is then commonly evaluated using static benchmarks. However, factual knowledge is generally subject to time-sensitive changes, and static…

计算与语言 · 计算机科学 2024-10-03 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

Everyday conversations require understanding everyday events, which in turn, requires understanding temporal commonsense concepts interwoven with those events. Despite recent progress with massive pre-trained language models (LMs) such as…

计算与语言 · 计算机科学 2021-06-09 Lianhui Qin , Aditya Gupta , Shyam Upadhyay , Luheng He , Yejin Choi , Manaal Faruqui

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

计算与语言 · 计算机科学 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

Existing temporal QA benchmarks focus on simple fact-seeking queries from news corpora, while reasoning-intensive retrieval benchmarks lack temporal grounding. However, real-world information needs often require reasoning about temporal…

信息检索 · 计算机科学 2026-01-15 Abdelrahman Abdallah , Mohammed Ali , Muhammad Abdul-Mageed , Adam Jatowt

Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we…

计算与语言 · 计算机科学 2025-07-01 Yaxuan Kong , Yiyuan Yang , Yoontae Hwang , Wenjie Du , Stefan Zohren , Zhangyang Wang , Ming Jin , Qingsong Wen

Language use changes over time, and this impacts the effectiveness of NLP systems. This phenomenon is even more prevalent in social media data during crisis events where meaning and frequency of word usage may change over the course of…

计算与语言 · 计算机科学 2022-11-10 Aniket Pramanick , Tilman Beck , Kevin Stowe , Iryna Gurevych

The dynamic nature of knowledge in an ever-changing world presents challenges for language models trained on static data; the model in the real world often requires not only acquiring new knowledge but also overwriting outdated information…

计算与语言 · 计算机科学 2024-04-23 Yujin Kim , Jaehong Yoon , Seonghyeon Ye , Sangmin Bae , Namgyu Ho , Sung Ju Hwang , Se-young Yun

LLMs often fail to handle temporal knowledge conflicts--contradictions arising when facts evolve over time within their training data. Existing studies evaluate this phenomenon through benchmarks built on structured knowledge bases like…

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

计算与语言 · 计算机科学 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti