中文
相关论文

相关论文: Syn-QA2: Evaluating False Assumptions in Long-tail…

200 篇论文

Understanding data visualizations like charts and plots requires reasoning about both visual elements and numerics. Although strong in extractive questions, current chart visual question answering (chart VQA) models suffer on complex…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Zhuowan Li , Bhavan Jasani , Peng Tang , Shabnam Ghadar

When Question-Answering (QA) systems are deployed in the real world, users query them through a variety of interfaces, such as speaking to voice assistants, typing questions into a search engine, or even translating questions to languages…

计算与语言 · 计算机科学 2021-02-17 Abhilasha Ravichander , Siddharth Dalmia , Maria Ryskina , Florian Metze , Eduard Hovy , Alan W Black

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

计算与语言 · 计算机科学 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

The information in tables can be an important complement to text, making table-based question answering (QA) systems of great value. The intrinsic complexity of handling tables often adds an extra burden to both model design and data…

计算与语言 · 计算机科学 2022-07-11 Zhengbao Jiang , Yi Mao , Pengcheng He , Graham Neubig , Weizhu Chen

Natural Language Processing (NLP) has undergone transformative changes with the advent of deep learning methodologies. One challenge persistently confronting researchers is the scarcity of high-quality, annotated datasets that drive these…

计算与语言 · 计算机科学 2023-10-13 Sia Gholami , Marwan Omar

We propose a novel text generation task, namely Curiosity-driven Question Generation. We start from the observation that the Question Generation task has traditionally been considered as the dual problem of Question Answering, hence…

计算与语言 · 计算机科学 2019-11-11 Thomas Scialom , Jacopo Staiano

Verifying fact-checking claims poses a significant challenge, even for humans. Recent approaches have demonstrated that decomposing claims into relevant questions to gather evidence enhances the efficiency of the fact-checking process. In…

计算与语言 · 计算机科学 2024-08-02 Ritvik Setty , Vinay Setty

Though current long-context large language models (LLMs) have demonstrated impressive capacities in answering user questions based on extensive text, the lack of citations in their responses makes user verification difficult, leading to…

计算与语言 · 计算机科学 2024-09-11 Jiajie Zhang , Yushi Bai , Xin Lv , Wanjun Gu , Danqing Liu , Minhao Zou , Shulin Cao , Lei Hou , Yuxiao Dong , Ling Feng , Juanzi Li

Recent developments in large language models (LLMs) have shown promise in their ability to generate synthetic query-document pairs by prompting with as few as 8 demonstrations. This has enabled building better IR models, especially for…

计算与语言 · 计算机科学 2023-11-15 Aditi Chaudhary , Karthik Raman , Michael Bendersky

Large language models (LLMs) demonstrate remarkable performance across various tasks, prompting researchers to develop diverse evaluation benchmarks. However, most benchmarks typically measure the ability of LLMs to respond to individual…

计算与语言 · 计算机科学 2026-01-30 Yutao Hou , Yajing Luo , Zhiwen Ruan , Hongru Wang , Weifeng Ge , Yun Chen , Guanhua Chen

Real-world data often have an open long-tailed distribution, and building a unified QA model supporting various tasks is vital for practical QA applications. However, it is non-trivial to extend previous QA approaches since they either…

计算与语言 · 计算机科学 2023-05-12 Yi Dai , Hao Lang , Yinhe Zheng , Fei Huang , Yongbin Li

Natural Language Sentence Matching (NLSM) has gained substantial attention from both academics and the industry, and rich public datasets contribute a lot to this process. However, biased datasets can also hurt the generalization…

计算与语言 · 计算机科学 2019-06-11 Guanhua Zhang , Bing Bai , Jian Liang , Kun Bai , Shiyu Chang , Mo Yu , Conghui Zhu , Tiejun Zhao

Due to the concise and structured nature of tables, the knowledge contained therein may be incomplete or missing, posing a significant challenge for table question answering (TableQA) and data analysis systems. Most existing datasets either…

计算与语言 · 计算机科学 2024-05-15 Mengkang Hu , Haoyu Dong , Ping Luo , Shi Han , Dongmei Zhang

The task of Question Answering has gained prominence in the past few decades for testing the ability of machines to understand natural language. Large datasets for Machine Reading have led to the development of neural models that cater to…

计算与语言 · 计算机科学 2018-06-20 Soumya Wadhwa , Khyathi Raghavi Chandu , Eric Nyberg

Every day, thousands of customers post questions on Amazon product pages. After some time, if they are fortunate, a knowledgeable customer might answer their question. Observing that many questions can be answered based upon the available…

计算与语言 · 计算机科学 2019-08-22 Mansi Gupta , Nitish Kulkarni , Raghuveer Chanda , Anirudha Rayasam , Zachary C Lipton

Financial documents like earning reports or balance sheets often involve long tables and multi-page reports. Large language models have become a new tool to help numerical reasoning and understanding these documents. However, prompt quality…

人工智能 · 计算机科学 2025-11-17 Yaoning Yu , Kai-Min Chang , Ye Yu , Kai Wei , Haojing Luo , Haohan Wang

Multihop reasoning remains an elusive goal as existing multihop benchmarks are known to be largely solvable via shortcuts. Can we create a question answering (QA) dataset that, by construction, \emph{requires} proper multihop reasoning? To…

计算与语言 · 计算机科学 2022-05-06 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

Evaluating synthetic tabular data is challenging, since they can differ from the real data in so many ways. There exist numerous metrics of synthetic data quality, ranging from statistical distances to predictive performance, often…

机器学习 · 计算机科学 2025-04-30 Jan Kapar , Niklas Koenen , Martin Jullum

Long-form question answering (LFQA) tasks require retrieving the documents pertinent to a query, using them to form a paragraph-length answer. Despite considerable progress in LFQA modeling, fundamental issues impede its progress: i)…

计算与语言 · 计算机科学 2021-12-28 Suchismit Mahapatra , Vladimir Blagojevic , Pablo Bertorello , Prasanna Kumar

Knowledge Base Question Answering (KBQA) challenges models to bridge the gap between natural language and strict knowledge graph schemas by generating executable logical forms. While Large Language Models (LLMs) have advanced this field,…

计算与语言 · 计算机科学 2026-01-12 Xin Sun , Zhongqi Chen , Xing Zheng , Qiang Liu , Shu Wu , Bowen Song , Zilei Wang , Weiqiang Wang , Liang Wang