English
Related papers

Related papers: Crowdsourcing Question-Answer Meaning Representati…

200 papers

Large language models (LLMs) demonstrate remarkable performance across various tasks, prompting researchers to develop diverse evaluation benchmarks. However, most benchmarks typically measure the ability of LLMs to respond to individual…

Computation and Language · Computer Science 2026-01-30 Yutao Hou , Yajing Luo , Zhiwen Ruan , Hongru Wang , Weifeng Ge , Yun Chen , Guanhua Chen

Question answering (QA) over knowledge bases (KBs) is challenging because of the diverse, essentially unbounded, types of reasoning patterns needed. However, we hypothesize in a large KB, reasoning patterns required to answer a query type…

Computation and Language · Computer Science 2022-06-22 Rajarshi Das , Ameya Godbole , Ankita Naik , Elliot Tower , Robin Jia , Manzil Zaheer , Hannaneh Hajishirzi , Andrew McCallum

Community Question Answering forums such as Quora, Stackoverflow are rich knowledge resources, often catering to information on topics overlooked by major search engines. Answers submitted to these forums are often elaborated, contain spam,…

Computation and Language · Computer Science 2018-11-13 Tanya Chowdhury , Tanmoy Chakraborty

Evaluation of QA systems is very challenging and expensive, with the most reliable approach being human annotations of correctness of answers for questions. Recent works (AVA, BEM) have shown that transformer LM encoder based similarity…

Computation and Language · Computer Science 2023-09-22 Matteo Gabburo , Siddhant Garg , Rik Koncel Kedziorski , Alessandro Moschitti

Conversational question--answer generation is a task that automatically generates a large-scale conversational question answering dataset based on input passages. In this paper, we introduce a novel framework that extracts question-worthy…

Computation and Language · Computer Science 2022-09-26 Seonjeong Hwang , Gary Geunbae Lee

We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text…

Computation and Language · Computer Science 2016-10-12 Pranav Rajpurkar , Jian Zhang , Konstantin Lopyrev , Percy Liang

In cross-lingual Abstract Meaning Representation (AMR) parsing, researchers develop models that project sentences from various languages onto their AMRs to capture their essential semantic structures: given a sentence in any language, we…

Computation and Language · Computer Science 2021-06-09 Sarah Uhrig , Yoalli Rezepka Garcia , Juri Opitz , Anette Frank

Knowledge bases (KBs) store rich yet heterogeneous entities and facts. Entity resolution (ER) aims to identify entities in KBs which refer to the same real-world object. Recent studies have shown significant benefits of involving humans in…

Databases · Computer Science 2020-02-24 Jiacheng Huang , Wei Hu , Zhifeng Bao , Yuzhong Qu

Large language models (LLMs) show amazing proficiency and fluency in the use of language. Does this mean that they have also acquired insightful linguistic knowledge about the language, to an extent that they can serve as an "expert…

Computation and Language · Computer Science 2023-12-12 Allyson Ettinger , Jena D. Hwang , Valentina Pyatkin , Chandra Bhagavatula , Yejin Choi

Thanks to information extraction and semantic Web efforts, search on unstructured text is increasingly refined using semantic annotations and structured knowledge bases. However, most users cannot become familiar with the schema of…

Information Retrieval · Computer Science 2012-12-27 Uma Sawant , Soumen Chakrabarti

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

In this paper, we introduce QABISAR, a novel framework for statutory article retrieval, to overcome the semantic mismatch problem when modeling each query-article pair in isolation, making it hard to learn representation that can…

Information Retrieval · Computer Science 2024-12-03 T. Y. S. S. Santosh , Hassan Sarwat , Matthias Grabmair

Argumentation is a type of discourse where speakers try to persuade their audience about the reasonableness of a claim by presenting supportive arguments. Most work in argument mining has focused on modeling arguments in monologues. We…

Computation and Language · Computer Science 2020-05-01 Tuhin Chakrabarty , Christopher Hidey , Smaranda Muresan , Kathy Mckeown , Alyssa Hwang

Long-form question answering (LFQA) demands nuanced evaluation of multi-sentence explanatory responses, yet existing metrics often fail to reflect human judgment. We present LFQA-HP-1M, a large-scale dataset comprising 1.3M human pairwise…

Computation and Language · Computer Science 2026-03-02 Rafid Ishrak Jahan , Fahmid Shahriar Iqbal , Sagnik Ray Choudhury

The dependency between an adequate question formulation and correct answer selection is a very intriguing but still underexplored area. In this paper, we show that question rewriting (QR) of the conversational context allows to shed more…

Computation and Language · Computer Science 2022-02-04 Svitlana Vakulenko , Shayne Longpre , Zhucheng Tu , Raviteja Anantha

Pretrained language models, especially masked language models (MLMs) have seen success across many NLP tasks. However, there is ample evidence that they use the cultural biases that are undoubtedly present in the corpora they are trained…

Computation and Language · Computer Science 2020-10-02 Nikita Nangia , Clara Vania , Rasika Bhalerao , Samuel R. Bowman

We present IBR, an Iterative Backward Reasoning model to solve the proof generation tasks on rule-based Question Answering (QA), where models are required to reason over a series of textual rules and facts to find out the related proof path…

Computation and Language · Computer Science 2022-05-25 Hanhao Qu , Yu Cao , Jun Gao , Liang Ding , Ruifeng Xu

Query-focused summarization (QFS) is the task of generating a summary in response to a user-written query. Despite its user-oriented nature, there has been limited work in QFS in explicitly considering a user's understanding of a generated…

Artificial Intelligence · Computer Science 2024-11-12 Cesare Spinoso-Di Piano , Jackie Chi Kit Cheung

To fully capture the meaning of a sentence, semantic representations should encode aspect, which describes the internal temporal structure of events. In graph-based meaning representation frameworks such as Uniform Meaning Representations…

Neural models for automated fact verification have achieved promising results thanks to the availability of large, human-annotated datasets. However, for each new domain that requires fact verification, creating a dataset by manually…

Computation and Language · Computer Science 2021-06-01 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang