English
Related papers

Related papers: QuestGen: Effectiveness of Question Generation Met…

200 papers

Automated fact-checking is a crucial task in the governance of internet content. Although various studies utilize advanced models to tackle this issue, a significant gap persists in addressing complex real-world rumors and deceptive claims.…

Computation and Language · Computer Science 2024-01-30 Wei-Yu Kao , An-Zi Yen

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation. In this paper, we present an automated fact-checking platform which given a…

Computation and Language · Computer Science 2019-04-04 Sebastião Miranda , David Nogueira , Afonso Mendes , Andreas Vlachos , Andrew Secker , Rebecca Garrett , Jeff Mitchel , Zita Marinho

Socratic questioning is an educational method that allows students to discover answers to complex problems by asking them a series of thoughtful questions. Generation of didactically sound questions is challenging, requiring understanding…

Computation and Language · Computer Science 2022-11-24 Kumar Shridhar , Jakub Macina , Mennatallah El-Assady , Tanmay Sinha , Manu Kapur , Mrinmaya Sachan

Contemporary approaches to assisted scientific discovery use language models to automatically generate large numbers of potential hypothesis to test, while also automatically generating code-based experiments to test those hypotheses. While…

Artificial Intelligence · Computer Science 2025-09-23 Peter Jansen , Samiah Hassan , Ruoyao Wang

Fact-checking is the process of evaluating the veracity of claims (i.e., purported facts). In this opinion piece, we raise an issue that has received little attention in prior work -- that some claims are far more difficult to fact-check…

Computation and Language · Computer Science 2022-02-08 Prakhar Singh , Anubrata Das , Junyi Jessy Li , Matthew Lease

Current large language models (LLMs) can exhibit near-human levels of performance on many natural language tasks, including open-domain question answering. Unfortunately, they also convincingly hallucinate incorrect answers, so that…

Information Retrieval · Computer Science 2023-06-27 Siqing Huo , Negar Arabzadeh , Charles L. A. Clarke

In high-stakes domains like legal question-answering, the accuracy and trustworthiness of generative AI systems are of paramount importance. This work presents a comprehensive benchmark of various methods to assess the groundedness of…

Computation and Language · Computer Science 2024-10-14 Dietrich Trautmann , Natalia Ostapuk , Quentin Grail , Adrian Alan Pol , Guglielmo Bonifazi , Shang Gao , Martin Gajek

Large language models (LLMs) have exhibited great potential in mathematical reasoning. However, there remains a performance gap in this area between existing open-source models and closed-source models such as GPT-4. In this paper, we…

Computation and Language · Computer Science 2024-09-12 Zimu Lu , Aojun Zhou , Houxing Ren , Ke Wang , Weikang Shi , Junting Pan , Mingjie Zhan , Hongsheng Li

Given the recent proliferation of false claims online, there has been a lot of manual fact-checking effort. As this is very time-consuming, human fact-checkers can benefit from tools that can support them and make them more efficient. Here,…

Computation and Language · Computer Science 2022-11-16 Shaden Shaar , Nikola Georgiev , Firoj Alam , Giovanni Da San Martino , Aisha Mohamed , Preslav Nakov

Automatic fake news detection models are ostensibly based on logic, where the truth of a claim made in a headline can be determined by supporting or refuting evidence found in a resulting web query. These models are believed to be reasoning…

Computation and Language · Computer Science 2022-04-18 Ian Kelk , Benjamin Basseri , Wee Yi Lee , Richard Qiu , Chris Tanner

In the expanding field of language model applications, medical knowledge representation remains a significant challenge due to the specialized nature of the domain. Large language models, such as GPT-4, obtain reasonable scores on medical…

Computation and Language · Computer Science 2024-05-24 Julien Khlaut , Corentin Dancette , Elodie Ferreres , Alaedine Bennani , Paul Hérent , Pierre Manceron

We introduce ClaimCheck, an LLM-guided automatic fact-checking system designed to verify real-world claims using live Web evidence and small language models. Unlike prior systems that rely on large, closed-source models and static knowledge…

Computation and Language · Computer Science 2025-10-03 Akshith Reddy Putta , Jacob Devasier , Chengkai Li

We introduce a novel data generation method for contradiction detection, which leverages the generative power of large language models as well as linguistic rules. Our vision is to provide a condensed corpus of prototypical contradictions,…

Computation and Language · Computer Science 2023-10-24 Maren Pielka , Svetlana Schmidt , Rafet Sifa

Real-life tasks such as giving legal or technical advice often lack complete context at the outset and can have disparate answers depending thereon. The ability to derive missing factual information by asking clarifying questions (ACQ) is…

Computation and Language · Computer Science 2024-10-15 Matthew Toles , Yukun Huang , Zhou Yu , Luis Gravano

Question Answering (QA) systems require a large amount of annotated data which is costly and time-consuming to gather. Converting datasets of existing QA benchmarks are challenging due to different formats and complexities. To address these…

Computation and Language · Computer Science 2022-10-14 Saptarashmi Bandyopadhyay , Shraman Pal , Hao Zou , Abhranil Chandra , Jordan Boyd-Graber

Despite recent success in natural language processing (NLP), fact verification still remains a difficult task. Due to misinformation spreading increasingly fast, attention has been directed towards automatically verifying the correctness of…

Computation and Language · Computer Science 2024-08-15 Tobias A. Opsahl

A reduction of a source distribution is a collection of smaller sized distributions that are collectively equivalent to the source distribution with respect to the property of decomposability. That is, an arbitrary language is decomposable…

Systems and Control · Computer Science 2018-03-30 Liyong Lin , Tomáš Masopust , W. Murray Wonham , Rong Su

Question generation (QG) is the task of generating a question from a reference sentence and a specified answer within the sentence. A major challenge in QG is to identify answer-relevant context words to finish the…

Computation and Language · Computer Science 2019-10-25 Jingjing Li , Yifan Gao , Lidong Bing , Irwin King , Michael R. Lyu

Prior research has shown that typical fact-checking models for stand-alone claims struggle with claims made in dialogues. As a solution, fine-tuning these models on labelled dialogue data has been proposed. However, creating separate models…

Computation and Language · Computer Science 2023-11-15 Eric Chamoun , Marzieh Saeidi , Andreas Vlachos