English
Related papers

Related papers: Plato's Cave: A Human-Centered Research Verificati…

200 papers

In the modern era, abundant information is easily accessible from various sources, however only a few of these sources are reliable as they mostly contain unverified contents. We develop a system to validate the truthfulness of a given…

Artificial Intelligence · Computer Science 2018-02-19 Papis Wongchaisuwat , Diego Klabjan

Background: Diagnostic test accuracy (DTA) studies, like etiological studies, are susceptible to various biases including reference standard error bias, partial verification bias, spectrum effect, confounding, and bias from misassumption of…

Methodology · Statistics 2026-01-21 Yang Lu , Nandini Dendukuri

Data analysis is a crucial analytical process to generate in-depth studies and conclusive insights to comprehensively answer a given user query for tabular data. In this work, we aim to propose new resources and benchmarks to inspire future…

Computation and Language · Computer Science 2024-10-30 Xueqing Wu , Rui Zheng , Jingzhen Sha , Te-Lin Wu , Hanyu Zhou , Mohan Tang , Kai-Wei Chang , Nanyun Peng , Haoran Huang

Text articles with false claims, especially news, have recently become aggravating for the Internet users. These articles are in wide circulation and readers face difficulty discerning fact from fiction. Previous work on credibility…

Computation and Language · Computer Science 2024-03-08 Nurendra Choudhary , Rajat Singh , Ishita Bindlish , Manish Shrivastava

We give a novel nonparametric pointwise consistent statistical test (the Markov Checker) of the Markov condition for directed acyclic graph (DAG) or completed partially directed acyclic graph (CPDAG) models given a dataset. We also…

Machine Learning · Computer Science 2024-10-01 Joseph D. Ramsey , Bryan Andrews , Peter Spirtes

We present PeerQA, a real-world, scientific, document-level Question Answering (QA) dataset. PeerQA questions have been sourced from peer reviews, which contain questions that reviewers raised while thoroughly examining the scientific…

Computation and Language · Computer Science 2025-02-20 Tim Baumgärtner , Ted Briscoe , Iryna Gurevych

We present FAKTA which is a unified framework that integrates various components of a fact checking process: document retrieval from media sources with various types of reliability, stance detection of documents with respect to given…

Computation and Language · Computer Science 2019-06-12 Moin Nadeem , Wei Fang , Brian Xu , Mitra Mohtarami , James Glass

We describe a new paradigm for implementing inference in belief networks, which relies on compiling a belief network into an arithmetic expression called a Query DAG (Q-DAG). Each non-leaf node of a Q-DAG represents a numeric operation, a…

Artificial Intelligence · Computer Science 2014-08-08 Adnan Darwiche , Gregory M. Provan

While visual comparison of directed acyclic graphs (DAGs) is commonly encountered in various disciplines (e.g., finance, biology), knowledge about humans' perception of graph similarity is currently quite limited. By graph similarity…

Human-Computer Interaction · Computer Science 2017-09-07 Kathrin Ballweg , Margit Pohl , Günter Wallner , Tatiana von Landesberger

Answering questions on scholarly knowledge comprising text and other artifacts is a vital part of any research life cycle. Querying scholarly knowledge and retrieving suitable answers is currently hardly possible due to the following…

Information Retrieval · Computer Science 2020-06-03 Mohamad Yaser Jaradeh , Markus Stocker , Sören Auer

Causal inference methods for observational data are increasingly recognized as a valuable complement to randomized clinical trials (RCTs). They can, under strong assumptions, emulate RCTs or help refine their focus. Our approach to causal…

Methodology · Statistics 2024-08-14 Carlo Berzuini , Davide Luciani , Hiren C. Patel

Natural Language Processing and Generation systems have recently shown the potential to complement and streamline the costly and time-consuming job of professional fact-checkers. In this work, we lift several constraints of current…

Computation and Language · Computer Science 2025-10-30 Daniel Russo , Stefano Menini , Jacopo Staiano , Marco Guerini

A directed acyclic graph (DAG) is the most common graphical model for representing causal relationships among a set of variables. When restricted to using only observational data, the structure of the ground truth DAG is identifiable only…

Data Structures and Algorithms · Computer Science 2018-09-12 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Kun Zhang

We present \textbf{QED}, an open-source multi-agent system that turns human-provided research questions into complete mathematical proofs without further human guidance. Its pipeline is designed to overcome common failures of single-query…

Artificial Intelligence · Computer Science 2026-05-25 Chenyang An , Qihao Ye , Minghao Pan , Jiayaun Zhang

In real world applications, knowledge graphs (KG) are widely used in various domains (e.g. medical applications and dialogue agents). However, for fact verification, KGs have not been adequately utilized as a knowledge source. KGs can be a…

Computation and Language · Computer Science 2023-10-18 Jiho Kim , Sungjin Park , Yeonsu Kwon , Yohan Jo , James Thorne , Edward Choi

The rapid spread of misinformation in the digital era poses significant challenges to public discourse, necessitating robust and scalable fact-checking solutions. Traditional human-led fact-checking methods, while credible, struggle with…

Artificial Intelligence · Computer Science 2025-06-24 Tam Trinh , Manh Nguyen , Truong-Son Hy

Deep research systems are widely used for multi-step web research, analysis, and cross-source synthesis, yet their evaluation remains challenging. Existing benchmarks often require annotation-intensive task construction, rely on static…

Computation and Language · Computer Science 2026-01-15 Yibo Wang , Lei Wang , Yue Deng , Keming Wu , Yao Xiao , Huanjin Yao , Liwei Kang , Hai Ye , Yongcheng Jing , Lidong Bing

An acyclic causal structure can be described with directed acyclic graph (DAG), where arrows indicate the possibility of direct causation. The task of learning this structure from data is known as "causal discovery." Diverse populations or…

Machine Learning · Computer Science 2024-10-17 Bijan Mazaheri , Spencer Gordon , Yuval Rabani , Leonard Schulman

We introduce a structure for the directed acyclic graph (DAG) and a mechanism design based on that structure so that peers can reach consensus at large scale based on proof of work (PoW). We also design a mempool transaction assignment…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-10 Jiahao He , Guangju Wang , Guangyuan Zhang , Jiheng Zhang

In the era of Big Knowledge Graphs, Question Answering (QA) systems have reached a milestone in their performance and feasibility. However, their applicability, particularly in specific domains such as the biomedical domain, has not gained…

Computation and Language · Computer Science 2020-10-19 Saeedeh Shekarpour , Abhishek Nadgeri , Kuldeep Singh