English
Related papers

Related papers: Automated Hypothesis Validation with Agentic Seque…

200 papers

Systematic literature reviews are essential for synthesizing scientific evidence but are costly, difficult to scale and time-intensive, creating bottlenecks for evidence-based policy. We study whether large language models can automate the…

We revisit Popper's falsifiability criterion. A tester hires a potential expert to produce a theory, offering payments contingent on the observed performance of the theory. In our model, instead of knowing the true data-generating process,…

Theoretical Economics · Economics 2026-01-06 Mark Whitmeyer , Kun Zhang

Large Language Models (LLMs) have emerged as powerful tools for accelerating scientific discovery, yet their static knowledge and hallucination issues hinder autonomous research applications. Recent advances integrate LLMs into agentic…

Artificial Intelligence · Computer Science 2025-12-23 Zeyu Xia , Jinzhe Ma , Congjie Zheng , Shufei Zhang , Yuqiang Li , Hang Su , P. Hu , Changshui Zhang , Xingao Gong , Wanli Ouyang , Lei Bai , Dongzhan Zhou , Mao Su

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, leading to their adoption in high-stakes domains such as healthcare, law, and scientific research. However, their reasoning often contains subtle logical…

Software Engineering · Computer Science 2025-12-30 Xinyi Zheng , Ningke Li , Xiaokun Luan , Kailong Wang , Ling Shi , Meng Sun , Haoyu Wang

Scientists form hypotheses and experimentally test them. If a hypothesis fails (is refuted), scientists try to explain the failure to eliminate other hypotheses. The more precise the failure analysis the more hypotheses can be eliminated.…

Artificial Intelligence · Computer Science 2023-05-25 Rolf Morel , Andrew Cropper

General-purpose Large Language Models (LLMs) have achieved remarkable success in intelligence, performing comparably to human experts on complex reasoning tasks such as coding and mathematical reasoning. However, generating formal proofs in…

The rapid proliferation of online misinformation threatens the stability of digital social systems and poses significant risks to public trust, policy, and safety, necessitating reliable automated fake news detection. Existing methods often…

Information Retrieval · Computer Science 2026-03-06 Roopa Bukke , Soumya Pandey , Suraj Kumar , Soumi Chattopadhyay , Chandranath Adak

Retrieval plays a central role in multi-hop question answering (QA), where answering complex questions requires gathering multiple pieces of evidence. We introduce an Agentic Retrieval System that leverages large language models (LLMs) in a…

Computation and Language · Computer Science 2025-10-17 Md Mahadi Hasan Nahid , Davood Rafiei

The demand for synthetic data in mathematical reasoning has increased due to its potential to enhance the mathematical capabilities of large language models (LLMs). However, ensuring the validity of intermediate reasoning steps remains a…

Artificial Intelligence · Computer Science 2026-01-19 Joshua Ong Jun Leang , Giwon Hong , Wenda Li , Shay B. Cohen

Large language models (LLMs) have been used to generate formal proofs of mathematical theorems in proofs assistants such as Lean. However, we often want to optimize a formal proof with respect to various criteria, depending on its…

Artificial Intelligence · Computer Science 2026-05-22 Riyaz Ahuja , Jeremy Avigad , Prasad Tetali , Sean Welleck

We describe an inductive logic programming (ILP) approach called learning from failures. In this approach, an ILP system (the learner) decomposes the learning problem into three separate stages: generate, test, and constrain. In the…

Artificial Intelligence · Computer Science 2020-11-26 Andrew Cropper , Rolf Morel

The exponential growth of scientific knowledge has made the automated generation of scientific hypotheses that combine novelty, feasibility, and research value a core challenge. Existing methods based on large language models fail to…

Artificial Intelligence · Computer Science 2025-08-05 Shiyang Duan , Yuan Tian , Qi Bing , Xiaowei Shao

As hypothesis generation becomes increasingly automated, a new bottleneck has emerged: hypothesis assessment. Modern systems can surface thousands of statistical relationships-correlations, trends, causal links-but offer little guidance on…

Machine Learning · Computer Science 2025-06-05 Yue Gong , Raul Castro Fernandez

Large language models (LLMs) are increasingly deployed in high-stakes settings where good decisions require forming beliefs over the probability of unknown outcomes. However, it is unclear whether LLMs act as if they hold coherent beliefs…

Artificial Intelligence · Computer Science 2026-05-12 Khurram Yamin , Jingjing Tang , Santiago Cortes-Gomez , Amit Sharma , Eric Horvitz , Bryan Wilder

Large language models (LLMs) have shown significant potential in scientific disciplines such as biomedicine, particularly in hypothesis generation, where they can analyze vast literature, identify patterns, and suggest research directions.…

Computation and Language · Computer Science 2025-06-10 Guangzhi Xiong , Eric Xie , Corey Williams , Myles Kim , Amir Hassan Shariatmadari , Sikun Guo , Stefan Bekiranov , Aidong Zhang

Proof engineering is notoriously labor-intensive: proofs that are straightforward on paper often require lengthy scripts in theorem provers. Recent advances in large language models (LLMs) create new opportunities for proof automation:…

Programming Languages · Computer Science 2026-01-08 Yichen Xu , Martin Odersky

Large language models (LLMs) increasingly help people solve problems, from debugging code to repairing machinery. This process requires generating plausible hypotheses from partial descriptions, then updating them as more information…

Machine Learning · Computer Science 2026-05-08 Hua-Dong Xiong

Hallucination remains a critical bottleneck for large language models (LLMs), undermining their reliability in real-world applications, especially in Retrieval-Augmented Generation (RAG) systems. While existing hallucination detection…

Computation and Language · Computer Science 2026-03-26 Zhuo Li , Yupeng Zhang , Pengyu Cheng , Jiajun Song , Mengyu Zhou , Hao Li , Shujie Hu , Yu Qin , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanations. In medical training, this reasoning is explicitly developed through counterfactual…

Computation and Language · Computer Science 2026-04-24 Zhiwen You , Xi Chen , Aniket Vashishtha , Simo Du , Gabriel Erion-Barner , Hongyuan Mei , Hao Peng , Yue Guo

With the proliferation of Large Language Models (LLMs), the detection of misinformation has become increasingly important and complex. This research proposes an innovative verifiable misinformation detection LLM agent that goes beyond…

Artificial Intelligence · Computer Science 2025-08-06 Zikun Cui , Tianyi Huang , Chia-En Chiang , Cuiqianhe Du