English
Related papers

Related papers: Large-Scale Validation of Hypothesis Generation Sy…

200 papers

Large language models (LLMs) have enabled agentic AI systems for scientific discovery, but most approaches remain limited to textbased reasoning without automated experimental verification. We propose MIND, an LLM-driven framework for…

Multiagent Systems · Computer Science 2026-04-16 Geonhee Ahn , Donghyun Lee , Hayoung Doo , Jonggeol Na , Hyunsoo Cho , Sookyung Kim

Hypotheses are central to information acquisition, decision-making, and discovery. However, many real-world hypotheses are abstract, high-level statements that are difficult to validate directly. This challenge is further intensified by the…

Machine Learning · Computer Science 2025-02-17 Kexin Huang , Ying Jin , Ryan Li , Michael Y. Li , Emmanuel Candès , Jure Leskovec

Hypothesis ranking is vital for automated scientific discovery, especially in cost-intensive, throughput-limited natural science domains. Current methods focus on pre-experiment ranking, relying solely on language model reasoning without…

Computation and Language · Computer Science 2025-10-28 Wanhao Liu , Zonglin Yang , Jue Wang , Lidong Bing , Di Zhang , Dongzhan Zhou , Yuqiang Li , Houqiang Li , Erik Cambria , Wanli Ouyang

The ability to research and synthesize knowledge is central to human expertise and progress. A new class of AI systems--designed for generative research synthesis--aims to automate this process by retrieving information from the live web…

Computation and Language · Computer Science 2026-02-10 Liana Patel , Negar Arabzadeh , Harshit Gupta , Ankita Sundar , Ion Stoica , Matei Zaharia , Carlos Guestrin

This paper introduces a comprehensive framework for the evaluation and validation of generative language models (GLMs), with a focus on Retrieval-Augmented Generation (RAG) systems deployed in high-stakes domains such as banking. GLM…

Computation and Language · Computer Science 2024-12-10 Agus Sudjianto , Aijun Zhang , Srinivas Neppalli , Tarun Joshi , Michal Malohlava

Hypothesis generation in biomedical research has traditionally centered on uncovering hidden relationships within vast scientific literature, often using methods like Literature-Based Discovery (LBD). Despite progress, current approaches…

Computation and Language · Computer Science 2025-11-13 Fuyi Yang , Chenchen Ye , Mingyu Derek Ma , Yijia Xiao , Matthew Yang , Wei Wang

Automatic evaluation of various text quality criteria produced by data-driven intelligent methods is very common and useful because it is cheap, fast, and usually yields repeatable results. In this paper, we present an attempt to automate…

Computation and Language · Computer Science 2020-06-08 Erion Çano , Ondřej Bojar

High-fidelity agent initialization is crucial for credible Agent-Based Modeling across diverse domains. A robust framework should be Topic-Adaptive, capturing macro-level joint distributions while ensuring micro-level individual…

Artificial Intelligence · Computer Science 2026-04-07 Rongxin Chen , Tianyu Wu , Bingbing Xu , Jiatang Luo , Xiucheng Xu , Huawei Shen

We introduce an explainability method for biomedical hypothesis generation systems, built on top of the novel Hypothesis Generation Context Retriever framework. Our approach combines semantic graph-based retrieval and relevant…

Information Retrieval · Computer Science 2025-11-11 Ilya Tyagin , Saeideh Valipour , Aliaksandra Sikirzhytskaya , Michael Shtutman , Ilya Safro

Large language models (LLMs) have enabled agent-based systems that aim to automate scientific research workflows. Most existing approaches focus on fully autonomous discovery, where AI systems generate research ideas, conduct analyses, and…

Artificial Intelligence · Computer Science 2026-03-10 Chen Zhu , Xiaolu Wang

Research automation efforts usually employ AI as a tool to automate specific tasks within the research process. To create an AI that truly conduct research themselves, it must independently generate hypotheses, design verification plans,…

Artificial Intelligence · Computer Science 2023-11-17 Shiro Takagi , Ryutaro Yamauchi , Wataru Kumagai

Retrieval-augmented generation (RAG) improves large language model reliability by grounding generated responses in external evidence. However, RAG performance depends on the relevance of retrieved passages, the quality of evidence ranking,…

Information Retrieval · Computer Science 2026-05-05 Fariba Afrin Irany , Sampson Akwafuo

Two-sample hypothesis testing for network comparison presents many significant challenges, including: leveraging repeated network observations and known node registration, but without requiring them to operate; relaxing strong structural…

Methodology · Statistics 2024-02-05 Meijia Shao , Dong Xia , Yuan Zhang , Qiong Wu , Shuo Chen

Large Language Models (LLMs) demonstrate strong capabilities for solving scientific and mathematical problems, yet they struggle to produce valid, challenging, and novel problems - an essential component for advancing LLM training and…

Machine Learning · Computer Science 2026-05-08 Yuhang Lai , Jiazhan Feng , Yee Whye Teh , Ning Miao

Materials discovery and design are essential for advancing technology across various industries by enabling the development of application-specific materials. Recent research has leveraged Large Language Models (LLMs) to accelerate this…

Computation and Language · Computer Science 2025-02-11 Shrinidhi Kumbhar , Venkatesh Mishra , Kevin Coutinho , Divij Handa , Ashif Iquebal , Chitta Baral

One of the notable fields in studying the genetics of cancer is disease gene identification which affects disease treatment and drug discovery. Many researches have been done in this field. Genome-wide association studies (GWAS) are one of…

Computational Engineering, Finance, and Science · Computer Science 2016-04-27 Zahra Razaghi-Moghadama , Razieh Abdollahia , Sama Goliaeib , Morteza Ebrahimia

Retrieval-Augmented Generation (RAG) grounds large language models in external evidence, yet it still falters when answers must be pieced together across semantically distant documents. We close this gap with the Hierarchical Lexical Graph…

The rapid growth of biomedical knowledge has outpaced our ability to efficiently extract insights and generate novel hypotheses. Large language models (LLMs) have emerged as a promising tool to revolutionize knowledge interaction and…

Computation and Language · Computer Science 2024-07-16 Biqing Qi , Kaiyan Zhang , Kai Tian , Haoxiang Li , Zhang-Ren Chen , Sihang Zeng , Ermo Hua , Hu Jinfang , Bowen Zhou

In this modern technological era, categorization and ranking of research journals is gaining popularity among researchers and scientists. It plays a significant role for publication of their research findings in a quality journal. Although,…

Digital Libraries · Computer Science 2022-10-07 Rabia Shabbir Ranjha , Arshad Ali , Shahid Yousaf

Human evaluation for natural language generation (NLG) often suffers from inconsistent user ratings. While previous research tends to attribute this problem to individual user preferences, we show that the quality of human judgements can…

Computation and Language · Computer Science 2018-10-03 Jekaterina Novikova , Ondřej Dušek , Verena Rieser