English
Related papers

Related papers: InfiniteScienceGym: An Unbounded, Procedurally-Gen…

200 papers

We introduce a benchmark framework developed by and for the scientific community to evaluate, monitor and steer large language model development in fundamental physics. Building on philosophical concepts of scientific understanding and…

Data Analysis, Statistics and Probability · Physics 2025-07-30 Kristian G. Barman , Sascha Caron , Faegheh Hasibi , Eugene Shalugin , Yoris Marcet , Johannes Otte , Henk W. de Regt , Merijn Moody

Autonomous agents powered by large language models (LLMs) promise to accelerate scientific discovery end-to-end, but rigorously evaluating their capacity for verifiable discovery remains a central challenge. Existing benchmarks face a…

Artificial Intelligence · Computer Science 2026-02-04 Zhen Wang , Fan Bai , Zhongyan Luo , Jinyan Su , Kaiser Sun , Xinle Yu , Jieyuan Liu , Kun Zhou , Claire Cardie , Mark Dredze , Eric P. Xing , Zhiting Hu

Ensuring large language model (LLM) reliability requires distinguishing objective unsolvability (inherent contradictions) from subjective capability limitations (tasks exceeding model competence). Current LLMs often conflate these…

Computation and Language · Computer Science 2026-02-03 Dengyun Peng , Qiguang Chen , Bofei Liu , Jiannan Guan , Libo Qin , Zheng Yan , Jinhao Liu , Jianshu Zhang , Wanxiang Che

Scientific equation discovery is a fundamental task in the history of scientific progress, enabling the derivation of laws governing natural phenomena. Recently, Large Language Models (LLMs) have gained interest for this task due to their…

Computation and Language · Computer Science 2025-06-10 Parshin Shojaee , Ngoc-Hieu Nguyen , Kazem Meidani , Amir Barati Farimani , Khoa D Doan , Chandan K Reddy

We introduce Reasoning Gym (RG), a library of reasoning environments for reinforcement learning with verifiable rewards. It provides over 100 data generators and verifiers spanning multiple domains including algebra, arithmetic,…

Machine Learning · Computer Science 2025-10-21 Zafir Stojanovski , Oliver Stanley , Joe Sharratt , Richard Jones , Abdulhakeem Adefioye , Jean Kaddour , Andreas Köpf

Subjective Answer Grading (SAG) plays a crucial role in education, standardized testing, and automated assessment systems, particularly for evaluating short-form responses in Short Answer Scoring (SAS). However, existing approaches often…

Computation and Language · Computer Science 2025-05-16 Peichao Lai , Kexuan Zhang , Yi Lin , Linyihan Zhang , Feiyang Ye , Jinhao Yan , Yanwei Xu , Conghui He , Yilei Wang , Wentao Zhang , Bin Cui

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

Most of the existing Large Language Model (LLM) benchmarks on scientific problem reasoning focus on problems grounded in high-school subjects and are confined to elementary algebraic operations. To systematically examine the reasoning…

Computation and Language · Computer Science 2024-07-01 Xiaoxuan Wang , Ziniu Hu , Pan Lu , Yanqiao Zhu , Jieyu Zhang , Satyen Subramaniam , Arjun R. Loomba , Shichang Zhang , Yizhou Sun , Wei Wang

Large Language Models (LLMs) are transforming scientific hypothesis generation and validation by enabling information synthesis, latent relationship discovery, and reasoning augmentation. This survey provides a structured overview of…

Generative AI tools exemplified by ChatGPT are becoming a new reality. This study is motivated by the premise that ``AI generated content may exhibit a distinctive behavior that can be separated from scientific articles''. In this study, we…

Computation and Language · Computer Science 2024-04-16 Ahmed Abdeen Hamed , Xindong Wu

Large language models can generate scientific simulation code, but the generated code silently fails on most non-textbook problems. We show that classical mathematical validation -- well-posedness, convergence, and error certification --…

Software Engineering · Computer Science 2026-03-30 Chengshuai Yang

LLM-based formal proof assistants (e.g., in Lean) hold great promise for automating mathematical discovery. But beyond syntactic correctness, do these systems truly understand mathematical structure as humans do? We investigate this…

Artificial Intelligence · Computer Science 2025-10-21 Haoyu Zhao , Yihan Geng , Shange Tang , Yong Lin , Bohan Lyu , Hongzhou Lin , Chi Jin , Sanjeev Arora

Scientific breakthroughs often emerge from synthesizing prior ideas into novel contributions. While language models (LMs) show promise in scientific discovery, their ability to perform this targeted, literature-grounded synthesis remains…

Computation and Language · Computer Science 2026-04-14 Joy He-Yueya , Anikait Singh , Ge Gao , Michael Y. Li , Sherry Yang , Chelsea Finn , Emma Brunskill , Noah D. Goodman

Scientific discovery is a complex cognitive process that has driven human knowledge and technological progress for centuries. While artificial intelligence (AI) has made significant advances in automating aspects of scientific reasoning,…

Machine Learning · Computer Science 2024-12-24 Chandan K Reddy , Parshin Shojaee

Large Language Models (LLMs) are increasingly excelling and outpacing human performance on many tasks. However, to improve LLM reasoning, researchers either rely on ad-hoc generated datasets or formal mathematical proof systems such as the…

Artificial Intelligence · Computer Science 2025-11-03 Nikolaus Holzer , William Fishell , Baishakhi Ray , Mark Santolucito

Current evaluations of mathematical reasoning in large language models (LLMs) are dominated by static benchmarks, either derived from competition-style problems or curated through costly expert effort, resulting in limited coverage of…

Computation and Language · Computer Science 2026-05-08 Jicheng Ma , Guohua Wang , Xinhua Feng , Yiming Liu , Zhichao Hu , Yuhong Liu

Large language models make remarkable progress in reasoning capabilities. Existing works focus mainly on deductive reasoning tasks (e.g., code and math), while another type of reasoning mode that better aligns with human learning, inductive…

Computation and Language · Computer Science 2025-03-18 Kedi Chen , Zhikai Lei , Fan Zhang , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Qipeng Guo , Kai Chen , Wei Zhang

Large Language Models have recently gained significant attention in scientific discovery for their extensive knowledge and advanced reasoning capabilities. However, they encounter challenges in effectively simulating observational feedback…

Machine Learning · Computer Science 2024-05-17 Pingchuan Ma , Tsun-Hsuan Wang , Minghao Guo , Zhiqing Sun , Joshua B. Tenenbaum , Daniela Rus , Chuang Gan , Wojciech Matusik

Evaluating the reasoning ability of language models (LMs) is complicated by their extensive parametric world knowledge, where benchmark performance often reflects factual recall rather than genuine reasoning. Existing datasets and…

Computation and Language · Computer Science 2026-03-11 Ken Gu , Advait Bhat , Mike A Merrill , Robert West , Xin Liu , Daniel McDuff , Tim Althoff

Machine learning-based modeling of physical systems has experienced increased interest in recent years. Despite some impressive progress, there is still a lack of benchmarks for Scientific ML that are easy to use but still challenging and…