English
Related papers

Related papers: Can LLMs Write Mathematics Papers? A Case Study in…

200 papers

Large language models (LLMs) such as ChatGPT, Gemini, LlaMa, and Claude are trained on massive quantities of text parsed from the internet and have shown a remarkable ability to respond to complex prompts in a manner often indistinguishable…

Optics · Physics 2025-04-01 Darui Lu , Yang Deng , Jordan M. Malof , Willie J. Padilla

How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparable research assistant lies their practical application…

Computation and Language · Computer Science 2025-08-19 Tianyi Li , Yu Qin , Olivia R. Liu Sheng

Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain. This study explores LLMs'…

Computation and Language · Computer Science 2025-10-10 Pragya Srivastava , Manuj Malik , Vivek Gupta , Tanuja Ganu , Dan Roth

This study evaluates the performance of Large Language Models (LLMs) as an Artificial Intelligence-based tutor for a university course. In particular, different advanced techniques are utilized, such as prompt engineering,…

Empirical methods to examine the capability of Large Language Models (LLMs) to use Automated Theorem Prover (ATP) reasoning strategies are studied. We evaluate the performance of State of the Art models from December 2023 and August 2024 on…

Artificial Intelligence · Computer Science 2025-09-18 Lachlan McGinness , Peter Baumgartner

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan

To advance the mathematical proficiency of large language models (LLMs), the DeepMath team has launched an open-source initiative aimed at developing an open mathematical LLM and systematically evaluating its mathematical creativity. This…

Existing research predominantly focuses on developing powerful language learning models (LLMs) for mathematical reasoning within monolingual languages, with few explorations in preserving efficacy in a multilingual context. To bridge this…

Computation and Language · Computer Science 2024-10-17 Nuo Chen , Zinan Zheng , Ning Wu , Ming Gong , Dongmei Zhang , Jia Li

An essential element of human mathematical reasoning is our number sense -- an abstract understanding of numbers and their relationships -- which allows us to solve problems involving vast number spaces using limited computational…

Artificial Intelligence · Computer Science 2025-04-02 Roussel Rahman

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

Computation and Language · Computer Science 2023-10-09 Michael R. Douglas

Mathematical problem-solving is a key field in artificial intelligence (AI) and a critical benchmark for evaluating the capabilities of large language models (LLMs). While extensive research has focused on mathematical problem-solving, most…

Computation and Language · Computer Science 2025-01-03 Ziye Chen , Hao Qi

Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing…

Computation and Language · Computer Science 2024-06-18 Roy Xie , Chengxuan Huang , Junlin Wang , Bhuwan Dhingra

The integration of artificial intelligence into various domains is rapidly increasing, with Large Language Models (LLMs) becoming more prevalent in numerous applications. This work is included in an overall project which aims to train an…

Computational Physics · Physics 2025-01-09 Christophe Bajan , Guillaume Lambard

Large Language Models are increasingly applied in the petroleum industry, highlighting the need for a domain-specific evaluation framework. This study develops a benchmark for LLMs in petroleum engineering, including a three-stage process…

Artificial Intelligence · Computer Science 2026-05-28 Xiang Wang , Tingting Zhang , Sen Wang , Ying Wu , Heng Meng , Peng Zhou , Peng Li

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

Computation and Language · Computer Science 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

While large language models (LLMs) excel at many domain-specific tasks, their ability to deeply comprehend and reason about full-length academic papers remains underexplored. Existing benchmarks often fall short of capturing such depth,…

Artificial Intelligence · Computer Science 2026-01-08 Xinbang Dai , Huikang Hu , Yongrui Chen , Jiaqi Li , Rihui Jin , Yuyang Zhang , Xiaoguang Li , Lifeng Shang , Guilin Qi

The rapid evolution of artificial intelligence (AI), especially in the domain of Large Language Models (LLMs) and generative AI, has opened new avenues for application across various fields, yet its role in business education remains…

Computation and Language · Computer Science 2024-01-09 Vahid Ashrafimoghari , Necdet Gürkan , Jordan W. Suchow

Preprint repositories become central infrastructures for scholarly communication. Their expansion transforms how research is circulated and evaluated before journal publication. Generative large language models (LLMs) introduce a further…

Computers and Society · Computer Science 2025-10-22 Minfeng Qi , Zhongmin Cao , Qin Wang , Ningran Li , Tianqing Zhu

Large language models (LLMs) are increasingly used in academic peer review, yet their reliability, alignment with human judgment, and robustness to adversarial attacks remain poorly understood. We present a systematic benchmark of…

Computation and Language · Computer Science 2026-05-26 Lingyao Li , Junjie Xiong , Changjia Zhu , Runlong Yu , Chen Chen , Junyu Wang , Renkai Ma , Zhicong Lu

The cognitive mechanism by which Large Language Models (LLMs) solve mathematical problems remains a widely debated and unresolved issue. Currently, there is little interpretable experimental evidence that connects LLMs' problem-solving with…

Artificial Intelligence · Computer Science 2025-09-23 Wei Xie , Shuoyoucheng Ma , Zhenhua Wang , Enze Wang , Kai Chen , Xiaobing Sun , Baosheng Wang