English
Related papers

Related papers: Can LLMs Write Mathematics Papers? A Case Study in…

200 papers

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Large language models (LLMs) demonstrate impressive capabilities in mathematical reasoning. However, despite these achievements, current evaluations are mostly limited to specific mathematical topics, and it remains unclear whether LLMs are…

Computation and Language · Computer Science 2025-04-01 Arash Gholami Davoodi , Seyed Pouyan Mousavi Davoudi , Pouya Pezeshkpour

Cutting-edge Artificial Intelligence (AI) techniques keep reshaping our view of the world. For example, Large Language Models (LLMs) based applications such as ChatGPT have shown the capability of generating human-like conversation on…

The recent popularity of large language models (LLMs) has brought a significant impact to boundless fields, particularly through their open-ended ecosystem such as the APIs, open-sourced models, and plugins. However, with their widespread…

Machine Learning · Computer Science 2023-08-31 Wentao Ye , Mingfeng Ou , Tianyi Li , Yipeng chen , Xuetao Ma , Yifan Yanggong , Sai Wu , Jie Fu , Gang Chen , Haobo Wang , Junbo Zhao

As researchers increasingly adopt LLMs as writing assistants, generating high-quality research paper introductions remains both challenging and essential. We introduce Scientific Introduction Generation (SciIG), a task that evaluates LLMs'…

Computation and Language · Computer Science 2025-08-26 Krishna Garg , Firoz Shaik , Sambaran Bandyopadhyay , Cornelia Caragea

Large language models (LLMs) have recently achieved remarkable success in generating rigorous mathematical proofs, with "AI for Math" emerging as a vibrant field of research (Ju et al., 2026). While these models have mastered…

Artificial Intelligence · Computer Science 2026-03-10 Lve Meng , Weilong Zhao , Yanzhi Zhang , Haoxiang Guan , Jiyan He

The widespread adoption of Large Language Models (LLMs) and publicly available ChatGPT have marked a significant turning point in the integration of Artificial Intelligence (AI) into people's everyday lives. This study examines the ability…

Computation and Language · Computer Science 2025-10-28 Sandeep Kumar , Tirthankar Ghosal , Vinayak Goyal , Asif Ekbal

The use of Large Language Models (LLMs) in mathematical reasoning has become a cornerstone of related research, demonstrating the intelligence of these models and enabling potential practical applications through their advanced performance,…

Computation and Language · Computer Science 2024-12-20 Kathrin Seßler , Yao Rong , Emek Gözlüklü , Enkelejda Kasneci

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

Computation and Language · Computer Science 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing

The widespread adoption of large language models (LLMs) makes it important to recognize their strengths and limitations. We argue that in order to develop a holistic understanding of these systems we need to consider the problem that they…

Computation and Language · Computer Science 2023-09-26 R. Thomas McCoy , Shunyu Yao , Dan Friedman , Matthew Hardy , Thomas L. Griffiths

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material…

Human-Computer Interaction · Computer Science 2024-01-26 Yongtao Liu , Marti Checa , Rama K. Vasudevan

Large language models (LLMs) have achieved remarkable performance in language understanding and generation tasks by leveraging vast amounts of online texts. Unlike conventional models, LLMs can adapt to new domains through prompt…

Artificial Intelligence · Computer Science 2024-06-18 Ming Cheung

Using Large Language Models (LLMs) for Process Mining (PM) tasks is becoming increasingly essential, and initial approaches yield promising results. However, little attention has been given to developing strategies for evaluating and…

Databases · Computer Science 2024-07-01 Alessandro Berti , Humam Kourani , Hannes Hafke , Chiao-Yun Li , Daniel Schuster

Large Language Models (LLMs) hold the potential to revolutionize autoformalization. The introduction of Lean4, a mathematical programming language, presents an unprecedented opportunity to rigorously assess the autoformalization…

Machine Learning · Computer Science 2024-06-12 Aryan Gulati , Devanshu Ladsaria , Shubhra Mishra , Jasdeep Sidhu , Brando Miranda

ChatGPT and other state-of-the-art large language models (LLMs) are rapidly transforming multiple fields, offering powerful tools for a wide range of applications. These models, commonly trained on vast datasets, exhibit human-like text…

Large Language Models (LLMs) have shown remarkable success on a wide range of math and reasoning benchmarks. However, we observe that they often struggle when faced with unreasonable math problems. Instead of recognizing these issues,…

Computation and Language · Computer Science 2025-06-03 Jingyuan Ma , Damai Dai , Zihang Yuan , Rui li , Weilin Luo , Bin Wang , Qun Liu , Lei Sha , Zhifang Sui

In recent years, Large Language Models (LLMs) have emerged as a transformative development in artificial intelligence (AI), drawing significant attention from industry and academia. Trained on vast datasets, these sophisticated AI systems…

Artificial Intelligence · Computer Science 2025-01-15 Oudom Hean , Utsha Saha , Binita Saha

Large language models (LLMs) have significantly advanced various natural language processing (NLP) tasks. Recent research indicates that moderately-sized LLMs often outperform larger ones after task-specific fine-tuning. This study focuses…

Computation and Language · Computer Science 2024-10-14 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , George Foster , Gholamreza Haffari

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Systems engineering (SE) is evolving with the availability of generative artificial intelligence (AI) and the demand for a systems-of-systems perspective, formalized under the purview of mission engineering (ME) in the US Department of…

Software Engineering · Computer Science 2025-02-07 Max Ofsa , Taylan G. Topcu