English
Related papers

Related papers: Can Large Language Models Correctly Interpret Equa…

200 papers

Recent advances in the performance of large language models (LLMs) have sparked debate over whether, given sufficient training, high-level human abilities emerge in such generic forms of artificial intelligence (AI). Despite the exceptional…

Computation and Language · Computer Science 2024-01-18 Nicholas Ichien , Dušan Stamenković , Keith J. Holyoak

Large language models (LLMs) have achieved top results in recent machine translation evaluations, but they are also known to be sensitive to errors and perturbations in their prompts. We systematically evaluate how both humanly plausible…

Computation and Language · Computer Science 2025-09-03 Patrícia Schmidtová , Niyati Bafna , Seth Aycock , Gianluca Vico , Wiktor Kamzela , Katharina Hämmerl , Vilém Zouhar

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

Computation and Language · Computer Science 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

Equation discovery is aimed at directly extracting physical laws from data and has emerged as a pivotal research domain. Previous methods based on symbolic mathematics have achieved substantial advancements, but often require the design of…

Machine Learning · Computer Science 2024-07-23 Mengge Du , Yuntian Chen , Zhongzheng Wang , Longfeng Nie , Dongxiao Zhang

Large Language Models (LLMs) have shown the potential to be valuable teaching tools, with the potential of giving every student a personalized tutor. However, one challenge with using LLMs to learn new concepts is that when learning a topic…

Human-Computer Interaction · Computer Science 2024-11-19 Steve Oney , Yue Shen , Fei Wu , Young Suh Hong , Ziang Wang , Yamini Khajekar , Jiacheng Zhang , April Yi Wang

The use of Large Language Models (LLMs) has drawn growing interest within the scientific community. LLMs can handle large volumes of textual data and support methods for evidence synthesis. Although recent studies highlight the potential of…

Software Engineering · Computer Science 2026-02-12 Cauã Ferreira Barros , Marcos Kalinowski , Mohamad Kassab , Valdemar Vicente Graciano Neto

Large Language Models (LLMs) excel at various tasks, including problem-solving and question-answering. However, LLMs often find Math Word Problems (MWPs) challenging because solving them requires a range of reasoning and mathematical…

Artificial Intelligence · Computer Science 2025-09-24 Mitchell Piehl , Dillon Wilson , Ananya Kalita , Jugal Kalita

Automated feedback as students answer open-ended math questions has significant potential in improving learning outcomes at large scale. A key part of automated feedback systems is an error classification component, which identifies student…

Computation and Language · Computer Science 2023-05-11 Hunter McNichols , Mengxue Zhang , Andrew Lan

Large language models (LLMs) have achieved remarkable success across various natural language processing (NLP) tasks. However, recent studies suggest that they still face challenges in performing fundamental NLP tasks essential for deep…

Computation and Language · Computer Science 2025-04-22 Ziyan Zhang , Yang Hou , Chen Gong , Zhenghua Li

Standardized math assessments require expensive human pilot studies to establish the difficulty of test items. We investigate the predictive value of open-source large language models (LLMs) for evaluating the difficulty of multiple-choice…

Computation and Language · Computer Science 2026-04-22 Christabel Acquaye , Yi Ting Huang , Marine Carpuat , Rachel Rudinger

Large Language Models (LLMs) have demonstrated significant capabilities in machine translation. However, their translation quality is sometimes questioned, as the generated outputs may deviate from expressions typically used by native…

Computation and Language · Computer Science 2024-12-10 Ke-Ching Chang , Chung-Chi Chen , An-Zi Yen

Large Language Models (LLMs) have demonstrated exceptional abilities across a broad range of language-related tasks, including generating solutions to complex reasoning problems. An effective technique to enhance LLM performance is…

Computation and Language · Computer Science 2024-12-25 Shuzhang Cai , Twumasi Mensah-Boateng , Xander Kuksov , Jing Yuan , Shaojie Tang

Many multilingual NLP applications need to translate words between different languages, but cannot afford the computational expense of inducing or applying a full translation model. For these applications, we have designed a fast algorithm…

cmp-lg · Computer Science 2008-02-03 I. Dan Melamed

Pre-trained large language models (LLM) have emerged as a powerful tool for simulating various scenarios and generating output given specific instructions and multimodal input. In this work, we analyze the specific use of LLM to enhance a…

Machine Learning · Computer Science 2024-05-10 Yuhang Wu , Yingfei Wang , Chu Wang , Zeyu Zheng

Large language models (LLMs) demonstrate considerable potential in various natural language tasks but face significant challenges in mathematical reasoning, particularly in executing precise, multi-step logic. However, current evaluation…

Computation and Language · Computer Science 2025-05-22 Tiasa Singha Roy , Aditeya Baral , Ayush Rajesh Jhaveri , Yusuf Baig

Recently, Large Language Models (LLMs) have drawn significant attention due to their outstanding reasoning capabilities and extensive knowledge repository, positioning them as superior in handling various natural language processing tasks…

Computation and Language · Computer Science 2023-11-30 Han Cao , Lingwei Wei , Mengyang Chen , Wei Zhou , Songlin Hu

Large language models (LLMs) are increasingly deployed on complex reasoning tasks, yet little is known about their ability to internally evaluate problem difficulty, which is an essential capability for adaptive reasoning and efficient…

Computation and Language · Computer Science 2025-10-14 Sunbowen Lee , Qingyu Yin , Chak Tou Leong , Jialiang Zhang , Yicheng Gong , Shiwen Ni , Min Yang , Xiaoyu Shen

Humans are accustomed to reading and writing in a forward manner, and this natural bias extends to text understanding in auto-regressive large language models (LLMs). This paper investigates whether LLMs, like humans, struggle with reverse…

Computation and Language · Computer Science 2025-02-25 Sicheng Yu , Yuanchen Xu , Cunxiao Du , Yanying Zhou , Minghui Qiu , Qianru Sun , Hao Zhang , Jiawei Wu

Modern Artificial Intelligence applications show great potential for language-related tasks that rely on next-word prediction. The current generation of Large Language Models (LLMs) have been linked to claims about human-like linguistic…

Computation and Language · Computer Science 2024-09-05 Evelina Leivada , Gary Marcus , Fritz Günther , Elliot Murphy

Recent advances in natural language processing (NLP), particularly large language models (LLMs), have motivated the automatic translation of natural language statements into formal logic without human intervention. This enables automated…

Computation and Language · Computer Science 2025-12-03 Muyu Pan , Dheeraj Kodakandla , Mahfuza Farooque