English
Related papers

Related papers: Testing LLM performance on the Physics GRE: some o…

200 papers

Large language models (LLMs) have the potential to revolutionize various fields, including code development, robotics, finance, and education, due to their extensive prior knowledge and rapid advancements. This paper investigates how LLMs…

Computers and Society · Computer Science 2025-06-10 Liangliang Chen , Zhihao Qin , Yiming Guo , Jacqueline Rohde , Ying Zhang

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

Providing students with individualized feedback through assignments is a cornerstone of education that supports their learning and development. Studies have shown that timely, high-quality feedback plays a critical role in improving…

Machine Learning · Computer Science 2025-01-27 Pavlin G. Poličar , Martin Špendl , Tomaž Curk , Blaž Zupan

Simulated Students offer a valuable methodological framework for evaluating pedagogical approaches and modelling diverse learner profiles, tasks which are otherwise challenging to undertake systematically in real-world settings. Recent…

Computers and Society · Computer Science 2025-11-11 Luis Marquez-Carpintero , Alberto Lopez-Sellers , Miguel Cazorla

The proliferation of Large Language Models (LLMs) in high-stakes applications such as medical (self-)diagnosis and preliminary triage raises significant ethical and practical concerns about the effectiveness, appropriateness, and possible…

Computers and Society · Computer Science 2025-06-18 Bonam Mingole , Aditya Majumdar , Firdaus Ahmed Choudhury , Jennifer L. Kraschnewski , Shyam S. Sundar , Amulya Yadav

In recent years, large language models (LLMs) have achieved remarkable success in natural language processing (NLP). LLMs require an extreme amount of parameters to attain high performance. As models grow into the trillion-parameter range,…

Computation and Language · Computer Science 2024-09-10 Zhyar Rzgar K Rostam , Sándor Szénási , Gábor Kertész

This paper presents a performance comparison of three large language models (LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard, on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT…

Computation and Language · Computer Science 2023-07-21 Xuan-Quy Dao

Software testing is an important part of the development cycle, yet it requires specialized expertise and substantial developer effort to adequately test software. Recent discoveries of the capabilities of large language models (LLMs)…

Software Engineering · Computer Science 2023-09-06 Robert Feldt , Sungmin Kang , Juyeon Yoon , Shin Yoo

Large language models (LLMs) are rapidly transforming knowledge work by improving the quality and efficiency of tasks such as writing, coding, and data analysis. However, their growing use in education has exposed a learning-performance…

In response to the increasing mental health challenges faced by college students, we sought to understand their perspectives on how AI applications, particularly Large Language Models (LLMs), can be leveraged to enhance their mental…

Human-Computer Interaction · Computer Science 2024-09-27 Owen Xingjian Zhang , Shuyao Zhou , Jiayi Geng , Yuhan Liu , Sunny Xun Liu

Large Language Models (LLMs) have exhibited impressive capabilities in various tasks, yet their vast parameter sizes restrict their applicability in resource-constrained settings. Knowledge distillation (KD) offers a viable solution by…

Computation and Language · Computer Science 2024-06-07 Rongzhi Zhang , Jiaming Shen , Tianqi Liu , Haorui Wang , Zhen Qin , Feng Han , Jialu Liu , Simon Baumgartner , Michael Bendersky , Chao Zhang

Large Language Models (LLMs) have emerged as powerful tools for natural language processing tasks, revolutionizing the field with their ability to understand and generate human-like text. In this paper, we present a comprehensive survey of…

Hardware Architecture · Computer Science 2024-09-06 Nikoletta Koilia , Christoforos Kachris

Interest in the role of large language models (LLMs) in education is increasing, considering the new opportunities they offer for teaching, learning, and assessment. In this paper, we examine the impact of LLMs on educational NLP in the…

Computation and Language · Computer Science 2026-01-19 Sowmya Vajjala , Bashar Alhafni , Stefano Bannò , Kaushal Kumar Maurya , Ekaterina Kochmar

Accurate and verifiable large language model (LLM) simulations of human research subjects promise an accessible data source for understanding human behavior and training new AI systems. However, results to date have been limited, and few…

Human-Computer Interaction · Computer Science 2025-06-06 Jacy Reese Anthis , Ryan Liu , Sean M. Richardson , Austin C. Kozlowski , Bernard Koch , James Evans , Erik Brynjolfsson , Michael Bernstein

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

Computation and Language · Computer Science 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

The impressive essay writing and problem-solving capabilities of large language models (LLMs) like OpenAI's ChatGPT have opened up new avenues in education. Our goal is to gain insights into the widespread use of LLMs among secondary…

Human-Computer Interaction · Computer Science 2024-12-02 Tiffany Zhu , Kexun Zhang , William Yang Wang

Building on the success of large language models (LLMs), recent advancements such as GPT-4o have enabled real-time speech interactions through LLM-based voice assistants, offering a significantly improved user experience compared to…

Computation and Language · Computer Science 2024-12-12 Yiming Chen , Xianghu Yue , Chen Zhang , Xiaoxue Gao , Robby T. Tan , Haizhou Li

Optimizing scientific software is a difficult task because codebases are often large and complex, and performance can depend upon several factors including the algorithm, its implementation, and hardware among others. Causes of poor…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-30 Daniel Nichols , Pranav Polasam , Harshitha Menon , Aniruddha Marathe , Todd Gamblin , Abhinav Bhatele

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

Software Engineering · Computer Science 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

Our work demonstrates that large language model (LLM) pre-trained on texts can not only solve pure math word problems, but also physics word problems, whose solution requires calculation and inference based on prior physical knowledge. We…

Computation and Language · Computer Science 2023-09-21 Jingzhe Ding , Yan Cen , Xinyuan Wei