English
Related papers

Related papers: Large Language Models (GPT) Struggle to Answer Mul…

200 papers

Test-time compute is emerging as a new paradigm for enhancing language models' complex multi-step reasoning capabilities, as demonstrated by the success of OpenAI's o1 and o3, as well as DeepSeek's R1. Compared to explicit reasoning in…

Computation and Language · Computer Science 2025-06-03 Tianhe Lin , Jian Xie , Siyu Yuan , Deqing Yang

Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase…

Computation and Language · Computer Science 2023-11-28 Haotian Luo , Yixin Liu , Peidong Liu , Xianggen Liu

Intelligent and adaptive online education systems aim to make high-quality education available for a diverse range of students. However, existing systems usually depend on a pool of hand-made questions, limiting how fine-grained and…

Computation and Language · Computer Science 2021-06-09 Megha Srivastava , Noah Goodman

Generative AI is changing the way that many disciplines are taught, including computer science. Researchers have shown that generative AI tools are capable of solving programming problems, writing extensive blocks of code, and explaining…

Human-Computer Interaction · Computer Science 2024-02-14 Bailey Kimmel , Austin Geisert , Lily Yaro , Brendan Gipson , Taylor Hotchkiss , Sidney Osae-Asante , Hunter Vaught , Grant Wininger , Chase Yamaguchi

The rapid evolution of artificial intelligence (AI), especially in the domain of Large Language Models (LLMs) and generative AI, has opened new avenues for application across various fields, yet its role in business education remains…

Computation and Language · Computer Science 2024-01-09 Vahid Ashrafimoghari , Necdet Gürkan , Jordan W. Suchow

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

Artificial Intelligence · Computer Science 2025-02-24 Johan Boye , Birger Moell

Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The…

This research paper contributes to the computing education research community's understanding of Generative AI (GenAI) in the context of introductory programming, and specifically, how students utilize related tools, such as ChatGPT. An…

Artificial Intelligence · Computer Science 2024-07-31 Andreas Scholl , Natalie Kiesler

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

CG (Computer Graphics) is a popular field of CS (Computer Science), but many students find this topic difficult due to it requiring a large number of skills, such as mathematics, programming, geometric reasoning, and creativity. Over the…

Artificial Intelligence · Computer Science 2024-10-23 Tony Haoran Feng , Paul Denny , Burkhard C. Wünsche , Andrew Luxton-Reilly , Jacqueline Whalley

Effective prioritization of issue reports is crucial in software engineering to optimize resource allocation and address critical problems promptly. However, the manual classification of issue reports for prioritization is laborious and…

Software Engineering · Computer Science 2024-01-10 Gabriel Aracena , Kyle Luster , Fabio Santos , Igor Steinmacher , Marco A. Gerosa

Large Language Models (LLMs) have demonstrated promising capabilities for code generation. While existing benchmarks evaluate the correctness and efficiency of LLM-generated code, the potential linguistic bias - where code quality varies…

Software Engineering · Computer Science 2025-05-02 Weipeng Jiang , Xuanqi Gao , Juan Zhai , Shiqing Ma , Xiaoyu Zhang , Ziyan Lei , Chao Shen

Artificial Intelligence (AI)-generated feedback in educational settings has garnered considerable attention due to its potential to enhance learning outcomes. However, a comprehensive understanding of the linguistic characteristics of…

Computation and Language · Computer Science 2025-05-01 Antoun Yaacoub , Zainab Assaghir , Lionel Prevost , Jérôme Da-Rugna

Recent studies have integrated large language models (LLMs) into diverse educational contexts, including providing adaptive programming hints, a type of feedback focuses on helping students move forward during problem-solving. However, most…

Human-Computer Interaction · Computer Science 2024-04-04 Ruiwei Xiao , Xinying Hou , John Stamper

Large language models (LLMs) are increasingly relied upon to solve complex mathematical word problems. However, being susceptible to hallucination, they may generate inaccurate results when presented with unanswerable questions, raising…

Computation and Language · Computer Science 2024-10-18 Asir Saadat , Tasmia Binte Sogir , Md Taukir Azam Chowdhury , Syem Aziz

Advances in natural language processing have resulted in large language models (LLMs) that are capable of generating understandable and sensible written text. Recent versions of these models, such as OpenAI Codex and GPT-3, can generate…

Software Engineering · Computer Science 2022-11-07 Stephen MacNeil , Andrew Tran , Arto Hellas , Joanne Kim , Sami Sarsa , Paul Denny , Seth Bernstein , Juho Leinonen

Generative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting). Generative QA models…

Computation and Language · Computer Science 2022-10-11 Zhengbao Jiang , Jun Araki , Haibo Ding , Graham Neubig

Large language models (LLMs), including OpenAI's GPT-series, have made significant advancements in recent years. Known for their expertise across diverse subject areas and quick adaptability to user-provided prompts, LLMs hold unique…

Human-Computer Interaction · Computer Science 2025-07-09 Michael Vaccaro , Mikayla Friday , Arash Zaghi

In the expanding field of language model applications, medical knowledge representation remains a significant challenge due to the specialized nature of the domain. Large language models, such as GPT-4, obtain reasonable scores on medical…

Computation and Language · Computer Science 2024-05-24 Julien Khlaut , Corentin Dancette , Elodie Ferreres , Alaedine Bennani , Paul Hérent , Pierre Manceron

Artificial intelligence (AI) is transforming society, making it crucial to prepare the next generation through AI literacy in K-12 education. However, scalable and reliable AI literacy materials and assessment resources are lacking. To…

Human-Computer Interaction · Computer Science 2024-12-03 Jiayi Wang , Ruiwei Xiao , Ying-Jui Tseng