English
Related papers

Related papers: Current LLMs still cannot 'talk much' about gramma…

200 papers

The degree to which large language models (LLMs) produce writing that is truly human-like remains unclear despite the extensive empirical attention that this question has received. The present study addresses this question from the…

Computation and Language · Computer Science 2026-01-27 Kelly Kendro , Jeffrey Maloney , Scott Jarvis

Large Language Models (LLMs) excel in generating personalized content and facilitating interactive dialogues, showcasing their remarkable aptitude for a myriad of applications. However, their capabilities in reasoning and providing…

Computation and Language · Computer Science 2024-02-16 Min Zhang , Sato Takumi , Jack Zhang , Jun Wang

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

ChatGPT is a language model based on Generative AI. Existing research work on ChatGPT focused on its use in various domains. However, its potential for Sign Language Translation (SLT) is yet to be explored. This paper addresses this void.…

Computation and Language · Computer Science 2024-01-17 Nada Shahin , Leila Ismail

The landscape for building conversational interfaces (chatbots) has witnessed a paradigm shift with recent developments in generative Artificial Intelligence (AI) based Large Language Models (LLMs), such as ChatGPT by OpenAI (GPT3.5 and…

Human-Computer Interaction · Computer Science 2024-07-23 Sumit Soman , Ranjani H G

Recent large language models (LLMs) have demonstrated remarkable performance on a variety of natural language processing (NLP) tasks, leading to intense excitement about their applicability across various domains. Unfortunately, recent work…

Computation and Language · Computer Science 2023-02-13 Yaqi Xie , Chen Yu , Tongyao Zhu , Jinbin Bai , Ze Gong , Harold Soh

Large language models (LLMs) have become mainstream technology with their versatile use cases and impressive performance. Despite the countless out-of-the-box applications, LLMs are still not reliable. A lot of work is being done to improve…

Computation and Language · Computer Science 2023-06-13 Aisha Khatun , Daniel G. Brown

This paper investigates the ontological characterization of Large Language Models (LLMs) like ChatGPT. Between inflationary and deflationary accounts, we pay special attention to their status as agents. This requires explaining in detail…

Artificial Intelligence · Computer Science 2026-03-09 Xabier E. Barandiaran , Lola S. Almendros

Large language models (LLMs) have recently emerged as a powerful tool for a wide range of language generation tasks. Nevertheless, this progress has been slower in Arabic. In this work, we focus on the task of generating stories from LLMs.…

Computation and Language · Computer Science 2024-07-11 Ahmed Oumar El-Shangiti , Fakhraddin Alwajih , Muhammad Abdul-Mageed

Large Language Models (LLMs) have been gaining increasing attention and demonstrated promising performance across a variety of Software Engineering (SE) tasks, such as Automated Program Repair (APR), code summarization, and code completion.…

Software Engineering · Computer Science 2024-04-18 Quanjun Zhang , Tongke Zhang , Juan Zhai , Chunrong Fang , Bowen Yu , Weisong Sun , Zhenyu Chen

Evaluating the capabilities of Large Language Models (LLMs) to assist teachers and students in educational tasks is receiving increasing attention. In this paper, we assess ChatGPT's capacities to solve and grade real programming exams,…

Artificial Intelligence · Computer Science 2025-03-21 Pablo Saborido-Fernández , Marcos Fernández-Pichel , David E. Losada

Assessing the capabilities and limitations of large language models (LLMs) has garnered significant interest, yet the evaluation of multiple models in real-world scenarios remains rare. Multilingual evaluation often relies on translated…

Computation and Language · Computer Science 2025-12-02 Varun Gumma , Ananditha Raghunath , Mohit Jain , Sunayana Sitaram

As a way of addressing increasingly sophisticated problems, software professionals face the constant challenge of seeking improvement. However, for these individuals to enhance their skills, their process of studying and training must…

Software Engineering · Computer Science 2023-08-02 Gustavo Pinto , Isadora Cardoso-Pereira , Danilo Monteiro Ribeiro , Danilo Lucena , Alberto de Souza , Kiev Gama

Based on one million arXiv papers submitted from May 2018 to January 2024, we assess the textual density of ChatGPT's writing style in their abstracts through a statistical analysis of word frequency changes. Our model is calibrated and…

Computation and Language · Computer Science 2024-11-11 Mingmeng Geng , Roberto Trotta

Modern Artificial Intelligence applications show great potential for language-related tasks that rely on next-word prediction. The current generation of Large Language Models (LLMs) have been linked to claims about human-like linguistic…

Computation and Language · Computer Science 2024-09-05 Evelina Leivada , Gary Marcus , Fritz Günther , Elliot Murphy

Large language models (LLMs) have significantly advanced various natural language processing (NLP) tasks. Recent research indicates that moderately-sized LLMs often outperform larger ones after task-specific fine-tuning. This study focuses…

Computation and Language · Computer Science 2024-10-14 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , George Foster , Gholamreza Haffari

In this paper, we investigate the use of large language models (LLMs) like ChatGPT for document-grounded response generation in the context of information-seeking dialogues. For evaluation, we use the MultiDoc2Dial corpus of task-oriented…

Computation and Language · Computer Science 2023-09-22 Norbert Braunschweiler , Rama Doddipatla , Simon Keizer , Svetlana Stoyanchev

Large language models (LLMs) have made significant progress in NLP. However, their ability to memorize, represent, and leverage commonsense knowledge has been a well-known pain point. In this paper, we specifically focus on ChatGPT, a…

Computation and Language · Computer Science 2024-04-22 Ning Bian , Xianpei Han , Le Sun , Hongyu Lin , Yaojie Lu , Ben He , Shanshan Jiang , Bin Dong

Deploying Large Language Models (LLMs) for question answering (QA) over lengthy contexts is a significant challenge. In industrial settings, this process is often hindered by high computational costs and latency, especially when multiple…

Computation and Language · Computer Science 2025-09-29 Xiliang Zhu , Shi Zong , David Rossouw

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi , Michal Kosinski