English
Related papers

Related papers: Fumbling in Babel: An Investigation into ChatGPT's…

200 papers

Large language models have been demonstrated to be valuable in different fields. ChatGPT, developed by OpenAI, has been trained using massive amounts of data and simulates human conversation by comprehending context and generating…

Computation and Language · Computer Science 2023-04-05 Ali Borji

Multilingual language models have significantly advanced due to rapid progress in natural language processing. Models like BLOOM 1.7B, trained on diverse multilingual datasets, aim to bridge linguistic gaps. However, their effectiveness in…

Computation and Language · Computer Science 2026-02-03 Santhosh Kakarla , Gautama Shastry Bulusu Venkata , Aishwarya Gaddam , Maheedhar Sai Omtri Mohan

The debut of ChatGPT has recently attracted the attention of the natural language processing (NLP) community and beyond. Existing studies have demonstrated that ChatGPT shows significant improvement in a range of downstream NLP tasks, but…

Information Retrieval · Computer Science 2023-08-25 Sunhao Dai , Ninglu Shao , Haiyuan Zhao , Weijie Yu , Zihua Si , Chen Xu , Zhongxiang Sun , Xiao Zhang , Jun Xu

This paper investigates the novel application of Large Language Models (LLMs) with vision capabilities to analyze satellite imagery for village-level poverty prediction. Although LLMs were originally designed for natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Hamid Sarmadi , Ola Hall , Thorsteinn Rögnvaldsson , Mattias Ohlsson

The increasing volume of log data produced by software-intensive systems makes it impractical to analyze them manually. Many deep learning-based methods have been proposed for log-based anomaly detection. These methods face several…

Machine Learning · Computer Science 2023-09-06 Jiaxing Qi , Shaohan Huang , Zhongzhi Luan , Carol Fung , Hailong Yang , Depei Qian

Recent advancements in Large Language Models (LLMs) have demonstrated significant potential across a wide range of software engineering tasks, including software design, an area traditionally regarded as highly dependent on human expertise…

Software Engineering · Computer Science 2026-05-05 Yifei Wang , Ruiyin Li , Peng Liang , Yangxiao Cai , Zengyang Li , Mojtaba Shahin , Arif Ali Khan , Qiong Feng

We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but…

Software Engineering · Computer Science 2024-03-26 Minaoar Hossain Tanzil , Junaed Younus Khan , Gias Uddin

The emergence of ChatGPT has generated much speculation in the press about its potential to disrupt social and economic systems. Its astonishing language ability has aroused strong curiosity among scholars about its performance in different…

Artificial Intelligence · Computer Science 2024-12-25 Rui Mao , Guanyi Chen , Xulang Zhang , Frank Guerin , Erik Cambria

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

Natural Language Processing (NLP) for Requirements Engineering (RE) (NLP4RE) seeks to apply NLP tools, techniques, and resources to the RE process to increase the quality of the requirements. There is little research involving the…

Software Engineering · Computer Science 2023-07-17 Krishna Ronanki , Christian Berger , Jennifer Horkoff

ChatGPT is a generative pretrained transformer language model created using artificial intelligence implemented as chatbot which can provide very detailed responses to a wide variety of questions. As a very contemporary phenomenon, this…

Cryptography and Security · Computer Science 2023-07-14 Sheetal Temara

There is enormous enthusiasm and concerns in using large language models (LLMs) in healthcare, yet current assumptions are all based on general-purpose LLMs such as ChatGPT. This study develops a clinical generative LLM, GatorTronGPT, using…

The progress of Large Language Models (LLMs) like ChatGPT raises the question of how they can be integrated into education. One hope is that they can support mathematics learning, including word-problem solving. Since LLMs can handle…

Computation and Language · Computer Science 2025-08-12 Anselm R. Strohmaier , Wim Van Dooren , Kathrin Seßler , Brian Greer , Lieven Verschaffel

Large Language Models (LLMs) have recently shown impressive abilities in handling various natural language-related tasks. Among different LLMs, current studies have assessed ChatGPT's superior performance across manifold tasks, especially…

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Yingya Li , Sheng Lu , Hoang Van , Hugo JWL Aerts , Guergana K. Savova , Danielle S. Bitterman

The ability to transmit and receive complex information via language is unique to humans and is the basis of traditions, culture and versatile social interactions. Through the disruptive introduction of transformer based large language…

Computation and Language · Computer Science 2024-05-06 Patrick Krauss , Jannik Hösch , Claus Metzner , Andreas Maier , Peter Uhrig , Achim Schilling

Multilingual pretrained language models (mPLMs) acquire valuable, generalizable linguistic information during pretraining and have advanced the state of the art on task-specific finetuning. To date, only ~31 out of ~2,000 African languages…

Computation and Language · Computer Science 2023-05-30 Ife Adebara , AbdelRahim Elmadany , Muhammad Abdul-Mageed , Alcides Alcoba Inciarte

Language Identification (LID) is the task of determining the language of a given text and is a fundamental preprocessing step that affects the reliability of downstream NLP applications. While recent work has expanded LID coverage for…

Computation and Language · Computer Science 2026-01-30 Sang Yun Kwon , AbdelRahim Elmadany , Muhammad Abdul-Mageed

Conversational large-language models are extensively used for issue resolution tasks. However, not all developer-LLM conversations are useful for effective issue resolution. In this paper, we analyze 686 developer-ChatGPT conversations…

Software Engineering · Computer Science 2025-11-25 Ramtin Ehsani , Sakshi Pathak , Esteban Parra , Sonia Haiduc , Preetha Chatterjee