English
Related papers

Related papers: In which fields do ChatGPT scores align better tha…

200 papers

Harnessing the potential of large language models (LLMs) like ChatGPT can help address social challenges through inclusive, ethical, and sustainable means. In this paper, we investigate the extent to which ChatGPT can annotate data for…

Artificial Intelligence · Computer Science 2024-07-10 Yiming Zhu , Peixian Zhang , Ehsan-Ul Haq , Pan Hui , Gareth Tyson

Generative AI including large language models (LLMs) has recently gained significant interest in the geo-science community through its versatile task-solving capabilities including programming, arithmetic reasoning, generation of sample…

Computers and Society · Computer Science 2024-08-14 Hartwig H. Hochmair , Levente Juhasz , Takoda Kemp

Given the rapid ascent of large language models (LLMs), we study the question: (How) can large language models help in reviewing of scientific papers or proposals? We first conduct some pilot studies where we find that (i) GPT-4 outperforms…

Computation and Language · Computer Science 2023-06-02 Ryan Liu , Nihar B. Shah

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Yingya Li , Sheng Lu , Hoang Van , Hugo JWL Aerts , Guergana K. Savova , Danielle S. Bitterman

In this paper, we evaluate the creative fiction writing abilities of a fine-tuned small language model (SLM), BART-large, and compare its performance to human writers and two large language models (LLMs): GPT-3.5 and GPT-4o. Our evaluation…

Computation and Language · Computer Science 2025-06-05 Guillermo Marco , Luz Rello , Julio Gonzalo

Artificial intelligence is gaining traction in more ways than ever before. The popularity of language models and AI-based businesses has soared since ChatGPT was made available to the general public via OpenAI. It is becoming increasingly…

Computers and Society · Computer Science 2023-07-31 Prabin Sharma , Kisan Thapa , Dikshya Thapa , Prastab Dhakal , Mala Deep Upadhaya , Santosh Adhikari , Salik Ram Khanal

Large Language Models (LLM) have taken the front seat in most of the news since November 2022, when ChatGPT was introduced. After more than one year, one of the major reasons companies are resistant to adopting them is the limited…

Artificial Intelligence · Computer Science 2024-03-13 Carlo Lipizzi

The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and…

Human-Computer Interaction · Computer Science 2023-06-27 Philippe J. Giabbanelli

We evaluate the effectiveness of Large Language Models (LLMs) in assessing essay quality, focusing on their alignment with human grading. More precisely, we evaluate ChatGPT and Llama in the Automated Essay Scoring (AES) task, a crucial…

Computation and Language · Computer Science 2024-09-23 Anindita Kundu , Denilson Barbosa

Low-resource languages face significant challenges due to the lack of sufficient linguistic data, resources, and tools for tasks such as supervised learning, annotation, and classification. This shortage hinders the development of accurate…

Computation and Language · Computer Science 2025-03-04 Suramya Jadhav , Abhay Shanbhag , Amogh Thakurdesai , Ridhima Sinare , Raviraj Joshi

Large language models (LLMs) often generate content with unsupported or unverifiable content, known as "hallucinations." To address this, retrieval-augmented LLMs are employed to include citations in their content, grounding the content in…

Information Retrieval · Computer Science 2024-08-23 Weijia Zhang , Mohammad Aliannejadi , Jiahuan Pei , Yifei Yuan , Jia-Hong Huang , Evangelos Kanoulas

The use of Large language models (LLMs) to augment clinical decision support systems is a topic with rapidly growing interest, but current shortcomings such as hallucinations and lack of clear source citations make them unreliable for use…

Human-Computer Interaction · Computer Science 2024-09-25 Daniel Jung , Alex Butler , Joongheum Park , Yair Saperstein

Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community. Previous research has evaluated these LLMs for various applications such as generating programming exercises and…

Human-Computer Interaction · Computer Science 2024-01-08 Ishika Joshi , Ritvik Budhiraja , Harshal D Akolekar , Jagat Sesh Challa , Dhruv Kumar

ChatGPT (GPT) has become one of the most talked-about innovations in recent years, with over 100 million users worldwide. However, there is still limited knowledge about the sources of information GPT utilizes. As a result, we carried out a…

Digital Libraries · Computer Science 2023-04-17 Eduard Petiska

Large Language Models (LLMs), such as ChatGPT, are reshaping content creation and academic writing. This study investigates the impact of AI-assisted generative revisions on research manuscripts, focusing on heterogeneous adoption patterns…

Computation and Language · Computer Science 2025-04-21 Cong William Lin , Wu Zhu

Background: Large language models (LLMs) such as ChatGPT are increasingly used in introductory programming courses to provide real-time code generation, debugging, and explanations. While these tools can boost productivity and code quality,…

Software Engineering · Computer Science 2025-10-02 Shiza Andleeb , Brandon Kantorski , Jeffrey C. Carver

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

Large language models (LLMs) like ChatGPT can generate and revise text with human-level performance. These models come with clear limitations: they can produce inaccurate information, reinforce existing biases, and be easily misused. Yet,…

Computation and Language · Computer Science 2025-07-04 Dmitry Kobak , Rita González-Márquez , Emőke-Ágnes Horvát , Jan Lause

Artificial intelligence chatbots driven by large language models (LLMs) have the potential to increase public science literacy and support scientific research, as they can quickly summarize complex scientific information in accessible…

Computation and Language · Computer Science 2025-04-02 Uwe Peters , Benjamin Chin-Yee

Bidirectional transformers excel at sentiment analysis, and Large Language Models (LLM) are effective zero-shot learners. Might they perform better as a team? This paper explores collaborative approaches between ELECTRA and GPT-4o for…

Computation and Language · Computer Science 2025-05-06 James P. Beno