English
Related papers

Related papers: Evaluating Large Language Models on a Highly-speci…

200 papers

Large language models (LLMs) like ChatGPT show excellent capabilities in various natural language processing tasks, especially for text generation. The effectiveness of LLMs in summarizing radiology report impressions remains unclear. In…

Computation and Language · Computer Science 2025-04-07 Danqing Hu , Shanyuan Zhang , Qing Liu , Xiaofeng Zhu , Bing Liu

The ChatGPT, a lite and conversational variant of Generative Pretrained Transformer 4 (GPT-4) developed by OpenAI, is one of the milestone Large Language Models (LLMs) with billions of parameters. LLMs have stirred up much interest among…

Computation and Language · Computer Science 2023-08-01 Hanyao Huang , Ou Zheng , Dongdong Wang , Jiayi Yin , Zijin Wang , Shengxuan Ding , Heng Yin , Chuan Xu , Renjie Yang , Qian Zheng , Bing Shi

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

The recent success of general-domain large language models (LLMs) has significantly changed the natural language processing paradigm towards a unified foundation model across domains and applications. In this paper, we focus on assessing…

The proliferation of Large Language Models (LLMs), such as ChatGPT, has raised concerns about their potential impact on academic integrity, prompting the need for LLM-resistant exam designs. This article investigates the performance of LLMs…

Computation and Language · Computer Science 2023-04-25 Simon kaare Larsen

Large Language Models (LLMs) have lately been on the spotlight of researchers, businesses, and consumers alike. While the linguistic capabilities of such models have been studied extensively, there is growing interest in investigating them…

Computation and Language · Computer Science 2023-08-17 Sotiris Lamprinidis

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

Computation and Language · Computer Science 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Yingya Li , Sheng Lu , Hoang Van , Hugo JWL Aerts , Guergana K. Savova , Danielle S. Bitterman

In the past year, there has been a growing trend in applying Large Language Models (LLMs) to the field of medicine, particularly with the advent of advanced language models such as ChatGPT developed by OpenAI. However, there is limited…

Computation and Language · Computer Science 2024-02-27 Fujian Jia , Xin Liu , Lixi Deng , Jiwen Gu , Chunchao Pu , Tunan Bai , Mengjiang Huang , Yuanzhi Lu , Kang Liu

Large Language Models (LLMs), such as ChatGPT, have taken the world by storm and have passed certain forms of the Turing test. However, LLMs are not limited to human language and analyze sequential data, such as DNA, protein, and gene…

Genomics · Quantitative Biology 2024-01-08 Hilbert Yuen In Lam , Xing Er Ong , Marek Mutwil

The potential of large language models in medicine for education and decision making purposes has been demonstrated as they achieve decent scores on medical exams such as the United States Medical Licensing Exam (USMLE) and the MedQA exam.…

The transformative influence of Large Language Models (LLMs) is profoundly reshaping the Artificial Intelligence (AI) technology domain. Notably, ChatGPT distinguishes itself within these models, demonstrating remarkable performance in…

Software Engineering · Computer Science 2024-05-28 Sayed Erfan Arefin , Tasnia Ashrafi Heya , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

Large Language Models (LLMs) could be a useful tool for lawyers. However, empirical research on their effectiveness in conducting legal tasks is scant. We study securities cases involving cryptocurrencies as one of numerous contexts where…

Artificial Intelligence · Computer Science 2024-02-23 Arianna Trozze , Toby Davies , Bennett Kleinberg

As large language models (LLMs) gain popularity among speakers of diverse languages, we believe that it is crucial to benchmark them to better understand model behaviors, failures, and limitations in languages beyond English. In this work,…

Computation and Language · Computer Science 2023-04-06 Jungo Kasai , Yuhei Kasai , Keisuke Sakaguchi , Yutaro Yamada , Dragomir Radev

Introduction: Large language models (LLM) have shown great potential in clinical decision support. GPT-5 is a novel LLM system that has been specifically marketed towards oncology use. Methods: Performance was assessed using two…

Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability, and scalability of analyses by automatic parallelization on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Mario Sänger , Ninon De Mecquenem , Katarzyna Ewa Lewińska , Vasilis Bountris , Fabian Lehmann , Ulf Leser , Thomas Kosch

As ChatGPT and GPT-4 spearhead the development of Large Language Models (LLMs), more researchers are investigating their performance across various tasks. But more research needs to be done on the interpretability capabilities of LLMs, that…

Computation and Language · Computer Science 2023-10-27 Dongfang Li , Jindi Yu , Baotian Hu , Zhenran Xu , Min Zhang

Large Language Models (LLMs) have emerged as influential instruments within the realm of natural language processing; nevertheless, their capacity to handle multi-party conversations (MPCs) -- a scenario marked by the presence of multiple…

Computation and Language · Computer Science 2023-10-26 Chao-Hong Tan , Jia-Chen Gu , Zhen-Hua Ling

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

Large language models (LLMs) implicitly learn to perform a range of language tasks, including machine translation (MT). Previous studies explore aspects of LLMs' MT capabilities. However, there exist a wide variety of languages for which…

Computation and Language · Computer Science 2023-09-15 Nathaniel R. Robinson , Perez Ogayo , David R. Mortensen , Graham Neubig