English
Related papers

Related papers: Practical Design and Benchmarking of Generative AI…

200 papers

Large Language Models (LLMs) have advanced rapidly as tools for automating code generation in scientific research, yet their ability to interpret and use unfamiliar Python APIs for complex computational experiments remains poorly…

Software Engineering · Computer Science 2025-09-17 Nuno Fachada , Daniel Fernandes , Carlos M. Fernandes , Bruno D. Ferreira-Saraiva , João P. Matos-Carvalho

Accurate interpretation of lab results is crucial in clinical medicine, yet most patient portals use universal normal ranges, ignoring conditional factors like age and gender. This study introduces Lab-AI, an interactive system that offers…

Computation and Language · Computer Science 2025-04-25 Xiaoyu Wang , Haoyong Ouyang , Balu Bhasuran , Xiao Luo , Karim Hanna , Mia Liza A. Lustria , Carl Yang , Zhe He

The emergent abilities of large language models (LLMs) have demonstrated great potential in solving medical questions. They can possess considerable medical knowledge, but may still hallucinate and are inflexible in the knowledge updates.…

Computation and Language · Computer Science 2024-10-14 Guangzhi Xiong , Qiao Jin , Xiao Wang , Minjia Zhang , Zhiyong Lu , Aidong Zhang

Advances in large language models (LLMs) provide new opportunities in healthcare for improved patient care, clinical decision-making, and enhancement of physician and administrator workflows. However, the potential of these models…

Computation and Language · Computer Science 2024-02-27 Salman Rahman , Lavender Yao Jiang , Saadia Gabriel , Yindalon Aphinyanaphongs , Eric Karl Oermann , Rumi Chunara

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Large language models (LLMs) have shown considerable promise in clinical natural language processing, yet few domain-specific datasets exist to rigorously evaluate their performance on radiology tasks. In this work, we introduce an…

Computation and Language · Computer Science 2025-11-18 Namu Park , Giridhar Kaushik Ramachandran , Kevin Lybarger , Fei Xia , Ozlem Uzuner , Meliha Yetisgen , Martin Gunn

Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. This leads to a…

Computation and Language · Computer Science 2022-04-22 Qihao Zhu , Xinyu Zhang , Jianxi Luo

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material…

Human-Computer Interaction · Computer Science 2024-01-26 Yongtao Liu , Marti Checa , Rama K. Vasudevan

Generative artificial intelligence (AI), and in particular Large Language Models (LLMs), have exploded in popularity and attention since the release to the public of ChatGPT's Generative Pre-trained Transformer (GPT)-3.5 model in November…

Computers and Society · Computer Science 2024-07-25 Daniel Hopp

Large Language Models (LLMs) have demonstrated impressive capabilities across natural language processing tasks. However, their application to specialized domains such as medicine and biology requires further optimization to ensure factual…

Computation and Language · Computer Science 2025-02-06 Seonok Kim

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

Computation and Language · Computer Science 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

Qualitative coding, or content analysis, extracts meaning from text to discern quantitative patterns across a corpus of texts. Recently, advances in the interpretive abilities of large language models (LLMs) offer potential for automating…

Computation and Language · Computer Science 2024-02-14 Zackary Okun Dunivin

Small open-source language models are gaining attention for healthcare applications in low-resource settings where cloud infrastructure and GPU hardware may be unavailable. However, the reliability of these models under different phrasings…

Computation and Language · Computer Science 2026-03-18 Shravani Hariprasad

Recent studies have demonstrated promising performance of ChatGPT and GPT-4 on several medical domain tasks. However, none have assessed its performance using a large-scale real-world electronic health record database, nor have evaluated…

Computation and Language · Computer Science 2023-07-18 Jingqing Zhang , Kai Sun , Akshay Jagadeesh , Mahta Ghahfarokhi , Deepa Gupta , Ashok Gupta , Vibhor Gupta , Yike Guo

In the realm of AI, large language models (LLMs) like GPT-4, central to the operation of AI agents, predominantly operate in the cloud, incurring high operational costs. With local-based small language models (SLMs) becoming more accurate,…

Machine Learning · Computer Science 2025-04-02 Shiyi Liu , Haiying Shen , Shuai Che , Mahdi Ghandi , Mingqin Li

Recent studies show that large language models (LLMs) struggle with technical standards in telecommunications. We propose a fine-tuned retrieval-augmented generation (RAG) system based on the Phi-2 small language model (SLM) to serve as an…

Computation and Language · Computer Science 2025-01-17 Omar Erak , Nouf Alabbasi , Omar Alhussein , Ismail Lotfi , Amr Hussein , Sami Muhaidat , Merouane Debbah

Recent advances in large language models (LLMs) have demonstrated impressive capabilities in code-related tasks, such as code generation and automated program repair. Despite their promising performance, most existing approaches for code…

Software Engineering · Computer Science 2025-09-03 Yicong Zhao , Shisong Chen , Jiacheng Zhang , Zhixu Li

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will…