English
Related papers

Related papers: ChatGPT-powered Conversational Drug Editing Using …

200 papers

Large language models (LLMs) integrated with autonomous agents hold significant potential for advancing scientific discovery through automated reasoning and task execution. However, applying LLM agents to drug discovery is still constrained…

Artificial Intelligence · Computer Science 2025-07-29 Kun Li , Zhennan Wu , Shoupeng Wang , Jia Wu , Shirui Pan , Wenbin Hu

This paper proposes a framework for quantitatively evaluating interactive LLMs such as ChatGPT using publicly available data sets. We carry out an extensive technical evaluation of ChatGPT using 23 data sets covering 8 different common NLP…

Computation and Language · Computer Science 2023-11-29 Yejin Bang , Samuel Cahyawijaya , Nayeon Lee , Wenliang Dai , Dan Su , Bryan Wilie , Holy Lovenia , Ziwei Ji , Tiezheng Yu , Willy Chung , Quyet V. Do , Yan Xu , Pascale Fung

Large language models (LLMs) are increasingly used for analytical tasks, yet their effectiveness in real-world applications remains underexamined, partly due to the opacity of proprietary models. We evaluate ChatGPT (GPT-3.5 and GPT-4) on…

Human-Computer Interaction · Computer Science 2026-03-25 Jonas Oppenlaender , Joonas Hämäläinen

Generalized large language models (LLMs) such as GPT-4 may not provide specific answers to queries formulated by materials science researchers. These models may produce a high-level outline but lack the capacity to return detailed…

Computation and Language · Computer Science 2024-06-04 Achuth Chandrasekhar , Jonathan Chan , Francis Ogoke , Olabode Ajenifujah , Amir Barati Farimani

Large language models (LLMs) have taken the scientific world by storm, changing the landscape of natural language processing and human-computer interaction. These powerful tools can answer complex questions and, surprisingly, perform…

Artificial Intelligence · Computer Science 2023-11-14 Pier Luca Lanzi , Daniele Loiacono

The evolution of Generative AI and the capabilities of the newly released Large Language Models (LLMs) open new opportunities in software engineering. However, they also lead to new challenges in cybersecurity. Recently, researchers have…

Cryptography and Security · Computer Science 2023-09-08 Mika Beckerich , Laura Plein , Sergio Coronado

Large Language Models (LLMs), like ChatGPT, have demonstrated vast potential but also introduce challenges related to content constraints and potential misuse. Our study investigates three key research questions: (1) the number of different…

Software Engineering · Computer Science 2024-03-12 Yi Liu , Gelei Deng , Zhengzi Xu , Yuekang Li , Yaowen Zheng , Ying Zhang , Lida Zhao , Tianwei Zhang , Kailong Wang , Yang Liu

Driven by the rapid growth of machine learning, recent advances in game artificial intelligence (AI) have significantly impacted productivity across various gaming genres. Reward design plays a pivotal role in training game AI models,…

Artificial Intelligence · Computer Science 2024-06-19 In-Chang Baek , Tae-Hwa Park , Jin-Ha Noh , Cheong-Mok Bae , Kyung-Joong Kim

Large language models (LLMs) have emerged as powerful machine-learning systems capable of handling a myriad of tasks. Tuned versions of these systems have been turned into chatbots that can respond to user queries on a vast diversity of…

Computation and Language · Computer Science 2024-08-16 Kevin G. Yager

The startling success of ChatGPT and other large language models (LLMs) using transformer-based generative neural network architecture in applications such as natural language processing and image synthesis has many researchers excited…

Artificial Intelligence · Computer Science 2024-11-05 Venkat Venkatasubramanian , Arijit Chakraborty

Drug-drug interaction (DDI) prediction is critical for treatment safety. While large language models (LLMs) show promise in pharmaceutical tasks, their effectiveness in DDI prediction remains challenging. Inspired by the well-established…

Artificial Intelligence · Computer Science 2025-05-30 Guangyi Liu , Yongqi Zhang , Xunyuan Liu , Quanming Yao

Although Large Language Models (LLMs) have demonstrated remarkable code-generation ability, they still struggle with complex tasks. In real-world software development, humans usually tackle complex tasks through collaborative teamwork, a…

Software Engineering · Computer Science 2024-05-14 Yihong Dong , Xue Jiang , Zhi Jin , Ge Li

Objective: To evaluate the efficiency of large language models (LLMs) such as ChatGPT to assist in diagnosing neuro-ophthalmic diseases based on detailed case descriptions. Methods: We selected 22 different case reports of neuro-ophthalmic…

Computers and Society · Computer Science 2023-09-25 Yeganeh Madadi , Mohammad Delsoz , Priscilla A. Lao , Joseph W. Fong , TJ Hollingsworth , Malik Y. Kahook , Siamak Yousefi

Traditional applications of natural language processing (NLP) in healthcare have predominantly focused on patient-centered services, enhancing patient interactions and care delivery, such as through medical dialogue systems. However, the…

Computation and Language · Computer Science 2024-06-11 Hengguan Huang , Songtao Wang , Hongfu Liu , Hao Wang , Ye Wang

Large language models (LLMs) such as those embedded in 'chatbots' are accelerating and democratizing research by providing comprehensible information and expertise from many different fields. However, these models may also confer easy…

Computers and Society · Computer Science 2023-06-07 Emily H. Soice , Rafael Rocha , Kimberlee Cordova , Michael Specter , Kevin M. Esvelt

The versatility of large language models (LLMs) has been explored across various sectors, but their application in healthcare poses challenges, particularly in the domain of pharmaceutical contraindications where accurate and reliable…

Artificial Intelligence · Computer Science 2025-08-11 Byeonghun Bang , Jongsuk Yoon , Dong-Jin Chang , Seho Park , Yong Oh Lee

This paper presents prompt design techniques for software engineering, in the form of patterns, to solve common problems when using large language models (LLMs), such as ChatGPT to automate common software engineering activities, such as…

Software Engineering · Computer Science 2023-03-15 Jules White , Sam Hays , Quchen Fu , Jesse Spencer-Smith , Douglas C. Schmidt

The increasing use of large language models (LLMs) in natural language processing (NLP) tasks has sparked significant interest in evaluating their effectiveness across diverse applications. While models like ChatGPT and DeepSeek have shown…

Computation and Language · Computer Science 2025-08-12 Wael Etaiwi , Bushra Alhijawi

Objective: This study aims to summarize the usage of Large Language Models (LLMs) in the process of creating a scientific review. We look at the range of stages in a review that can be automated and assess the current state-of-the-art…

Digital Libraries · Computer Science 2025-05-16 Dmitry Scherbakov , Nina Hubig , Vinita Jansari , Alexander Bakumenko , Leslie A. Lenert

Code reviews are an integral part of software development and have been recognized as a crucial practice for minimizing bugs and favouring higher code quality. They serve as an important checkpoint before committing code and play an…

Software Engineering · Computer Science 2024-12-05 Genevieve Caumartin , Qiaolin Qin , Sharon Chatragadda , Janmitsinh Panjrolia , Heng Li , Diego Elias Costa