English
Related papers

Related papers: Can ChatGPT advance software testing intelligence?…

200 papers

ChatGPT has achieved great success and can be considered to have acquired an infrastructural status. There are abundant works for evaluating ChatGPT on benchmarks. However, existing benchmarks encounter two challenges: (1) Disregard for…

Computation and Language · Computer Science 2024-06-19 Shangqing Tu , Chunyang Li , Jifan Yu , Xiaozhi Wang , Lei Hou , Juanzi Li

The advent of ChatGPT, a large language model-powered chatbot, has prompted questions about its potential implications for traditional search engines. In this study, we investigate the differences in user behavior when employing search…

Artificial Intelligence · Computer Science 2023-07-04 Ruiyun Xu , Yue Feng , Hailiang Chen

Large language models (LLMs) have introduced substantial challenges to software quality assurance due to their generative, probabilistic, and open-ended nature, which intensifies the oracle problem and limits the applicability of…

Software Engineering · Computer Science 2026-05-15 Zheng Zheng , Zenghui Zhou , Yinwang Xu , Daixu Ren , Tsong Yueh Chen

We have recently witnessed tremendous success of Machine Learning (ML) in practical applications. Computer vision, speech recognition and language translation have all seen a near human level performance. We expect, in the near future, most…

Large-scale language models (LLMs) have emerged as a groundbreaking innovation in the realm of question-answering and conversational agents. These models, leveraging different deep learning architectures such as Transformers, are trained on…

Software Engineering · Computer Science 2023-07-18 Fardin Ahsan Sakib , Saadat Hasan Khan , A. H. M. Rezaul Karim

Generative AI models continue to become more powerful. The launch of ChatGPT in November 2022 has ushered in a new era of AI. ChatGPT and other similar chatbots have a range of capabilities, from answering student homework questions to…

Computers and Society · Computer Science 2023-06-14 Yanchen Wang , Lisa Singh

ChatGPT is a powerful language model from OpenAI that is arguably able to comprehend and generate text. ChatGPT is expected to have a large impact on society, research, and education. An essential step to understand ChatGPT's expected…

Human-Computer Interaction · Computer Science 2023-09-20 Lukas Schulze Balhorn , Jana M. Weber , Stefan Buijsman , Julian R. Hildebrandt , Martina Ziefle , Artur M. Schweidtmann

The recent advancements in Large Language Models (LLMs), particularly conversational LLMs like ChatGPT, have prompted changes in a range of fields, including design. This study aims to examine the capabilities of ChatGPT in a human-centered…

Human-Computer Interaction · Computer Science 2023-02-16 A. Baki Kocaballi

The rapid progression in artificial intelligence has facilitated the emergence of large language models like ChatGPT, offering potential applications extending into specialized engineering modeling, especially physics-based building energy…

Human-Computer Interaction · Computer Science 2024-11-18 Liang Zhang , Zhelun Chen , Vitaly Ford

Large Language Models (LLMs) have revo lutionized natural language processing Natural Language Processing (NLP), with Chat Generative Pre-trained Transformer (ChatGPT) standing out as a notable exampledue to its advanced capabilities and…

Computation and Language · Computer Science 2025-03-25 Azim Akhtarshenas , Afshin Dini , Navid Ayoobi

ChatGPT has recently gathered attention from the general public and academia as a tool that is able to generate plausible and human-sounding text answers to various questions. One potential use, or abuse, of ChatGPT is in answering various…

Computers and Society · Computer Science 2023-04-17 Sanjay Deshpande , Jakub Szefer

With the widespread application of LLM-based dialogue systems in daily life, quality assurance has become more important than ever. Recent research has successfully introduced methods to identify unexpected behaviour in single-turn testing…

Software Engineering · Computer Science 2025-06-24 Guoxiang Guo , Aldeida Aleti , Neelofar Neelofar , Chakkrit Tantithamthavorn , Yuanyuan Qi , Tsong Yueh Chen

This study explores the integration and impact of ChatGPT, a generative AI that utilizes natural language processing, in an educational environment. The main goal is to evaluate how ChatGPT affects project performance. To this end, we…

Computers and Society · Computer Science 2024-09-09 Sunhee Hwang , Yudoo Kim , Heejin Lee

In Agile software development, user stories play a vital role in capturing and conveying end-user needs, prioritizing features, and facilitating communication and collaboration within development teams. However, automated methods for…

Software Engineering · Computer Science 2023-06-22 Krishna Ronanki , Beatriz Cabrero-Daniel , Christian Berger

Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022. It has shown impressive performance in various domains, including passing exams and creative writing.…

Computation and Language · Computer Science 2023-08-28 Shahab Saquib Sohail , Faiza Farhat , Yassine Himeur , Mohammad Nadeem , Dag Øivind Madsen , Yashbir Singh , Shadi Atalla , Wathiq Mansoor

Orchestrating a high-quality data preparation program is essential for successful machine learning (ML), but it is known to be time and effort consuming. Despite the impressive capabilities of large language models like ChatGPT in…

Databases · Computer Science 2023-04-10 Sibei Chen , Hanbing Liu , Weiting Jin , Xiangyu Sun , Xiaoyao Feng , Ju Fan , Xiaoyong Du , Nan Tang

The rapid advancement of artificial intelligence (AI) has highlighted ChatGPT as a pivotal technology in the field of information retrieval (IR). Distinguished from its predecessors, ChatGPT offers significant benefits that have attracted…

Information Retrieval · Computer Science 2024-04-18 Yizheng Huang , Jimmy Huang

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

Computation and Language · Computer Science 2023-07-07 Md Tahmid Rahman Laskar , M Saiful Bari , Mizanur Rahman , Md Amran Hossen Bhuiyan , Shafiq Joty , Jimmy Xiangji Huang

Prompt engineering has shown potential for improving translation quality in LLMs. However, the possibility of using translation concepts in prompt design remains largely underexplored. Against this backdrop, the current paper discusses the…

Computation and Language · Computer Science 2026-04-06 Sui He

Computer programming is a fundamental tool for life scientists, allowing them to carry out many essential research tasks. However, despite a variety of educational efforts, learning to write code can be a challenging endeavor for both…

Other Quantitative Biology · Quantitative Biology 2024-01-02 Stephen R. Piccolo , Paul Denny , Andrew Luxton-Reilly , Samuel Payne , Perry G. Ridge