English
Related papers

Related papers: Exploring ChatGPT's Capabilities on Vulnerability …

200 papers

The way users acquire information is undergoing a paradigm shift with the advent of ChatGPT. Unlike conventional search engines, ChatGPT retrieves knowledge from the model itself and generates answers for users. ChatGPT's impressive…

Cryptography and Security · Computer Science 2023-10-06 Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

Large Language Models (LLMs) have been gaining increasing attention and demonstrated promising performance across a variety of Software Engineering (SE) tasks, such as Automated Program Repair (APR), code summarization, and code completion.…

Software Engineering · Computer Science 2024-04-18 Quanjun Zhang , Tongke Zhang , Juan Zhai , Chunrong Fang , Bowen Yu , Weisong Sun , Zhenyu Chen

ChatGPT has changed the AI community and an active research line is the performance evaluation of ChatGPT. A key challenge for the evaluation is that ChatGPT is still closed-source and traditional benchmark datasets may have been used by…

Computation and Language · Computer Science 2024-05-13 Ming Liu , Ran Liu , Ye Zhu , Hua Wang , Youyang Qu , Rongsheng Li , Yongpan Sheng , Wray Buntine

The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7…

Computation and Language · Computer Science 2023-04-25 Bo Li , Gexiang Fang , Yang Yang , Quansen Wang , Wei Ye , Wen Zhao , Shikun Zhang

Automated code generation can be a powerful technique for software development, significantly reducing developers' efforts and time required to create new code by generating it automatically based on requirements. Recently, OpenAI's…

Software Engineering · Computer Science 2023-05-16 Chao Liu , Xuanlin Bao , Hongyu Zhang , Neng Zhang , Haibo Hu , Xiaohong Zhang , Meng Yan

In recent years, large language models have been responsible for great advances in the field of artificial intelligence (AI). ChatGPT in particular, an AI chatbot developed and recently released by OpenAI, has taken the field to the next…

Cryptography and Security · Computer Science 2026-04-09 Raphaël Khoury , Anderson R. Avila , Jacob Brunelle , Baba Mamadou Camara

ChatGPT has recently emerged as a powerful tool for performing diverse NLP tasks. However, ChatGPT has been criticized for generating nonfactual responses, raising concerns about its usability for sensitive tasks like fact verification.…

Information Retrieval · Computer Science 2023-11-14 Mohna Chakraborty , Adithya Kulkarni , Qi Li

Event extraction is a fundamental task in natural language processing that involves identifying and extracting information about events mentioned in text. However, it is a challenging task due to the lack of annotated data, which is…

Computation and Language · Computer Science 2023-03-10 Jun Gao , Huan Zhao , Changlong Yu , Ruifeng Xu

Code review is an essential activity for ensuring the quality and maintainability of software projects. However, it is a time-consuming and often error-prone task that can significantly impact the development process. Recently, ChatGPT, a…

Software Engineering · Computer Science 2023-09-18 Qi Guo , Junming Cao , Xiaofei Xie , Shangqing Liu , Xiaohong Li , Bihuan Chen , Xin Peng

As artificial intelligence technology continues to advance, chatbots are becoming increasingly powerful. Among them, ChatGPT, launched by OpenAI, has garnered widespread attention globally due to its powerful natural language processing…

Cryptography and Security · Computer Science 2026-02-03 Yushan Xiang , Zhongwen Li , Xiaoqi Li

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

In this paper, we explore the application of ChatGPT in the domain of Robust and Adaptive Robust Optimization. We demonstrate that with appropriate prompting, ChatGPT can be used to auto-formulate and solve simple Robust and Adaptive…

Optimization and Control · Mathematics 2025-01-03 Dimitris Bertsimas , Georgios Margaritis

Recently, ChatGPT has drawn great attention from both the research community and the public. We are particularly interested in whether it can serve as a universal sentiment analyzer. To this end, in this work, we provide a preliminary…

Computation and Language · Computer Science 2024-02-20 Zengzhi Wang , Qiming Xie , Yi Feng , Zixiang Ding , Zinong Yang , Rui Xia

ChatGPT is a type of artificial intelligence language model that uses deep learning algorithms to generate human-like responses to text-based prompts. The introduction of the latest ChatGPT version in November of 2022 has caused shockwaves…

Computers and Society · Computer Science 2023-05-02 Mohammad Fraiwan , Natheer Khasawneh

In recent years, personality has been regarded as a valuable personal factor being incorporated into numerous tasks such as sentiment analysis and product recommendation. This has led to widespread attention to text-based personality…

Computation and Language · Computer Science 2023-12-29 Yu Ji , Wen Wu , Hong Zheng , Yi Hu , Xi Chen , Liang He

Large language models (LLMs) like ChatGPT have shown the potential to assist developers with coding and debugging tasks. However, their role in collaborative issue resolution is underexplored. In this study, we analyzed 1,152…

Software Engineering · Computer Science 2024-12-12 Joy Krishan Das , Saikat Mondal , Chanchal K. Roy

ChatGPT has achieved great success and can be considered to have acquired an infrastructural status. There are abundant works for evaluating ChatGPT on benchmarks. However, existing benchmarks encounter two challenges: (1) Disregard for…

Computation and Language · Computer Science 2024-06-19 Shangqing Tu , Chunyang Li , Jifan Yu , Xiaozhi Wang , Lei Hou , Juanzi Li

In this study we argue that integrating ChatGPT into the data processing pipeline of automated sensors in precision agriculture has the potential to bring several benefits and enhance various aspects of modern farming practices. Policy…

Artificial Intelligence · Computer Science 2023-11-14 Ilyas Potamitis

This report provides a preliminary evaluation of ChatGPT for machine translation, including translation prompt, multilingual translation, and translation robustness. We adopt the prompts advised by ChatGPT to trigger its translation ability…

Computation and Language · Computer Science 2023-11-03 Wenxiang Jiao , Wenxuan Wang , Jen-tse Huang , Xing Wang , Shuming Shi , Zhaopeng Tu

ChatGPT has shown the potential of emerging general artificial intelligence capabilities, as it has demonstrated competent performance across many natural language processing tasks. In this work, we evaluate the capabilities of ChatGPT to…

Computation and Language · Computer Science 2023-03-07 Mostafa M. Amin , Erik Cambria , Björn W. Schuller