English
Related papers

Related papers: Is GPT-4 a Good Data Analyst?

200 papers

Large language models (LLMs) are now highly capable at a diverse range of tasks. This paper studies whether or not GPT-4, one such LLM, is capable of assisting researchers in the field of adversarial machine learning. As a case study, we…

Cryptography and Security · Computer Science 2023-07-28 Nicholas Carlini

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

Data analysis is challenging as it requires synthesizing domain knowledge, statistical expertise, and programming skills. Assistants powered by large language models (LLMs), such as ChatGPT, can assist analysts by translating natural…

Human-Computer Interaction · Computer Science 2024-03-05 Ken Gu , Ruoxi Shang , Tim Althoff , Chenglong Wang , Steven M. Drucker

The accelerated evolution of large language models has raised questions about their comparative performance across domains of practical importance. GPT-4 by OpenAI introduced advances in reasoning, multimodality, and task generalization,…

Human-Computer Interaction · Computer Science 2025-08-28 Georgios P. Georgiou

A successful negotiation requires a range of capabilities, including comprehension of the conversation context, Theory-of-Mind (ToM) skills to infer the partner's motives, strategic reasoning, and effective communication, making it…

Computation and Language · Computer Science 2024-10-03 Deuksin Kwon , Emily Weiss , Tara Kulshrestha , Kushal Chawla , Gale M. Lucas , Jonathan Gratch

In the fast-evolving domain of artificial intelligence, large language models (LLMs) such as GPT-3 and GPT-4 are revolutionizing the landscapes of finance, healthcare, and law: domains characterized by their reliance on professional…

Computation and Language · Computer Science 2024-11-25 Zhiyu Zoey Chen , Jing Ma , Xinlu Zhang , Nan Hao , An Yan , Armineh Nourbakhsh , Xianjun Yang , Julian McAuley , Linda Petzold , William Yang Wang

This study evaluates the GPT-4 Large Language Model's abductive reasoning in complex fields like medical diagnostics, criminology, and cosmology. Using an interactive interview format, the AI assistant demonstrated reliability in generating…

Artificial Intelligence · Computer Science 2023-07-21 Remo Pareschi

Large language models (LLMs) such as GPT-4 have emerged as frontrunners, showcasing unparalleled prowess in diverse applications, including answering queries, code generation, and more. Parallelly, graph-structured data, an intrinsic data…

Artificial Intelligence · Computer Science 2023-11-14 Shirui Pan , Yizhen Zheng , Yixin Liu

In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The…

Computation and Language · Computer Science 2023-12-22 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Anurag Maravi , Marcin Abram

Empirical software engineering research on production systems has brought forth a better understanding of the software engineering process for practitioners and researchers alike. However, only a small subset of production systems is…

Software Engineering · Computer Science 2024-06-21 Jenny T. Liang , Carmen Badea , Christian Bird , Robert DeLine , Denae Ford , Nicole Forsgren , Thomas Zimmermann

The most recent large language models(LLMs) such as ChatGPT and GPT-4 have shown exceptional capabilities of generalist models, achieving state-of-the-art performance on a wide range of NLP tasks with little or no adaptation. How effective…

Computation and Language · Computer Science 2023-10-12 Xianzhi Li , Samuel Chan , Xiaodan Zhu , Yulong Pei , Zhiqiang Ma , Xiaomo Liu , Sameena Shah

ChatGPT has gained a huge popularity since its introduction. Its positive aspects have been reported through many media platforms, and some analyses even showed that ChatGPT achieved a decent grade in professional exams, adding extra…

Computation and Language · Computer Science 2023-11-15 Myeongjun Erik Jang , Thomas Lukasiewicz

As large language models (LLMs) become more advanced and impactful, it is increasingly important to scrutinize the data that they rely upon and produce. What is it to be a dataset practitioner doing this work? We approach this in two parts:…

Computation and Language · Computer Science 2024-04-03 Crystal Qian , Emily Reif , Minsuk Kahng

Large Language Models (LLMs) have emerged as influential instruments within the realm of natural language processing; nevertheless, their capacity to handle multi-party conversations (MPCs) -- a scenario marked by the presence of multiple…

Computation and Language · Computer Science 2023-10-26 Chao-Hong Tan , Jia-Chen Gu , Zhen-Hua Ling

Recently, there has been a growing trend of utilizing Large Language Model (LLM) to evaluate the quality of other LLMs. Many studies have fine-tuned judge models based on open-source LLMs for evaluation. While the fine-tuned judge models…

Computation and Language · Computer Science 2025-06-02 Hui Huang , Xingyuan Bu , Hongli Zhou , Yingqi Qu , Jing Liu , Muyun Yang , Bing Xu , Tiejun Zhao

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Computation and Language · Computer Science 2025-02-14 Lena Schmidt , Kaitlyn Hair , Sergio Graziosi , Fiona Campbell , Claudia Kapp , Alireza Khanteymoori , Dawn Craig , Mark Engelbert , James Thomas

It has been suggested that large language models such as GPT-4 have acquired some form of understanding beyond the correlations among the words in text including some understanding of mathematics as well. Here, we perform a critical inquiry…

Machine Learning · Computer Science 2023-11-15 Roozbeh Yousefzadeh , Xuenan Cao

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI's GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been…

Computation and Language · Computer Science 2024-09-11 Ridong Han , Chaohao Yang , Tao Peng , Prayag Tiwari , Xiang Wan , Lu Liu , Benyou Wang

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI's GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been…

Computation and Language · Computer Science 2024-09-12 Ridong Han , Chaohao Yang , Tao Peng , Prayag Tiwari , Xiang Wan , Lu Liu , Benyou Wang

Educational materials such as survey articles in specialized fields like computer science traditionally require tremendous expert inputs and are therefore expensive to create and update. Recently, Large Language Models (LLMs) have achieved…

Computation and Language · Computer Science 2024-05-24 Fan Gao , Hang Jiang , Rui Yang , Qingcheng Zeng , Jinghui Lu , Moritz Blum , Dairui Liu , Tianwei She , Yuang Jiang , Irene Li