English
Related papers

Related papers: A Multitask, Multilingual, Multimodal Evaluation o…

200 papers

Understanding how users authentically interact with Large Language Models (LLMs) remains a significant challenge in human-computer interaction research. Most existing studies rely on self-reported usage patterns or controlled experimental…

Computers and Society · Computer Science 2025-09-18 Kalyani Khona

Large Language Models (LLMs) have attained the impressive capability to resolve a wide range of NLP tasks by fine-tuning high-quality instruction data. However, collecting human-written data of high quality, especially multi-turn dialogues,…

Computation and Language · Computer Science 2023-10-20 Dongjie Yang , Ruifeng Yuan , Yuantao Fan , Yifei Yang , Zili Wang , Shusen Wang , Hai Zhao

ChatGPT has changed the AI community and an active research line is the performance evaluation of ChatGPT. A key challenge for the evaluation is that ChatGPT is still closed-source and traditional benchmark datasets may have been used by…

Computation and Language · Computer Science 2024-05-13 Ming Liu , Ran Liu , Ye Zhu , Hua Wang , Youyang Qu , Rongsheng Li , Yongpan Sheng , Wray Buntine

This study investigates the potential of a multimodal large language model (LLM), specifically ChatGPT-4o, to perform human-like interpretations of traffic scenes using static dashcam images. Herein, we focus on three judgment tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yuki Yoshihara , Linjing Jiang , Nihan Karatas , Hitoshi Kanamori , Asuka Harada , Takahiro Tanaka

Large Language Models (LLMs) offer numerous applications, the full extent of which is not yet understood. This paper investigates if LLMs can be applied for editing structured and semi-structured documents with minimal effort. Using a…

Machine Learning · Computer Science 2024-09-16 Irene Weber

Evaluating the quality of academic journal articles is a time consuming but critical task for national research evaluation exercises, appointments and promotion. It is therefore important to investigate whether Large Language Models (LLMs)…

Digital Libraries · Computer Science 2024-12-02 Mike Thelwall

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Large language models (LLMs), such as ChatGPT, are able to generate human-like, fluent responses for many downstream tasks, e.g., task-oriented dialog and question answering. However, applying LLMs to real-world, mission-critical…

Computation and Language · Computer Science 2023-03-10 Baolin Peng , Michel Galley , Pengcheng He , Hao Cheng , Yujia Xie , Yu Hu , Qiuyuan Huang , Lars Liden , Zhou Yu , Weizhu Chen , Jianfeng Gao

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

Software Engineering · Computer Science 2024-11-20 Nathalia Nascimento , Everton Guimaraes , Sai Sanjna Chintakunta , Santhosh Anitha Boominathan

This paper explores the use of Large Language Models (LLMs) and in particular ChatGPT in programming, source code analysis, and code generation. LLMs and ChatGPT are built using machine learning and artificial intelligence techniques, and…

Software Engineering · Computer Science 2023-06-12 Ahmed R. Sadik , Antonello Ceravola , Frank Joublin , Jibesh Patra

Conversation agents fueled by Large Language Models (LLMs) are providing a new way to interact with visual data. While there have been initial attempts for image-based conversation models, this work addresses the under-explored field of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan

Large language models (LLMs), such as ChatGPT, have shown remarkable abilities in natural language processing, opening new avenues in psychological research. This study explores whether LLMs can predict human memory performance in tasks…

Computation and Language · Computer Science 2025-11-25 Markus Huff , Elanur Ulakçı

ChatGPT has been used in several educational contexts,including learning, teaching and research. It also has potential to conduct the systematic literature review (SLR). However, there are limited empirical studies on how to use ChatGPT in…

Artificial Intelligence · Computer Science 2024-09-27 Qian Huang , Qiyun Wang

This paper presents an experimental study regarding the use of OpenAI's ChatGPT for robotics applications. We outline a strategy that combines design principles for prompt engineering and the creation of a high-level function library which…

Artificial Intelligence · Computer Science 2023-07-21 Sai Vemprala , Rogerio Bonatti , Arthur Bucker , Ashish Kapoor

Artificial intelligence is gaining traction in more ways than ever before. The popularity of language models and AI-based businesses has soared since ChatGPT was made available to the general public via OpenAI. It is becoming increasingly…

Computers and Society · Computer Science 2023-07-31 Prabin Sharma , Kisan Thapa , Dikshya Thapa , Prastab Dhakal , Mala Deep Upadhaya , Santosh Adhikari , Salik Ram Khanal

Recent developments in natural language processing have demonstrated the potential of large language models (LLMs) to improve a range of educational and learning outcomes. Of recent chatbots based on LLMs, ChatGPT and Bard have made it…

This paper takes an exploratory approach to examine the use of ChatGPT for pattern mining. It proposes an eight-step collaborative process that combines human insight with AI capabilities to extract patterns from known uses. The paper…

Artificial Intelligence · Computer Science 2024-12-24 Michael Weiss

The way users acquire information is undergoing a paradigm shift with the advent of ChatGPT. Unlike conventional search engines, ChatGPT retrieves knowledge from the model itself and generates answers for users. ChatGPT's impressive…

Cryptography and Security · Computer Science 2023-10-06 Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

With the increase in software vulnerabilities that cause significant economic and social losses, automatic vulnerability detection has become essential in software development and maintenance. Recently, large language models (LLMs) like GPT…

Software Engineering · Computer Science 2024-04-15 Chenyuan Zhang , Hao Liu , Jiutian Zeng , Kejing Yang , Yuhong Li , Hui Li

Large Language Models (LLMs), like ChatGPT, have demonstrated vast potential but also introduce challenges related to content constraints and potential misuse. Our study investigates three key research questions: (1) the number of different…

Software Engineering · Computer Science 2024-03-12 Yi Liu , Gelei Deng , Zhengzi Xu , Yuekang Li , Yaowen Zheng , Ying Zhang , Lida Zhao , Tianwei Zhang , Kailong Wang , Yang Liu
‹ Prev 1 8 9 10 Next ›