English
Related papers

Related papers: Visual ChatGPT: Talking, Drawing and Editing with …

200 papers

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

Human-Computer Interaction · Computer Science 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

Recent advances in interactive large language models like ChatGPT have revolutionized various domains; however, their behavior in natural and role-play conversation settings remains underexplored. In our study, we address this gap by deeply…

Computation and Language · Computer Science 2024-03-28 Yufei Tao , Ameeta Agrawal , Judit Dombi , Tetyana Sydorenko , Jung In Lee

A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric. Despite the remarkable progress of generative AI, existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yu Xu , Yuxin Zhang , Juan Cao , Lin Gao , Chunyu Wang , Oliver Deussen , Tong-Yee Lee , Fan Tang

This survey provides an overview of the evolution of visually grounded models of spoken language over the last 20 years. Such models are inspired by the observation that when children pick up a language, they rely on a wide range of…

Artificial Intelligence · Computer Science 2022-02-22 Grzegorz Chrupała

Editing real facial images is a crucial task in computer vision with significant demand in various real-world applications. While GAN-based methods have showed potential in manipulating images especially when combined with CLIP, these…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Dongxu Yue , Qin Guo , Munan Ning , Jiaxi Cui , Yuesheng Zhu , Li Yuan

ChatGPT, as a language model based on large-scale pre-training, has exerted a profound influence on the domain of machine translation. In ChatGPT, a "Prompt" refers to a segment of text or instruction employed to steer the model towards…

Computation and Language · Computer Science 2024-06-05 Hui Jiao , Bei Peng , Lu Zong , Xiaojun Zhang , Xinwei Li

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

Human-Computer Interaction · Computer Science 2025-03-04 Si Thu , A. Baki Kocaballi

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

The well-known artificial intelligence-based chatbot ChatGPT-4 has become able to process image data as input in October 2023. We investigated its performance on the Test of Understanding Graphs in Kinematics to inform the physics education…

Physics Education · Physics 2025-02-10 Giulia Polverini , Bor Gregorcic

The recent evolution of generative artificial intelligence (GAI) leads to the emergence of groundbreaking applications such as ChatGPT, which not only enhances the efficiency of digital content production, such as text, audio, video, or…

Networking and Internet Architecture · Computer Science 2023-12-12 Nguyen Van Huynh , Jiacheng Wang , Hongyang Du , Dinh Thai Hoang , Dusit Niyato , Diep N. Nguyen , Dong In Kim , Khaled B. Letaief

In this work, we present VARGPT-v1.1, an advanced unified visual autoregressive model that builds upon our previous framework VARGPT. The model preserves the dual paradigm of next-token prediction for visual understanding and next-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Xianwei Zhuang , Yuxin Xie , Yufan Deng , Dongchao Yang , Liming Liang , Jinghan Ru , Yuguo Yin , Yuexian Zou

The advent of large language models, enabling flexibility through instruction-driven approaches, has revolutionized many traditional generative tasks, but large models for 3D data, particularly in comprehensively handling 3D shapes with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Fukun Yin , Xin Chen , Chi Zhang , Biao Jiang , Zibo Zhao , Jiayuan Fan , Gang Yu , Taihao Li , Tao Chen

In this work, we introduce Vision-Language Generative Pre-trained Transformer (VL-GPT), a transformer model proficient at concurrently perceiving and generating visual and linguistic data. VL-GPT achieves a unified pre-training approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jinguo Zhu , Xiaohan Ding , Yixiao Ge , Yuying Ge , Sijie Zhao , Hengshuang Zhao , Xiaohua Wang , Ying Shan

This paper delves into the realm of ChatGPT, an AI-powered chatbot that utilizes topic modeling and reinforcement learning to generate natural responses. Although ChatGPT holds immense promise across various industries, such as customer…

Cryptography and Security · Computer Science 2023-07-27 Xiaodong Wu , Ran Duan , Jianbing Ni

We introduce the task of Visual Dialog, which requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content. Specifically, given an image, a dialog history, and a question about the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Abhishek Das , Satwik Kottur , Khushi Gupta , Avi Singh , Deshraj Yadav , José M. F. Moura , Devi Parikh , Dhruv Batra

We introduce ChatGarment, a novel approach that leverages large vision-language models (VLMs) to automate the estimation, generation, and editing of 3D garments from images or text descriptions. Unlike previous methods that struggle in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Siyuan Bian , Chenghao Xu , Yuliang Xiu , Artur Grigorev , Zhen Liu , Cewu Lu , Michael J. Black , Yao Feng

Since its launch, ChatGPT has achieved remarkable success as a versatile conversational AI platform, drawing millions of users worldwide and garnering widespread recognition across academic, industrial, and general communities. This paper…

Human-Computer Interaction · Computer Science 2023-12-19 Yuyang Deng , Ni Zhao , Xin Huang

This paper explores interactive facial image editing via dialogue and introduces the ChatEdit benchmark dataset for evaluating image editing and conversation abilities in this context. ChatEdit is constructed from the CelebA-HQ dataset,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Xing Cui , Zekun Li , Peipei Li , Yibo Hu , Hailin Shi , Zhaofeng He

This exploratory study investigates the potential of the artificial intelligence tool, ChatGPT, to support systems thinking (ST) in various subjects. Using both general and subject specific prompts, the study assesses the accuracy,…

Human-Computer Interaction · Computer Science 2023-07-27 Holger Arndt

At present, executable visual workflows have emerged as a mainstream paradigm in real-world industrial deployments, offering strong reliability and controllability. However, in current practice, such workflows are almost entirely…

Computation and Language · Computer Science 2026-05-27 Yi Zhong , Buqiang Xu , Yijun Wang , Zifei Shan , Shuofei Qiao , Guozhou Zheng , Ningyu Zhang