中文
相关论文

相关论文: Visual ChatGPT: Talking, Drawing and Editing with …

200 篇论文

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

人机交互 · 计算机科学 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

Recent advances in interactive large language models like ChatGPT have revolutionized various domains; however, their behavior in natural and role-play conversation settings remains underexplored. In our study, we address this gap by deeply…

计算与语言 · 计算机科学 2024-03-28 Yufei Tao , Ameeta Agrawal , Judit Dombi , Tetyana Sydorenko , Jung In Lee

A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric. Despite the remarkable progress of generative AI, existing models…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Yu Xu , Yuxin Zhang , Juan Cao , Lin Gao , Chunyu Wang , Oliver Deussen , Tong-Yee Lee , Fan Tang

This survey provides an overview of the evolution of visually grounded models of spoken language over the last 20 years. Such models are inspired by the observation that when children pick up a language, they rely on a wide range of…

人工智能 · 计算机科学 2022-02-22 Grzegorz Chrupała

Editing real facial images is a crucial task in computer vision with significant demand in various real-world applications. While GAN-based methods have showed potential in manipulating images especially when combined with CLIP, these…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Dongxu Yue , Qin Guo , Munan Ning , Jiaxi Cui , Yuesheng Zhu , Li Yuan

ChatGPT, as a language model based on large-scale pre-training, has exerted a profound influence on the domain of machine translation. In ChatGPT, a "Prompt" refers to a segment of text or instruction employed to steer the model towards…

计算与语言 · 计算机科学 2024-06-05 Hui Jiao , Bei Peng , Lu Zong , Xiaojun Zhang , Xinwei Li

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

人机交互 · 计算机科学 2025-03-04 Si Thu , A. Baki Kocaballi

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

软件工程 · 计算机科学 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

The well-known artificial intelligence-based chatbot ChatGPT-4 has become able to process image data as input in October 2023. We investigated its performance on the Test of Understanding Graphs in Kinematics to inform the physics education…

物理教育 · 物理学 2025-02-10 Giulia Polverini , Bor Gregorcic

The recent evolution of generative artificial intelligence (GAI) leads to the emergence of groundbreaking applications such as ChatGPT, which not only enhances the efficiency of digital content production, such as text, audio, video, or…

网络与互联网体系结构 · 计算机科学 2023-12-12 Nguyen Van Huynh , Jiacheng Wang , Hongyang Du , Dinh Thai Hoang , Dusit Niyato , Diep N. Nguyen , Dong In Kim , Khaled B. Letaief

In this work, we present VARGPT-v1.1, an advanced unified visual autoregressive model that builds upon our previous framework VARGPT. The model preserves the dual paradigm of next-token prediction for visual understanding and next-scale…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Xianwei Zhuang , Yuxin Xie , Yufan Deng , Dongchao Yang , Liming Liang , Jinghan Ru , Yuguo Yin , Yuexian Zou

The advent of large language models, enabling flexibility through instruction-driven approaches, has revolutionized many traditional generative tasks, but large models for 3D data, particularly in comprehensively handling 3D shapes with…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Fukun Yin , Xin Chen , Chi Zhang , Biao Jiang , Zibo Zhao , Jiayuan Fan , Gang Yu , Taihao Li , Tao Chen

In this work, we introduce Vision-Language Generative Pre-trained Transformer (VL-GPT), a transformer model proficient at concurrently perceiving and generating visual and linguistic data. VL-GPT achieves a unified pre-training approach for…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Jinguo Zhu , Xiaohan Ding , Yixiao Ge , Yuying Ge , Sijie Zhao , Hengshuang Zhao , Xiaohua Wang , Ying Shan

This paper delves into the realm of ChatGPT, an AI-powered chatbot that utilizes topic modeling and reinforcement learning to generate natural responses. Although ChatGPT holds immense promise across various industries, such as customer…

密码学与安全 · 计算机科学 2023-07-27 Xiaodong Wu , Ran Duan , Jianbing Ni

We introduce the task of Visual Dialog, which requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content. Specifically, given an image, a dialog history, and a question about the…

计算机视觉与模式识别 · 计算机科学 2017-08-03 Abhishek Das , Satwik Kottur , Khushi Gupta , Avi Singh , Deshraj Yadav , José M. F. Moura , Devi Parikh , Dhruv Batra

We introduce ChatGarment, a novel approach that leverages large vision-language models (VLMs) to automate the estimation, generation, and editing of 3D garments from images or text descriptions. Unlike previous methods that struggle in…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Siyuan Bian , Chenghao Xu , Yuliang Xiu , Artur Grigorev , Zhen Liu , Cewu Lu , Michael J. Black , Yao Feng

Since its launch, ChatGPT has achieved remarkable success as a versatile conversational AI platform, drawing millions of users worldwide and garnering widespread recognition across academic, industrial, and general communities. This paper…

人机交互 · 计算机科学 2023-12-19 Yuyang Deng , Ni Zhao , Xin Huang

This paper explores interactive facial image editing via dialogue and introduces the ChatEdit benchmark dataset for evaluating image editing and conversation abilities in this context. ChatEdit is constructed from the CelebA-HQ dataset,…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Xing Cui , Zekun Li , Peipei Li , Yibo Hu , Hailin Shi , Zhaofeng He

This exploratory study investigates the potential of the artificial intelligence tool, ChatGPT, to support systems thinking (ST) in various subjects. Using both general and subject specific prompts, the study assesses the accuracy,…

人机交互 · 计算机科学 2023-07-27 Holger Arndt

At present, executable visual workflows have emerged as a mainstream paradigm in real-world industrial deployments, offering strong reliability and controllability. However, in current practice, such workflows are almost entirely…

计算与语言 · 计算机科学 2026-05-27 Yi Zhong , Buqiang Xu , Yijun Wang , Zifei Shan , Shuofei Qiao , Guozhou Zheng , Ningyu Zhang