English
Related papers

Related papers: Text2VP: Generative AI for Visual Programming and …

200 papers

In this paper, we design and train a Generative Image-to-text Transformer, GIT, to unify vision-language tasks such as image/video captioning and question answering. While generative models provide a consistent network architecture between…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jianfeng Wang , Zhengyuan Yang , Xiaowei Hu , Linjie Li , Kevin Lin , Zhe Gan , Zicheng Liu , Ce Liu , Lijuan Wang

Human values and their measurement are long-standing interdisciplinary inquiry. Recent advances in AI have sparked renewed interest in this area, with large language models (LLMs) emerging as both tools and subjects of value measurement.…

Computation and Language · Computer Science 2025-03-07 Haoran Ye , Yuhang Xie , Yuanyi Ren , Hanjun Fang , Xin Zhang , Guojie Song

In this work, we introduce Vision-Language Generative Pre-trained Transformer (VL-GPT), a transformer model proficient at concurrently perceiving and generating visual and linguistic data. VL-GPT achieves a unified pre-training approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jinguo Zhu , Xiaohan Ding , Yixiao Ge , Yuying Ge , Sijie Zhao , Hengshuang Zhao , Xiaohua Wang , Ying Shan

Recent advances in generative artificial intelligence (AI) technologies have been significantly driven by models such as generative adversarial networks (GANs), variational autoencoders (VAEs), and denoising diffusion probabilistic models…

Machine Learning · Computer Science 2024-10-24 Chengyuan Li , Tianyu Zhang , Xusheng Du , Ye Zhang , Haoran Xie

Visual prompting (VP) is an emerging parameter-efficient fine-tuning approach to adapting pre-trained vision models to solve various downstream image-classification tasks. However, there has hitherto been little systematic study of the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Hsi-Ai Tsao , Lei Hsiung , Pin-Yu Chen , Sijia Liu , Tsung-Yi Ho

Generative AI, specifically text-to-image models, have revolutionized interior architectural design by enabling the rapid translation of conceptual ideas into visual representations from simple text prompts. While generative AI can produce…

Human-Computer Interaction · Computer Science 2025-06-19 Richa Gupta , Alexander Htet Kyaw

Generative Artificial Intelligence (GenAI) has emerged as a fundamental component of intelligent interactive systems, enabling the automatic generation of multimodal media content. The continuous enhancement in the quality of Artificial…

Human-Computer Interaction · Computer Science 2024-07-23 Yongquan Hu , Dawen Zhang , Mingyue Yuan , Kaiqi Xian , Don Samitha Elvitigala , June Kim , Gelareh Mohammadi , Zhenchang Xing , Xiwei Xu , Aaron Quigley

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

ChatGPT is attracting a cross-field interest as it provides a language interface with remarkable conversational competency and reasoning capabilities across many domains. However, since ChatGPT is trained with languages, it is currently not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Chenfei Wu , Shengming Yin , Weizhen Qi , Xiaodong Wang , Zecheng Tang , Nan Duan

Advances in Generative AI tools have allowed designers to manipulate existing 3D models using text or image-based prompts, enabling creators to explore different design goals. Photochromic color-changing systems, on the other hand, allow…

Human-Computer Interaction · Computer Science 2024-04-29 Yunyi Zhu , Faraz Faruqi , Stefanie Mueller

This review surveys the state-of-the-art in text-to-image and image-to-image generation within the scope of generative AI. We provide a comparative analysis of three prominent architectures: Variational Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zineb Sordo , Eric Chagnon , Daniela Ushizima

New systems employ Machine Learning to sift through large knowledge sources, creating flexible Large Language Models. These models discern context and predict sequential information in various communication forms. Generative AI, leveraging…

Artificial Intelligence · Computer Science 2023-07-19 Ted Selker

Generative Artificial Intelligence (AI) models such as OpenAI's ChatGPT have the potential to revolutionize Statistical Process Control (SPC) practice, learning, and research. However, these tools are in the early stages of development and…

Machine Learning · Computer Science 2023-06-19 Fadel M. Megahed , Ying-Ju Chen , Joshua A. Ferris , Sven Knoth , L. Allison Jones-Farmer

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

This study explores the potential of generative artificial intelligence (AI) models, specifically OpenAI's generative pre-trained transformer (GPT) series, when integrated with building information modeling (BIM) tools as an interactive…

Artificial Intelligence · Computer Science 2024-10-21 Suhyung Jang , Ghang Lee

Recent advances in generative diffusion models have enabled text-controlled synthesis of realistic and diverse images with impressive quality. Despite these remarkable advances, the application of text-to-image generative models in computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yulu Gan , Sungwoo Park , Alexander Schubert , Anthony Philippakis , Ahmed M. Alaa

Advances in 3D generative AI have enabled the creation of physical objects from text prompts, but challenges remain in creating objects involving multiple component types. We present a pipeline that integrates 3D generative AI with…

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

As ChatGPT goes viral, generative AI (AIGC, a.k.a AI-generated content) has made headlines everywhere because of its ability to analyze and create text, images, and beyond. With such overwhelming media coverage, it is almost impossible for…

Generative Artificial Intelligence (AI) has rapidly advanced the field of computer vision by enabling machines to create and interpret visual data with unprecedented sophistication. This transformation builds upon a foundation of generative…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daochang Liu , Junyu Zhang , Anh-Dung Dinh , Eunbyung Park , Shichao Zhang , Ajmal Mian , Mubarak Shah , Chang Xu