English
Related papers

Related papers: Large-scale Text-to-Image Generation Models for Vi…

200 papers

Text-to-image generation (TTIG) models, a recent addition to creative AI, can generate images based on a text description. These models have begun to rival the work of professional creatives, and sparked discussions on the future of…

Human-Computer Interaction · Computer Science 2023-09-06 Veera Vimpari , Annakaisa Kultima , Perttu Hämäläinen , Christian Guckelsberger

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or…

Computation and Language · Computer Science 2024-08-23 Xun Liang , Hanyu Wang , Yezhaohui Wang , Shichao Song , Jiawei Yang , Simin Niu , Jie Hu , Dan Liu , Shunyu Yao , Feiyu Xiong , Zhiyu Li

Large Language Models (LLMs) have been successfully used in many natural-language tasks and applications including text generation and AI chatbots. They also are a promising new technology for concept-oriented deep learning (CODL). However,…

Machine Learning · Computer Science 2023-09-21 Daniel T. Chang

Recent advancements in generation models have showcased remarkable capabilities in generating fantastic content. However, most of them are trained on proprietary high-quality data, and some models withhold their parameters and only provide…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Rui Zhao , Hangjie Yuan , Yujie Wei , Shiwei Zhang , Yuchao Gu , Lingmin Ran , Xiang Wang , Zhangjie Wu , Junhao Zhang , Yingya Zhang , Mike Zheng Shou

Under pure textual modality, Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning tasks by decomposing them into simpler sub-problems. However, Multimodal Large Language Models (MLLMs) still struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingming Liu , Yumeng Li , Boyuan Xiao , Yichang Jian , Ziang Qin , Tianjia Shao , Yao-Xiang Ding , Kun Zhou

We review research on generating visual data from text from the angle of "cross-modal generation." This point of view allows us to draw parallels between various methods geared towards working on input text and producing visual output,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Maciej Żelaszczyk , Jacek Mańdziuk

Image-text matching (ITM) aims to address the fundamental challenge of aligning visual and textual modalities, which inherently differ in their representations, continuous, high-dimensional image features vs. discrete, structured text. We…

Multimedia · Computer Science 2025-07-14 Junyu Chen , Yihua Gao , Mingyong Li

Large Language Models (LLMs) have demonstrated their remarkable capabilities in numerous fields. This survey focuses on how LLMs empower users, regardless of their technical background, to use human languages to automatically generate…

Software Engineering · Computer Science 2025-04-03 Nam Huynh , Beiyu Lin

Visual communication, dating back to prehistoric cave paintings, is the use of visual elements to convey ideas and information. In today's visually saturated world, effective design demands an understanding of graphic design principles,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yael Vinker

Inverse graphics -- the task of inverting an image into physical variables that, when rendered, enable reproduction of the observed scene -- is a fundamental challenge in computer vision and graphics. Successfully disentangling an image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Peter Kulits , Haiwen Feng , Weiyang Liu , Victoria Abrevaya , Michael J. Black

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Autonomous agents operating on the graphical user interfaces (GUIs) of various applications hold immense practical value. Unlike the large language model (LLM)-based methods which rely on structured texts and customized backends, the…

Artificial Intelligence · Computer Science 2024-11-05 Xuetian Chen , Hangcheng Li , Jiaqing Liang , Sihang Jiang , Deqing Yang

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

The field of multimodal research focusing on the comprehension and creation of both images and text has witnessed significant strides. This progress is exemplified by the emergence of sophisticated models dedicated to image captioning at…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Hang Li , Jindong Gu , Rajat Koner , Sahand Sharifzadeh , Volker Tresp

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by…

Human-Computer Interaction · Computer Science 2026-02-02 Bartosz Sawicki , Tomasz Les , Dariusz Parzych , Aleksandra Wycisk-Ficek , Pawel Trebacz , Pawel Zawadzki

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image…

Human-Computer Interaction · Computer Science 2022-11-01 Jonas Oppenlaender

With the rapid development of diffusion models, text-to-image(T2I) models have made significant progress, showcasing impressive abilities in prompt following and image generation. Recently launched models such as FLUX.1 and Ideogram2.0,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jiayi Lei , Renrui Zhang , Xiangfei Hu , Weifeng Lin , Zhen Li , Wenjian Sun , Ruoyi Du , Le Zhuo , Zhongyu Li , Xinyue Li , Shitian Zhao , Ziyu Guo , Yiting Lu , Peng Gao , Hongsheng Li