中文
相关论文

相关论文: Large-scale Text-to-Image Generation Models for Vi…

200 篇论文

Text-to-image generation (TTIG) models, a recent addition to creative AI, can generate images based on a text description. These models have begun to rival the work of professional creatives, and sparked discussions on the future of…

人机交互 · 计算机科学 2023-09-06 Veera Vimpari , Annakaisa Kultima , Perttu Hämäläinen , Christian Guckelsberger

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or…

计算与语言 · 计算机科学 2024-08-23 Xun Liang , Hanyu Wang , Yezhaohui Wang , Shichao Song , Jiawei Yang , Simin Niu , Jie Hu , Dan Liu , Shunyu Yao , Feiyu Xiong , Zhiyu Li

Large Language Models (LLMs) have been successfully used in many natural-language tasks and applications including text generation and AI chatbots. They also are a promising new technology for concept-oriented deep learning (CODL). However,…

机器学习 · 计算机科学 2023-09-21 Daniel T. Chang

Recent advancements in generation models have showcased remarkable capabilities in generating fantastic content. However, most of them are trained on proprietary high-quality data, and some models withhold their parameters and only provide…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Rui Zhao , Hangjie Yuan , Yujie Wei , Shiwei Zhang , Yuchao Gu , Lingmin Ran , Xiang Wang , Zhangjie Wu , Junhao Zhang , Yingya Zhang , Mike Zheng Shou

Under pure textual modality, Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning tasks by decomposing them into simpler sub-problems. However, Multimodal Large Language Models (MLLMs) still struggle with…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Jingming Liu , Yumeng Li , Boyuan Xiao , Yichang Jian , Ziang Qin , Tianjia Shao , Yao-Xiang Ding , Kun Zhou

We review research on generating visual data from text from the angle of "cross-modal generation." This point of view allows us to draw parallels between various methods geared towards working on input text and producing visual output,…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Maciej Żelaszczyk , Jacek Mańdziuk

Image-text matching (ITM) aims to address the fundamental challenge of aligning visual and textual modalities, which inherently differ in their representations, continuous, high-dimensional image features vs. discrete, structured text. We…

多媒体 · 计算机科学 2025-07-14 Junyu Chen , Yihua Gao , Mingyong Li

Large Language Models (LLMs) have demonstrated their remarkable capabilities in numerous fields. This survey focuses on how LLMs empower users, regardless of their technical background, to use human languages to automatically generate…

软件工程 · 计算机科学 2025-04-03 Nam Huynh , Beiyu Lin

Visual communication, dating back to prehistoric cave paintings, is the use of visual elements to convey ideas and information. In today's visually saturated world, effective design demands an understanding of graphic design principles,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Yael Vinker

Inverse graphics -- the task of inverting an image into physical variables that, when rendered, enable reproduction of the observed scene -- is a fundamental challenge in computer vision and graphics. Successfully disentangling an image…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Peter Kulits , Haiwen Feng , Weiyang Liu , Victoria Abrevaya , Michael J. Black

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

计算与语言 · 计算机科学 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Autonomous agents operating on the graphical user interfaces (GUIs) of various applications hold immense practical value. Unlike the large language model (LLM)-based methods which rely on structured texts and customized backends, the…

人工智能 · 计算机科学 2024-11-05 Xuetian Chen , Hangcheng Li , Jiaqing Liang , Sihang Jiang , Deqing Yang

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

计算机与社会 · 计算机科学 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

The field of multimodal research focusing on the comprehension and creation of both images and text has witnessed significant strides. This progress is exemplified by the emergence of sophisticated models dedicated to image captioning at…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Hang Li , Jindong Gu , Rajat Koner , Sahand Sharifzadeh , Volker Tresp

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

人工智能 · 计算机科学 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by…

人机交互 · 计算机科学 2026-02-02 Bartosz Sawicki , Tomasz Les , Dariusz Parzych , Aleksandra Wycisk-Ficek , Pawel Trebacz , Pawel Zawadzki

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image…

人机交互 · 计算机科学 2022-11-01 Jonas Oppenlaender

With the rapid development of diffusion models, text-to-image(T2I) models have made significant progress, showcasing impressive abilities in prompt following and image generation. Recently launched models such as FLUX.1 and Ideogram2.0,…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Jiayi Lei , Renrui Zhang , Xiangfei Hu , Weifeng Lin , Zhen Li , Wenjian Sun , Ruoyi Du , Le Zhuo , Zhongyu Li , Xinyue Li , Shitian Zhao , Ziyu Guo , Yiting Lu , Peng Gao , Hongsheng Li