English
Related papers

Related papers: DiffAgent: Fast and Accurate Text-to-Image API Sel…

200 papers

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

The proliferation of Large Language Models like ChatGPT has significantly advanced language understanding and generation, impacting a broad spectrum of applications. However, these models predominantly excel in text-based tasks, overlooking…

Computation and Language · Computer Science 2023-11-23 Xiao Liu , Jianfeng Lin , Jiawei Zhang

Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Sedat Porikli , Vedat Porikli

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

The rapid development of generative artificial intelligence (GenAI) presents new opportunities to advance the cartographic process. Previous studies have either overlooked the artistic aspects of maps or faced challenges in creating both…

Human-Computer Interaction · Computer Science 2025-05-16 Chenglong Wang , Yuhao Kang , Zhaoya Gong , Pengjun Zhao , Yu Feng , Wenjia Zhang , Ge Li

Advances in multimodal machine learning have made text-to-image (T2I) models increasingly accessible and popular. However, T2I models introduce risks such as the generation of non-consensual depictions of identifiable individuals, otherwise…

Computers and Society · Computer Science 2025-05-08 Will Hawkins , Chris Russell , Brent Mittelstadt

Natural Language to Visualization (NL2Vis) seeks to convert natural-language descriptions into visual representations of given tables, empowering users to derive insights from large-scale data. Recent advancements in Large Language Models…

Computation and Language · Computer Science 2025-02-10 Geliang Ouyang , Jingyao Chen , Zhihe Nie , Yi Gui , Yao Wan , Hongyu Zhang , Dongping Chen

Precision therapeutics require multimodal adaptive models that generate personalized treatment recommendations. We introduce TxAgent, an AI agent that leverages multi-step reasoning and real-time biomedical knowledge retrieval across a…

Artificial Intelligence · Computer Science 2025-03-17 Shanghua Gao , Richard Zhu , Zhenglun Kong , Ayush Noori , Xiaorui Su , Curtis Ginder , Theodoros Tsiligkaridis , Marinka Zitnik

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

Computation and Language · Computer Science 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

An unpaired image-to-image (I2I) translation technique seeks to find a mapping between two domains of data in a fully unsupervised manner. While initial solutions to the I2I problem were provided by generative adversarial neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Dmitrii Torbunov , Yi Huang , Huan-Hsin Tseng , Haiwang Yu , Jin Huang , Shinjae Yoo , Meifeng Lin , Brett Viren , Yihui Ren

Recent advances in Large Language Models (LLMs) have propelled intelligent agents from reactive responses to proactive support. While promising, existing proactive agents either rely exclusively on observations from enclosed environments…

Artificial Intelligence · Computer Science 2025-10-28 Bufang Yang , Lilin Xu , Liekang Zeng , Kaiwei Liu , Siyang Jiang , Wenrui Lu , Hongkai Chen , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

Text-to-image (T2I) diffusion models have achieved strong performance in semantic alignment, yet they still struggle with generating the correct number of objects specified in prompts. Existing approaches typically incorporate auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Nobline Yoo , Olga Russakovsky , Ye Zhu

Generative text-to-image (TTI) models produce high-quality images from short textual descriptions and are widely used in academic and creative domains. Like humans, TTI models have a worldview, a conception of the world learned from their…

Machine Learning · Computer Science 2024-02-06 Zoe De Simone , Angie Boggust , Arvind Satyanarayan , Ashia Wilson

Mobile Graphical User Interface (GUI) agents powered by multimodal large language models have demonstrated promising capabilities in automating complex smartphone tasks. However, existing approaches face two critical limitations: the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yiping Xie , Song Chen , Jingxuan Xing , Wei Jiang , Zekun Zhu , Yingyao Wang , Pi Bu , Jun Song , Yuning Jiang , Bo Zheng

This paper does not describe a new method; instead, it provides a thorough exploration of an important yet understudied design space related to recent advances in text-to-image synthesis -- specifically, the deep fusion of large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Bingda Tang , Boyang Zheng , Xichen Pan , Sayak Paul , Saining Xie

Text-to-image generation models have recently achieved astonishing results in image quality, flexibility, and text alignment, and are consequently employed in a fast-growing number of applications. Through improvements in multilingual…

Despite the significant advancements in text-to-image (T2I) generative models, users often face a trial-and-error challenge in practical scenarios. This challenge arises from the complexity and uncertainty of tedious steps such as crafting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Chengyou Jia , Changliang Xia , Zhuohang Dang , Weijia Wu , Hangwei Qian , Minnan Luo

Text-to-Image (T2I) diffusion models have shown impressive results in generating visually compelling images following user prompts. Building on this, various methods further fine-tune the pre-trained T2I model for specific tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Tsu-Jui Fu , Yusu Qian , Chen Chen , Wenze Hu , Zhe Gan , Yinfei Yang

In this paper, we introduce InfiAgent-DABench, the first benchmark specifically designed to evaluate LLM-based agents on data analysis tasks. These tasks require agents to end-to-end solving complex tasks by interacting with an execution…

Computation and Language · Computer Science 2024-03-12 Xueyu Hu , Ziyu Zhao , Shuang Wei , Ziwei Chai , Qianli Ma , Guoyin Wang , Xuwu Wang , Jing Su , Jingjing Xu , Ming Zhu , Yao Cheng , Jianbo Yuan , Jiwei Li , Kun Kuang , Yang Yang , Hongxia Yang , Fei Wu

The deployment and scaling of large language models (LLMs) have become critical as they permeate various applications, demanding high-throughput and low-latency serving systems. Existing frameworks struggle to balance these requirements,…