中文
相关论文

相关论文: DiffAgent: Fast and Accurate Text-to-Image API Sel…

200 篇论文

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

The proliferation of Large Language Models like ChatGPT has significantly advanced language understanding and generation, impacting a broad spectrum of applications. However, these models predominantly excel in text-based tasks, overlooking…

计算与语言 · 计算机科学 2023-11-23 Xiao Liu , Jianfeng Lin , Jiawei Zhang

Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Sedat Porikli , Vedat Porikli

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

The rapid development of generative artificial intelligence (GenAI) presents new opportunities to advance the cartographic process. Previous studies have either overlooked the artistic aspects of maps or faced challenges in creating both…

人机交互 · 计算机科学 2025-05-16 Chenglong Wang , Yuhao Kang , Zhaoya Gong , Pengjun Zhao , Yu Feng , Wenjia Zhang , Ge Li

Advances in multimodal machine learning have made text-to-image (T2I) models increasingly accessible and popular. However, T2I models introduce risks such as the generation of non-consensual depictions of identifiable individuals, otherwise…

计算机与社会 · 计算机科学 2025-05-08 Will Hawkins , Chris Russell , Brent Mittelstadt

Natural Language to Visualization (NL2Vis) seeks to convert natural-language descriptions into visual representations of given tables, empowering users to derive insights from large-scale data. Recent advancements in Large Language Models…

计算与语言 · 计算机科学 2025-02-10 Geliang Ouyang , Jingyao Chen , Zhihe Nie , Yi Gui , Yao Wan , Hongyu Zhang , Dongping Chen

Precision therapeutics require multimodal adaptive models that generate personalized treatment recommendations. We introduce TxAgent, an AI agent that leverages multi-step reasoning and real-time biomedical knowledge retrieval across a…

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

计算与语言 · 计算机科学 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

An unpaired image-to-image (I2I) translation technique seeks to find a mapping between two domains of data in a fully unsupervised manner. While initial solutions to the I2I problem were provided by generative adversarial neural networks…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Dmitrii Torbunov , Yi Huang , Huan-Hsin Tseng , Haiwang Yu , Jin Huang , Shinjae Yoo , Meifeng Lin , Brett Viren , Yihui Ren

Recent advances in Large Language Models (LLMs) have propelled intelligent agents from reactive responses to proactive support. While promising, existing proactive agents either rely exclusively on observations from enclosed environments…

Text-to-image (T2I) diffusion models have achieved strong performance in semantic alignment, yet they still struggle with generating the correct number of objects specified in prompts. Existing approaches typically incorporate auxiliary…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Nobline Yoo , Olga Russakovsky , Ye Zhu

Generative text-to-image (TTI) models produce high-quality images from short textual descriptions and are widely used in academic and creative domains. Like humans, TTI models have a worldview, a conception of the world learned from their…

机器学习 · 计算机科学 2024-02-06 Zoe De Simone , Angie Boggust , Arvind Satyanarayan , Ashia Wilson

Mobile Graphical User Interface (GUI) agents powered by multimodal large language models have demonstrated promising capabilities in automating complex smartphone tasks. However, existing approaches face two critical limitations: the…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Yiping Xie , Song Chen , Jingxuan Xing , Wei Jiang , Zekun Zhu , Yingyao Wang , Pi Bu , Jun Song , Yuning Jiang , Bo Zheng

This paper does not describe a new method; instead, it provides a thorough exploration of an important yet understudied design space related to recent advances in text-to-image synthesis -- specifically, the deep fusion of large language…

计算机视觉与模式识别 · 计算机科学 2025-05-16 Bingda Tang , Boyang Zheng , Xichen Pan , Sayak Paul , Saining Xie

Text-to-image generation models have recently achieved astonishing results in image quality, flexibility, and text alignment, and are consequently employed in a fast-growing number of applications. Through improvements in multilingual…

Despite the significant advancements in text-to-image (T2I) generative models, users often face a trial-and-error challenge in practical scenarios. This challenge arises from the complexity and uncertainty of tedious steps such as crafting…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Chengyou Jia , Changliang Xia , Zhuohang Dang , Weijia Wu , Hangwei Qian , Minnan Luo

Text-to-Image (T2I) diffusion models have shown impressive results in generating visually compelling images following user prompts. Building on this, various methods further fine-tune the pre-trained T2I model for specific tasks. However,…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Tsu-Jui Fu , Yusu Qian , Chen Chen , Wenze Hu , Zhe Gan , Yinfei Yang

In this paper, we introduce InfiAgent-DABench, the first benchmark specifically designed to evaluate LLM-based agents on data analysis tasks. These tasks require agents to end-to-end solving complex tasks by interacting with an execution…

The deployment and scaling of large language models (LLMs) have become critical as they permeate various applications, demanding high-throughput and low-latency serving systems. Existing frameworks struggle to balance these requirements,…