English
Related papers

Related papers: Towards Reliable Agentic Progressive Text-to-Visua…

200 papers

The visual analytics community has long aimed to understand users better and assist them in their analytic endeavors. As a result, numerous conceptual models of visual analytics aim to formalize common workflows, techniques, and goals…

Human-Computer Interaction · Computer Science 2023-04-20 Shayan Monadjemi , Mengtian Guo , David Gotz , Roman Garnett , Alvitta Ottley

We introduce V-Agent, a novel multi-agent platform designed for advanced video search and interactive user-system conversations. By fine-tuning a vision-language model (VLM) with a small video preference dataset and enhancing it with a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 SunYoung Park , Jong-Hyeon Lee , Youngjune Kim , Daegyu Sung , Younghyun Yu , Young-rok Cha , Jeongho Ju

Interactive large language model (LLM) agents operating via multi-turn dialogue and multi-step tool calling are increasingly used in production. Benchmarks for these agents must both reliably compare models and yield on-policy training…

Recent agentic systems demonstrate that large language models can generate scientific visualizations from natural language. However, reliability remains a major limitation: systems may execute invalid operations, introduce subtle but…

Human-Computer Interaction · Computer Science 2026-03-27 Nathaniel Gorski , Shusen Liu , Bei Wang

A key challenge in training Vision-Language Model (VLM) agents, compared to Language Model (LLM) agents, lies in the shift from textual states to complex visual observations. This transition introduces partial observability and demands…

Recent advances in multi-modal large language models (MLLMs) have enabled increasingly sophisticated autonomous visualization agents capable of translating user intentions into data visualizations. However, measuring progress and comparing…

Human-Computer Interaction · Computer Science 2025-09-19 Kuangshi Ai , Haichao Miao , Zhimin Li , Chaoli Wang , Shusen Liu

Text-to-video (T2V) generation has rapidly progressed in visual fidelity, yet its ability to faithfully represent multiple cultures within a single prompt remains underexplored. We introduce MAVEN, a multi-agent prompt refinement framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Shuowei Li , Yuming Zhao , Parth Bhalerao , Oana Ignat

We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances beyond these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jingwei Shi , Zeyu Zhang , Biao Wu , Yanjie Liang , Meng Fang , Ling Chen , Yang Zhao

Reinforcement learning with verifiable rewards (RLVR) is pivotal for the continuous evolution of GUI agents, yet existing evaluation paradigms face significant limitations. Rule-based methods suffer from poor scalability and cannot handle…

Robotics · Computer Science 2026-02-03 Chaoqun Cui , Jing Huang , Shijing Wang , Liming Zheng , Qingchao Kong , Zhixiong Zeng

Text-to-image generation tasks have driven remarkable advances in diverse media applications, yet most focus on single-turn scenarios and struggle with iterative, multi-turn creative tasks. Recent dialogue-based systems attempt to bridge…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Shichao Ma , Yunhe Guo , Jiahao Su , Qihe Huang , Zhengyang Zhou , Yang Wang

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

User interface (UI) development requires translating design mockups into functional code, a process that remains repetitive and labor-intensive. While recent Vision-Language Models (VLMs) automate UI-to-Code generation, they generate only…

Software Engineering · Computer Science 2025-11-11 Mingde Xu , Zhen Yang , Wenyi Hong , Lihang Pan , Xinyue Fan , Yan Wang , Xiaotao Gu , Bin Xu , Jie Tang

Visual Language Models (VLMs) achieve promising results in medical reasoning but struggle with hallucinations, vague descriptions, inconsistent logic and poor localization. To address this, we propose a agent framework named Medical Visual…

Artificial Intelligence · Computer Science 2025-10-22 Guangfu Guo , Xiaoqian Lu , Yue Feng

Multi-turn Text-to-SQL aims to translate a user's conversational utterances into executable SQL while preserving dialogue coherence and grounding to the target schema. However, most existing systems only regard this task as a simple text…

Computation and Language · Computer Science 2026-04-21 Taicheng Guo , Hai Wang , ChaoChun Liu , Mohsen Golalikhani , Xin Chen , Xiangliang Zhang , Chandan K. Reddy

Explainable Reinforcement Learning (XRL) has emerged as a promising approach in improving the transparency of Reinforcement Learning (RL) agents. However, there remains a gap between complex RL policies and domain experts, due to the…

Artificial Intelligence · Computer Science 2025-09-09 Haechang Kim , Hao Chen , Can Li , Jong Min Lee

Generative models have substantially expanded video generation capabilities, yet practical thought-to-video creation remains a multi-stage, multi-modal, and decision-intensive process. However, existing tools either hide intermediate…

Multimedia · Computer Science 2026-02-10 Zhuoyun Zheng , Yu Dong , Gaorong Liang , Guan Li , Guihua Shan , Shiyu Cheng , Dong Tian , Jianlong Zhou , Jie Liang

Learning to navigate in a visual environment following natural-language instructions is a challenging task, because the multimodal inputs to the agent are highly variable, and the training data on a new task is often limited. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Weituo Hao , Chunyuan Li , Xiujun Li , Lawrence Carin , Jianfeng Gao

Offering diverse perspectives on a museum artifact can deepen visitors' understanding and help avoid the cognitive limitations of a single narrative, ultimately enhancing their overall experience. Physical museums promote diversity through…

Human-Computer Interaction · Computer Science 2025-08-12 Mingyang Su , Chao Liu , Jingling Zhang , WU Shuang , Mingming Fan

A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric. Despite the remarkable progress of generative AI, existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yu Xu , Yuxin Zhang , Juan Cao , Lin Gao , Chunyu Wang , Oliver Deussen , Tong-Yee Lee , Fan Tang

Recent advancements in the field of AI agents have impacted the way we work, enabling greater automation and collaboration between humans and agents. In the data visualization field, multi-agent systems can be useful for employing agents…

Artificial Intelligence · Computer Science 2025-09-03 Anton Wolter , Georgios Vidalakis , Michael Yu , Ankit Grover , Vaishali Dhanoa