English
Related papers

Related papers: T2VTree: User-Centered Visual Analytics for Agent-…

200 papers

Training computer-use agents requires massive amounts of GUI interaction data, but manually annotating action trajectories at scale is prohibitively expensive. We present VideoAgentTrek, a scalable pipeline that automatically mines training…

Data analysts often need to iterate between data transformations and chart designs to create rich visualizations for exploratory data analysis. Although many AI-powered systems have been introduced to reduce the effort of visualization…

Human-Computer Interaction · Computer Science 2025-02-24 Chenglong Wang , Bongshin Lee , Steven Drucker , Dan Marshall , Jianfeng Gao

In recent years, agentic workflows have been widely applied to solve complex human tasks. However, existing workflow construction still faces key challenges, including human-dependent workflow construction, the lack of graph-level execution…

Artificial Intelligence · Computer Science 2026-05-15 Mingda Zhang , Wenjin Liu , Tiesunlong Shen , Qika Lin , Rui Mao , Erik Cambria , Xiaoying Tang , Haoran Luo

Recent vision-language-action (VLA) models for multi-task robot manipulation often rely on fixed camera setups and shared visual encoders, which limit their performance under occlusions and during cross-task transfer. To address these…

With recent advances in image and video diffusion models for content creation, a plethora of techniques have been proposed for customizing their generated content. In particular, manipulating the cross-attention layers of Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Saman Motamed , Wouter Van Gansbeke , Luc Van Gool

Identity-preserving text-to-video (IPT2V) generation creates videos faithful to both a reference subject image and a text prompt. While fine-tuning large pretrained video diffusion models on ID-matched data achieves state-of-the-art results…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jiayi Gao , Changcheng Hua , Qingchao Chen , Yuxin Peng , Yang Liu

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to balance between…

Human-Computer Interaction · Computer Science 2020-09-02 Tan Tang , Renzhong Li , Xinke Wu , Shuhan Liu , Johannes Knittel , Steffen Koch , Thomas Ertl , Lingyun Yu , Peiran Ren , Yingcai Wu

Video understanding requires not only visual recognition but also complex reasoning. While Vision-Language Models (VLMs) demonstrate impressive capabilities, they typically process videos largely in a single-pass manner with limited support…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Hong Gao , Yiming Bao , Xuezhen Tu , Yutong Xu , Yue Jin , Yiyang Mu , Bin Zhong , Linan Yue , Min-Ling Zhang

User prompts for generative AI models are often underspecified, leading to a misalignment between the user intent and models' understanding. As a result, users commonly have to painstakingly refine their prompts. We study this alignment…

Artificial Intelligence · Computer Science 2025-10-27 Meera Hahn , Wenjun Zeng , Nithish Kannen , Rich Galt , Kartikeya Badola , Been Kim , Zi Wang

We present Vivid-VR, a DiT-based generative video restoration method built upon an advanced T2V foundation model, where ControlNet is leveraged to control the generation process, ensuring content consistency. However, conventional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Haoran Bai , Xiaoxu Chen , Canqian Yang , Zongyao He , Sibin Deng , Ying Chen

Cross-Video Reasoning (CVR) has emerged as a critical frontier in multimodal intelligence, requiring models to retrieve, align, and aggregate evidence distributed across multiple videos. Current Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yilun Qiu , Jiahe Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Yao Hu , Chun Yuan

Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual…

Computation and Language · Computer Science 2021-07-08 Chi-Yang Hsu , Yun-Wei Chu , Ting-Hao 'Kenneth' Huang , Lun-Wei Ku

Subject-driven text-to-image (T2I) generation aims to produce images that align with a given textual description, while preserving the visual identity from a referenced subject image. Despite its broad downstream applicability - ranging…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Aviv Slobodkin , Hagai Taitelbaum , Yonatan Bitton , Brian Gordon , Michal Sokolik , Nitzan Bitton Guetta , Almog Gueta , Royi Rassin , Dani Lischinski , Idan Szpektor

This paper presents Video-P2P, a novel framework for real-world video editing with cross-attention control. While attention control has proven effective for image editing with pre-trained image generation models, there are currently no…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Shaoteng Liu , Yuechen Zhang , Wenbo Li , Zhe Lin , Jiaya Jia

Scriptwriting has traditionally been text-centric, a modality that only partially conveys the produced audiovisual experience. A formative study with professional writers informed us that connecting textual and audiovisual modalities can…

Human-Computer Interaction · Computer Science 2026-04-09 Zhecheng Wang , Jiaju Ma , Eitan Grinspun , Tovi Grossman , Bryan Wang

The current text-to-video (T2V) generation has made significant progress in synthesizing realistic general videos, but it is still under-explored in identity-specific human video generation with customized ID images. The key challenge lies…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hengjia Li , Haonan Qiu , Shiwei Zhang , Xiang Wang , Yujie Wei , Zekun Li , Yingya Zhang , Boxi Wu , Deng Cai

Collaborative driving systems leverage vehicle-to-everything (V2X) communication for multi-agent collaborative perception to enhance driving safety, yet they remain constrained by scarce annotated real-world V2X driving datasets and limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihang Tao , Yu Guo , Senkang Hu , Yanan Ma , Zihan Fang , Sam Kwong , Yuguang Fang

Despite rapid advances in text-to-video synthesis, generated video quality remains critically dependent on precise user prompts. Existing test-time optimization methods, successful in other domains, struggle with the multi-faceted nature of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Do Xuan Long , Xingchen Wan , Hootan Nakhost , Chen-Yu Lee , Tomas Pfister , Sercan Ö. Arık

The use of visual analytics tools has gained popularity in various domains, helping users discover meaningful information from complex and large data sets. Users often face difficulty in disseminating the knowledge discovered without clear…

Human-Computer Interaction · Computer Science 2021-04-26 Nam Wook Kim