English
Related papers

Related papers: GenMAC: Compositional Text-to-Video Generation wit…

200 papers

Agentic task-solving with Large Language Models (LLMs) requires multi-turn, multi-step interactions, often involving complex function calls and dynamic user-agent exchanges. Existing simulation-based data generation methods for such…

Computation and Language · Computer Science 2026-02-16 Xingshan Zeng , Weiwen Liu , Lingzhi Wang , Liangyou Li , Fei Mi , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu

The recent success in StyleGAN demonstrates that pre-trained StyleGAN latent space is useful for realistic video generation. However, the generated motion in the video is usually not semantically meaningful due to the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Seung Hyun Lee , Gyeongrok Oh , Wonmin Byeon , Chanyoung Kim , Won Jeong Ryoo , Sang Ho Yoon , Hyunjun Cho , Jihyun Bae , Jinkyu Kim , Sangpil Kim

While recent generative models advance pixel-space video synthesis, they remain limited in producing professional educational videos, which demand disciplinary knowledge, precise visual structures, and coherent transitions, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yanzhe Chen , Kevin Qinghong Lin , Mike Zheng Shou

We present PresentAgent, a multimodal agent that transforms long-form documents into narrated presentation videos. While existing approaches are limited to generating static slides or text summaries, our method advances beyond these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jingwei Shi , Zeyu Zhang , Biao Wu , Yanjie Liang , Meng Fang , Ling Chen , Yang Zhao

Music enhances video narratives and emotions, driving demand for automatic video-to-music (V2M) generation. However, existing V2M methods relying solely on visual features or supplementary textual inputs generate music in a black-box…

Multimedia · Computer Science 2025-07-29 Junxian Wu , Weitao You , Heda Zuo , Dengming Zhang , Pei Chen , Lingyun Sun

Text-to-Video (T2V) generation has benefited from recent advances in diffusion models, yet current systems still struggle under complex scenarios, which are generally exacerbated by the ambiguity and underspecification of text prompts. In…

Artificial Intelligence · Computer Science 2026-04-21 Chengyi Yang , Pengzhen Li , Jiayin Qi , Aimin Zhou , Ji Wu , Ji Liu

Advances in technology have led to the development of methods that can create desired visual multimedia. In particular, image generation using deep learning has been extensively studied across diverse fields. In comparison, video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Doyeon Kim , Donggyu Joo , Junmo Kim

We introduce a novel diffusion-based video generation method, generating a video showing multiple events given multiple individual sentences from the user. Our method does not require a large-scale video dataset since our method uses a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Gyeongrok Oh , Jaehwan Jeong , Sieun Kim , Wonmin Byeon , Jinkyu Kim , Sungwoong Kim , Sangpil Kim

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Text-to-motion (T2M) generation aims to control the behavior of a target character via textual descriptions. Leveraging text-motion paired datasets, existing T2M models have achieved impressive performance in generating high-quality motions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiakun Zheng , Ting Xiao , Shiqin Cao , Xinran Li , Zhe Wang , Chenjia Bai

The rapid advancement of video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models, primarily due to simple prompts that cannot showcase the model's capabilities, fixed evaluation operators…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yuhang Yang , Ke Fan , Shangkun Sun , Hongxiang Li , Ailing Zeng , FeiLin Han , Wei Zhai , Wei Liu , Yang Cao , Zheng-Jun Zha

Recent text-to-video (T2V) generation methods have seen significant advancements. However, the majority of these works focus on producing short video clips of a single event (i.e., single-scene videos). Meanwhile, recent large language…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Han Lin , Abhay Zala , Jaemin Cho , Mohit Bansal

While recent text-to-video models excel at generating diverse scenes, they struggle with precise motion control, particularly for complex, multi-subject motions. Although methods for single-motion customization have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Youcan Xu , Zhen Wang , Jiaxin Shi , Kexin Li , Feifei Shao , Jun Xiao , Yi Yang , Jun Yu , Long Chen

Despite the success achieved by existing image generation and editing methods, current models still struggle with complex problems including intricate text prompts, and the absence of verification and self-correction mechanisms makes the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Zhenyu Wang , Aoxue Li , Zhenguo Li , Xihui Liu

Video generation has witnessed remarkable progress with the advent of deep generative models, particularly diffusion models. While existing methods excel in generating high-quality videos from text prompts or single images, personalized…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yufan Deng , Xun Guo , Yizhi Wang , Jacob Zhiyuan Fang , Angtian Wang , Shenghai Yuan , Yiding Yang , Bo Liu , Haibin Huang , Chongyang Ma

Recent progress in large language model (LLM)-based multi-agent collaboration highlights the power of structured communication in enabling collective intelligence. However, existing methods largely rely on static or graph-based inter-agent…

Artificial Intelligence · Computer Science 2025-11-04 Song Wang , Zhen Tan , Zihan Chen , Shuang Zhou , Tianlong Chen , Jundong Li

Video generation is a challenging yet pivotal task in various industries, such as gaming, e-commerce, and advertising. One significant unresolved aspect within T2V is the effective visualization of text within generated videos. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Lin Liu , Quande Liu , Shengju Qian , Yuan Zhou , Wengang Zhou , Houqiang Li , Lingxi Xie , Qi Tian

This paper proposes a multi-agent artificial intelligence system that generates response-oriented media content in real time based on audio-derived emotional signals. Unlike conventional speech emotion recognition studies that focus…

Artificial Intelligence · Computer Science 2026-01-21 HyeYoung Lee

While text-to-visual models now produce photo-realistic images and videos, they struggle with compositional text prompts involving attributes, relationships, and higher-order reasoning such as logic and comparison. In this work, we conduct…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Baiqi Li , Zhiqiu Lin , Deepak Pathak , Jiayao Li , Yixin Fei , Kewen Wu , Tiffany Ling , Xide Xia , Pengchuan Zhang , Graham Neubig , Deva Ramanan