English
Related papers

Related papers: Narrative Weaver: Towards Controllable Long-Range …

200 papers

We introduce Aether Weaver, a novel, integrated framework for multimodal narrative co-generation that overcomes limitations of sequential text-to-visual pipelines. Our system concurrently synthesizes textual narratives, dynamic scene graph…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Saeed Ghorbani

Video reasoning constitutes a comprehensive assessment of a model's capabilities, as it demands robust perceptual and interpretive skills, thereby serving as a means to explore the boundaries of model performance. While recent research has…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yudi Shi , Shangzhe Di , Qirui Chen , Qinian Wang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Weidi Xie

Data-driven storytelling has gained prominence in journalism and other data reporting fields. However, the process of creating these stories remains challenging, often requiring the integration of effective visualizations with compelling…

Human-Computer Interaction · Computer Science 2025-04-01 Yu Fu , Dennis Bromley , Vidya Setlur

Current video generation models perform well at single-shot synthesis but struggle with multi-shot videos, facing critical challenges in maintaining character and background consistency across shots and flexibly generating videos of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Xiangyang Luo , Qingyu Li , Xiaokun Liu , Wenyu Qin , Miao Yang , Meng Wang , Pengfei Wan , Di Zhang , Kun Gai , Shao-Lun Huang

Recent unified models have made unprecedented progress in both understanding and generation. However, while most of them accept multi-modal inputs, they typically produce only single-modality outputs. This challenge of producing interleaved…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jinbo Xing , Zeyinzi Jiang , Yuxiang Tuo , Chaojie Mao , Xiaotang Gai , Xi Chen , Jingfeng Zhang , Yulin Pan , Zhen Han , Jie Xiao , Keyu Yan , Chenwei Xie , Chongyang Zhong , Kai Zhu , Tong Shen , Lianghua Huang , Yu Liu , Yujiu Yang

Generative video modeling has made significant strides, yet ensuring structural and temporal consistency over long sequences remains a challenge. Current methods predominantly rely on RGB signals, leading to accumulated errors in object…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Zhiheng Liu , Xueqing Deng , Shoufa Chen , Angtian Wang , Qiushan Guo , Mingfei Han , Zeyue Xue , Mengzhao Chen , Ping Luo , Linjie Yang

Large language model-based agents operating in long-horizon interactions require memory systems that support temporal consistency, multi-hop reasoning, and evidence-grounded reuse across sessions. Existing approaches largely rely on…

Computation and Language · Computer Science 2026-01-27 Juexiang Ye , Xue Li , Xinyu Yang , Chengkai Huang , Lanshun Nie , Lina Yao , Dechen Zhan

A storyboard is a sequence of images to illustrate a story containing multiple sentences, which has been a key process to create different story products. In this paper, we tackle a new multimedia task of automatic storyboard creation to…

Machine Learning · Computer Science 2019-12-02 Shizhe Chen , Bei Liu , Jianlong Fu , Ruihua Song , Qin Jin , Pingping Lin , Xiaoyu Qi , Chunting Wang , Jin Zhou

Bridging vision and natural language is a longstanding goal in computer vision and multimedia research. While earlier works focus on generating a single-sentence description for visual content, recent works have studied paragraph…

Multimedia · Computer Science 2020-05-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan S. Kankanhalli

Character image animation, which synthesizes videos of reference characters driven by pose sequences, has advanced rapidly but remains largely limited to single-human settings. Existing methods struggle to generalize to multi-humanoid…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xirui Hu , Yanbo Ding , Jiahao Wang , Tingting Shi , Yali Wang , Guo Zhi Zhi , Weizhan Zhang

Long-form visual storytelling requires maintaining continuity across shots, including consistent characters, stable environments, and smooth scene transitions. While existing generative models can produce strong individual frames, they fail…

Computation and Language · Computer Science 2026-04-16 Ishani Mondal , Yiwen Song , Mihir Parmar , Palash Goyal , Jordan Boyd-Graber , Tomas Pfister , Yale Song

Visual storytelling is an emerging field that combines images and narratives to create engaging and contextually rich stories. Despite its potential, generating coherent and emotionally resonant visual stories remains challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiaochuan Lin , Xiangyong Chen

Story visualization has gained increasing attention in artificial intelligence. However, existing methods still struggle with maintaining a balance between character identity preservation and text-semantics alignment, largely due to a lack…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Jinlu Zhang , Jiji Tang , Rongsheng Zhang , Tangjie Lv , Xiaoshuai Sun

This paper tackles \textbf{open-ended deep research (OEDR)}, a complex challenge where AI agents must synthesize vast web-scale information into insightful reports. Current approaches are plagued by dual-fold limitations: static research…

Computation and Language · Computer Science 2025-10-08 Zijian Li , Xin Guan , Bo Zhang , Shen Huang , Houquan Zhou , Shaopeng Lai , Ming Yan , Yong Jiang , Pengjun Xie , Fei Huang , Jun Zhang , Jingren Zhou

Ensuring safety in autonomous driving requires scalable generation of realistic, controllable driving scenes beyond what real-world testing provides. Yet existing instruction guided image editors, trained on object-centric or artistic data,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mauricio Soroco , Francesco Pittaluga , Zaid Tasneem , Abhishek Aich , Bingbing Zhuang , Wuyang Chen , Manmohan Chandraker , Ziyu Jiang

This work introduces Weaver, our first family of large language models (LLMs) dedicated to content creation. Weaver is pre-trained on a carefully selected corpus that focuses on improving the writing capabilities of large language models.…

Text to video generation has emerged as a critical frontier in generative artificial intelligence, yet existing approaches struggle with maintaining temporal consistency, compositional understanding, and fine grained control over visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Piyushkumar Patel

With the rapid development of foundation video generation technologies, long video generation models have exhibited promising research potential thanks to expanded content creation space. Recent studies reveal that the goal of long video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 X. Feng , H. Yu , M. Wu , S. Hu , J. Chen , C. Zhu , J. Wu , X. Chu , K. Huang

Text-to-image generation with visual autoregressive~(VAR) models has recently achieved impressive advances in generation fidelity and inference efficiency. While control mechanisms have been explored for diffusion models, enabling precise…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Keli Liu , Zhendong Wang , Wengang Zhou , Shaodong Xu , Ruixiao Dong , Houqiang Li

Visual narrative generation transforms textual narratives into sequences of images illustrating the content of the text. However, generating visual narratives that are faithful to the input text and self-consistent across generated images…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Silin Gao , Sheryl Mathew , Li Mi , Sepideh Mamooler , Mengjie Zhao , Hiromi Wakaki , Yuki Mitsufuji , Syrielle Montariol , Antoine Bosselut
‹ Prev 1 2 3 10 Next ›