English
Related papers

Related papers: DATAWEAVER: Authoring Data-Driven Narratives throu…

200 papers

While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, open-source alternatives significantly lag behind. Most academic models remain heavily fragmented, and the few existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Kaihang Pan , Qi Tian , Jianwei Zhang , Weijie Kong , Jiangfeng Xiong , Yanxin Long , Shixue Zhang , Haiyi Qiu , Tan Wang , Zheqi Lv , Yue Wu , Liefeng Bo , Siliang Tang , Zhao Zhong

Recent advances in AI-driven storytelling have enhanced video generation and story visualization. However, translating dialogue-centric scripts into coherent storyboards remains a significant challenge due to limited script detail,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Min Zhang , Zilin Wang , Liyan Chen , Kunhong Liu , Juncong Lin

Visual storytelling aims to generate a narrative paragraph from a sequence of images automatically. Existing approaches construct text description independently for each image and roughly concatenate them as a story, which leads to the…

Computation and Language · Computer Science 2020-11-02 Ruize Wang , Zhongyu Wei , Ying Cheng , Piji Li , Haijun Shan , Ji Zhang , Qi Zhang , Xuanjing Huang

The emerging practice of data-driven storytelling is framing data using familiar narrative mechanisms such as slideshows, videos, and comics to make even highly complex phenomena understandable. However, current data stories are still not…

Human-Computer Interaction · Computer Science 2025-11-18 Zhenpeng Zhao , Niklas Elmqvist

Digital storytelling, essential in entertainment, education, and marketing, faces challenges in production scalability and flexibility. The StoryAgent framework, introduced in this paper, utilizes Large Language Models and generative tools…

Computation and Language · Computer Science 2024-06-24 Samuel S. Sohn , Danrui Li , Sen Zhang , Che-Jui Chang , Mubbasir Kapadia

Stories are central to human culture, serving to share ideas, preserve traditions, and foster connections. Automatic story generation, a key advancement in artificial intelligence (AI), offers new possibilities for creating personalized…

Computation and Language · Computer Science 2025-06-04 Jiaming Li , Yukun Chen , Ziqiang Liu , Minghuan Tan , Lei Zhang , Yunshui Li , Run Luo , Longze Chen , Jing Luo , Ahmadreza Argha , Hamid Alinejad-Rokny , Wei Zhou , Min Yang

Individuals with Intellectual and Developmental Disabilities (IDD) have unique needs and challenges when working with data. While visualization aims to make data more accessible to a broad audience, our understanding of how to design…

Human-Computer Interaction · Computer Science 2024-08-30 Keke Wu , Ghulam Jilani Quadri , Arran Zeyu Wang , David Kwame Osei-Tutu , Emma Petersen , Varsha Koushik , Danielle Albers Szafir

Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual…

Computation and Language · Computer Science 2021-07-08 Chi-Yang Hsu , Yun-Wei Chu , Ting-Hao 'Kenneth' Huang , Lun-Wei Ku

Large Language Models (LLMs) have shown impressive abilities in natural language understanding and generation, leading to their widespread use in applications such as chatbots and virtual assistants. However, existing LLM frameworks face…

Text-to-3D generation, which synthesizes 3D assets according to an overall text description, has significantly progressed. However, a challenge arises when the specific appearances need customizing at designated viewpoints but referring…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Junkai Yan , Yipeng Gao , Qize Yang , Xihan Wei , Xuansong Xie , Ancong Wu , Wei-Shi Zheng

In recent years, narrative visualization has gained much attention. Researchers have proposed different design spaces for various narrative visualization genres and scenarios to facilitate the creation process. As users' needs grow and…

Human-Computer Interaction · Computer Science 2023-03-23 Qing Chen , Shixiong Cao , Jiazhe Wang , Nan Cao

Character image animation, which synthesizes videos of reference characters driven by pose sequences, has advanced rapidly but remains largely limited to single-human settings. Existing methods struggle to generalize to multi-humanoid…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xirui Hu , Yanbo Ding , Jiahao Wang , Tingting Shi , Yali Wang , Guo Zhi Zhi , Weizhan Zhang

In this text, we consider the authoring of interactive digital narratives (IDNs) as a system of interwoven creative processes and look at it as a design process. The aim is to better understand the structural, aesthetic and interactive…

Human-Computer Interaction · Computer Science 2025-06-10 Frank Nack

Ensuring safety in autonomous driving requires scalable generation of realistic, controllable driving scenes beyond what real-world testing provides. Yet existing instruction guided image editors, trained on object-centric or artistic data,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mauricio Soroco , Francesco Pittaluga , Zaid Tasneem , Abhishek Aich , Bingbing Zhuang , Wuyang Chen , Manmohan Chandraker , Ziyu Jiang

Visual storytelling is the task of generating stories based on a sequence of images. Inspired by the recent works in neural generation focusing on controlling the form of text, this paper explores the idea of generating these stories in…

Computation and Language · Computer Science 2019-06-18 Shrimai Prabhumoye , Khyathi Raghavi Chandu , Ruslan Salakhutdinov , Alan W Black

Whether it is in the form of transcribed conversations, blog posts, or tweets, qualitative data provides a reader with rich insight into both the overarching trends as well as the diversity of human ideas expressed through text. Handling…

Human-Computer Interaction · Computer Science 2022-09-27 Huyen N. Nguyen , Tommy Dang , Kathleen A. Bowe

When exploring data, analysts construct narratives about what the data means by asking questions, generating visualizations, reflecting on patterns, and revising their interpretations as new insights emerge. Yet existing analysis tools…

Human-Computer Interaction · Computer Science 2026-01-06 Oliver Huang , Muhammad Fatir , Steven Luo , Sangho Suh , Hariharan Subramonyam , Carolina Nobre

Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand long text inputs and 2) produce a globally consistent image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Hong Chen , Rujun Han , Te-Lin Wu , Hideki Nakayama , Nanyun Peng

Data storytelling (DS) is rapidly gaining attention as an approach that integrates data, visuals, and narratives to create data stories that can help a particular audience to comprehend the key messages underscored by the data with enhanced…

Human-Computer Interaction · Computer Science 2024-05-21 Honbo Shao , Roberto Martinez-Maldonado , Vanessa Echeverria , Lixiang Yan , Dragan Gasevic

Large language model-based agents operating in long-horizon interactions require memory systems that support temporal consistency, multi-hop reasoning, and evidence-grounded reuse across sessions. Existing approaches largely rely on…

Computation and Language · Computer Science 2026-01-27 Juexiang Ye , Xue Li , Xinyu Yang , Chengkai Huang , Lanshun Nie , Lina Yao , Dechen Zhan