English
Related papers

Related papers: Plot and Rework: Modeling Storylines for Visual St…

200 papers

In argumentative writing, writers must brainstorm hierarchical writing goals, ensure the persuasiveness of their arguments, and revise and organize their plans through drafting. Recent advances in large language models (LLMs) have made…

Human-Computer Interaction · Computer Science 2023-07-31 Zheng Zhang , Jie Gao , Ranjodh Singh Dhaliwal , Toby Jia-Jun Li

A storyline visualization is a layout that represents the temporal dynamics of social interactions along time by the convergence of chronological lines. Among the criteria oriented at improving aesthetics and legibility of a representation…

Data Structures and Algorithms · Computer Science 2016-08-30 Martin Gronemann , Michael Jünger , Frauke Liers , Francesco Mambelli

We present a new comprehensive theory for explaining, exploring, and using pattern as a visual variable in visualization. Although patterns have long been used for data encoding and continue to be valuable today, their conceptual…

Human-Computer Interaction · Computer Science 2026-01-30 Tingying He , Jason Dykes , Petra Isenberg , Tobias Isenberg

Recent advances in AI enable the automatic generation of visualizations directly from textual prompts using agentic workflows. However, visualizations produced via one-shot generative methods often suffer from insufficient quality,…

Human-Computer Interaction · Computer Science 2026-03-19 Roxana Bujack , Li-Ta Lo , Ethan Stam , Ayan Biswas , David Rogers

We consider the problem of automatically generating longer stories of over two thousand words. Compared to prior work on shorter stories, long-range plot coherence and relevance are more central challenges here. We propose the Recursive…

Computation and Language · Computer Science 2022-10-25 Kevin Yang , Yuandong Tian , Nanyun Peng , Dan Klein

Recent generative models have demonstrated impressive capabilities in generating realistic and visually pleasing images grounded on textual prompts. Nevertheless, a significant challenge remains in applying these models for the more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Xiaoqian Shen , Mohamed Elhoseiny

In recent years, narrative visualization has gained much attention. Researchers have proposed different design spaces for various narrative visualization genres and scenarios to facilitate the creation process. As users' needs grow and…

Human-Computer Interaction · Computer Science 2023-03-23 Qing Chen , Shixiong Cao , Jiazhe Wang , Nan Cao

Data-driven stories seek to inform and persuade audiences through the use of data visualisations and engaging narratives. These stories have now been highly optimised to be viewed on desktop and mobile computers. In contrast, while…

Human-Computer Interaction · Computer Science 2023-08-28 Xiaoyan Zhou , Yalong Yang , Francisco Ortega , Anil Ufuk Batmaz , Benjamin Lee

Text-to-image diffusion models have demonstrated significant capabilities to generate diverse and detailed visuals in various domains, and story visualization is emerging as a particularly promising application. However, as their use in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Kiymet Akdemir , Jing Shi , Kushal Kafle , Brian Price , Pinar Yanardag

We propose the task of outline-conditioned story generation: given an outline as a set of phrases that describe key characters and events to appear in a story, the task is to generate a coherent narrative that is consistent with the…

Computation and Language · Computer Science 2020-10-13 Hannah Rashkin , Asli Celikyilmaz , Yejin Choi , Jianfeng Gao

We propose a learning model for the task of visual storytelling. The main idea is to predict anchor word embeddings from the images and use the embeddings and the image features jointly to generate narrative sentences. We use the embeddings…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Bowen Zhang , Hexiang Hu , Fei Sha

Video is a powerful medium for communication and storytelling, yet reauthoring existing footage remains challenging. Even simple edits often demand expertise, time, and careful planning, constraining how creators envision and shape their…

Human-Computer Interaction · Computer Science 2026-04-07 Sitong Wang , Anh Truong , Lydia B. Chilton , Dingzeyu Li

Reasoning about visual relationships is central to how humans interpret the visual world. This task remains challenging for current deep learning algorithms since it requires addressing three key technical problems jointly: 1) identifying…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Xiaojian Ma , Weili Nie , Zhiding Yu , Huaizu Jiang , Chaowei Xiao , Yuke Zhu , Song-Chun Zhu , Anima Anandkumar

Explanations for computer vision models are important tools for interpreting how the underlying models work. However, they are often presented in static formats, which pose challenges for users, including information overload, a gap between…

Human-Computer Interaction · Computer Science 2025-04-16 Indu Panigrahi , Sunnie S. Y. Kim , Amna Liaqat , Rohan Jinturkar , Olga Russakovsky , Ruth Fong , Parastoo Abtahi

Large Language Models have rapidly advanced in their ability to interpret and generate natural language. In enterprise settings, they are frequently augmented with closed-source domain knowledge to deliver more contextually informed…

Computation and Language · Computer Science 2025-12-03 Tanmay Agrawal

Data-rich documents are commonly found across various fields such as business, finance, and science. However, a general limitation of these documents for reading is their reliance on text to convey data and facts. Visual representation of…

Human-Computer Interaction · Computer Science 2025-02-25 Zekai Shao , Leixian Shen , Haotian Li , Yi Shan , Huamin Qu , Yun Wang , Siming Chen

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

Empowering blind and low vision (BLV) users to explore visual media improves content comprehension, strengthens user agency, and fulfills diverse information needs. However, most existing tools separate exploration from the main narration,…

Human-Computer Interaction · Computer Science 2025-08-08 Shuchang Xu

The new generation of state-of-the-art computer vision systems are trained from natural language supervision, ranging from simple object category names to descriptive captions. This form of supervision ensures high generality and usability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Sheng Shen , Chunyuan Li , Xiaowei Hu , Jianwei Yang , Yujia Xie , Pengchuan Zhang , Zhe Gan , Lijuan Wang , Lu Yuan , Ce Liu , Kurt Keutzer , Trevor Darrell , Anna Rohrbach , Jianfeng Gao

Current work on image-based story generation suffers from the fact that the existing image sequence collections do not have coherent plots behind them. We improve visual story generation by producing a new image-grounded dataset, Visual…

Computation and Language · Computer Science 2023-01-23 Xudong Hong , Asad Sayeed , Khushboo Mehra , Vera Demberg , Bernt Schiele