English
Related papers

Related papers: Leveraging Foundation Models for Crafting Narrativ…

200 papers

We define "visual story-writing" as using visual representations of story elements to support writing and revising narrative texts. To demonstrate this approach, we developed a text editor that automatically visualizes a graph of entity…

Human-Computer Interaction · Computer Science 2025-08-01 Damien Masson , Zixin Zhao , Fanny Chevalier

The advent of foundation models has revolutionized the fields of natural language processing and computer vision, paving the way for their application in autonomous driving (AD). This survey presents a comprehensive review of more than 40…

Machine Learning · Computer Science 2024-09-06 Haoxiang Gao , Zhongruo Wang , Yaqian Li , Kaiwen Long , Ming Yang , Yiqing Shen

Analyzing literature involves tracking interactions between characters, locations, and themes. Visualization has the potential to facilitate the mapping and analysis of these complex relationships, but capturing structured information from…

Human-Computer Interaction · Computer Science 2025-08-12 Catherine Yeh , Tara Menon , Robin Singh Arya , Helen He , Moira Weigel , Fernanda Viégas , Martin Wattenberg

Narrative inquiry has been one of the prominent application domains for the analysis of human experience, aiming to know more about the complexity of human society. However, researchers are often required to transform various forms of data…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Runtong Wu , Jiayao Song , Fei Teng , Xianhao Ren , Yuyan Gao , Kailun Yang

Narrative frames are a powerful way of conceptualizing and communicating complex, controversial ideas, however automated frame analysis to date has mostly overlooked this framing device. In this paper, we connect elements of narrativity…

Computation and Language · Computer Science 2025-06-03 Yulia Otmakhova , Lea Frermann

Text is an integral but understudied component of visualization design. Although recent studies have examined how text elements (e.g., titles and annotations) influence comprehension, preferences, and predictions, many questions remain…

Human-Computer Interaction · Computer Science 2025-07-17 Chase Stokes , Anjana Arunkumar , Marti A. Hearst , Lace Padilla

The effective design and delivery of assessments in a wide variety of evolving educational environments remains a challenging problem. Proposals have included the use of learning dashboards, peer learning environments, and grading support…

Human-Computer Interaction · Computer Science 2019-10-15 Kendra M. L. Cooper , Hassan Khosravi

We propose an approach to manipulate existing interactive visualizations to answer users' natural language queries. We analyze the natural language tasks and propose a design space of a hierarchical task structure, which allows for a…

Human-Computer Interaction · Computer Science 2024-04-10 Can Liu , Jiacheng Yu , Yuhan Guo , Jiayi Zhuang , Yuchu Luo , Xiaoru Yuan

Narratives are fundamental to our perception of the world and are pervasive in all activities that involve the representation of events in time. Yet, modern online information systems do not incorporate narratives in their representation of…

Human-Computer Interaction · Computer Science 2020-10-27 Brian Keith , Tanushree Mitra

Visual Storytelling is a challenging multimodal task between Vision & Language, where the purpose is to generate a story for a stream of images. Its difficulty lies on the fact that the story should be both grounded to the image sequence…

Computation and Language · Computer Science 2025-08-21 Admitos Passadakis , Yingjin Song , Albert Gatt

In recent years, a substantial body of work in visually grounded natural language processing has focused on real-life multimodal scenarios such as describing content depicted in images or videos. However, comparatively less attention has…

Computation and Language · Computer Science 2025-08-21 Aditya K Surikuchi , Raquel Fernández , Sandro Pezzelle

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story with a global consistency across dynamic scenes and characters. Current works still struggle with output images' quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Bowen Li , Thomas Lukasiewicz

Mathematical concepts and tools have shaped the field of visualization in fundamental ways and played a key role in the development of a large variety of visualization techniques. In this chapter, we sample the visualization literature to…

Human-Computer Interaction · Computer Science 2019-09-12 Ingrid Hotz , Roxana Bujack , Christoph Garth , Bei Wang

This paper presents a theoretical model for interactive visualization literacy to describe how people use interactive data visualizations and systems. Literacies have become an important concept in describing modern life skills, with…

Human-Computer Interaction · Computer Science 2026-02-11 Gabriela Molina León , Benjamin Bach , Matheus Valentim , Niklas Elmqvist

Traditional approaches to data visualization have often focused on comparing different subsets of data, and this is reflected in the many techniques developed and evaluated over the years for visual comparison. Similarly, common workflows…

Human-Computer Interaction · Computer Science 2024-02-27 David Borland , Arran Zeyu Wang , David Gotz

Constructive approaches to visualization authoring have been shown to offer advantages such as providing options for flexible outputs, scaffolding and ideation of new data mappings, personalized exploration of data, as well as supporting…

Human-Computer Interaction · Computer Science 2019-08-05 Gonzalo Gabriel Méndez , Jagoda Walny , Søren Knudsen , Charles Perin , Samuel Huron , Jo Vermeulen , Richard Pusch , Sheelagh Carpendale

As artificial intelligence systems become increasingly integrated into daily life, the field of explainability has gained significant attention. This trend is particularly driven by the complexity of modern AI models and their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation…

Computation and Language · Computer Science 2023-05-16 Hanieh Khorashadizadeh , Nandana Mihindukulasooriya , Sanju Tiwari , Jinghua Groppe , Sven Groppe

During the last decade, Natural Language Processing has become, after Computer Vision, the second field of Artificial Intelligence that was massively changed by the advent of Deep Learning. Regardless of the architecture, the language…

Computation and Language · Computer Science 2022-05-23 Adrian M. P. Braşoveanu , Răzvan Andonie

The major objective of this work is to study and report the existing ontology-driven models for narrative information. The paper aims to analyze these models across various domains. The goal of this work is to bring the relevant literature,…

Digital Libraries · Computer Science 2021-10-06 Udaya Varadarajan , Biswanath Dutta