English
Related papers

Related papers: Comprehending Spatio-temporal Data via Cinematic S…

200 papers

We consider the problem of designing an artificial agent capable of interacting with humans in collaborative dialogue to produce creative, engaging narratives. In this task, the goal is to establish universe details, and to collaborate on…

Human-Computer Interaction · Computer Science 2019-02-01 Kory W. Mathewson , Pablo Samuel Castro , Colin Cherry , George Foster , Marc G. Bellemare

Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transformer-based models…

Machine Learning · Computer Science 2026-04-16 Xinjin Li , Jinghan Cao , Mengyue Wang , Yue Wu , Longxiang Yan , Yeyang Zhou , Ziqi Sha , Yu Ma

Compact visual summaries of spatio-temporal movement data often strive to express accurate positions of movers. We present SpatialRugs, a technique to enhance the spatial awareness of movements in dense pixel visualizations. SpatialRugs…

Human-Computer Interaction · Computer Science 2020-03-30 Juri F. Buchmüller , Udo Schlegel , Eren Cakmak , Evanthia Dimara , Daniel A. Keim

Face analysis has been studied from different angles to infer emotion, poses, shapes, and landmarks. Traditionally RGB cameras are used, yet for fine-grained tasks standard sensors might not be up to the task due to their latency, making it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Luca Cultrera , Federico Becattini , Lorenzo Berlincioni , Claudio Ferrari , Alberto Del Bimbo

Narrative sensemaking is an essential part of understanding sequential data. Narrative maps are a visual representation model that can assist analysts to understand narratives. In this work, we present a semantic interaction (SI) framework…

Human-Computer Interaction · Computer Science 2023-02-14 Brian Keith Norambuena , Tanushree Mitra , Chris North

Motion is a fundamental cue for scene analysis and human activity understan- ding in videos. It can be encoded in trajectories for tracking objects and for action recognition, or in form of flow to address behaviour analysis in crowded…

Computer Vision and Pattern Recognition · Computer Science 2015-09-30 Eduardo M. Pereira , Jaime S. Cardoso , Ricardo Morla

Generating long-form audio-visual stories from a short user prompt remains challenging due to an intent-execution gap, where high-level narrative intent must be preserved across coherent, shot-level multimodal generation over long horizons.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Wenzhang Sun , Zhenyu Wang , Zhangchi Hu , Chunfeng Wang , Hao Li , Wei Chen

We introduce a dataset containing human-authored descriptions of target locations in an "end-of-trip in a taxi ride" scenario. We describe our data collection method and a novel annotation scheme that supports understanding of such…

Computation and Language · Computer Science 2018-07-12 Deepthi Karkada , Ramesh Manuvinakurike , Kallirroi Georgila

There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on…

Computation and Language · Computer Science 2024-06-06 Nick Alonso , Tomás Figliolia , Anthony Ndirango , Beren Millidge

Traditional visual storytelling is complex, requiring specialized knowledge and substantial resources, yet often constrained by human creativity and creation precision. While Large Language Models (LLMs) enhance visual storytelling, current…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yuzhou Huang , Yiran Qin , Shunlin Lu , Xintao Wang , Rui Huang , Ying Shan , Ruimao Zhang

Narrative sensemaking is a fundamental process to understand sequential information. Narrative maps are a visual representation framework that can aid analysts in this process. They allow analysts to understand the big picture of a…

Human-Computer Interaction · Computer Science 2021-09-03 Brian Felipe Keith Norambuena , Tanushree Mitra , Chris North

Film media is a rich form of artistic expression. Unlike photography, and short videos, movies contain a storyline that is deliberately complex and intricate in order to engage its audience. In this paper we present a large scale study…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Paola Cascante-Bonilla , Kalpathy Sitaraman , Mengjia Luo , Vicente Ordonez

With the advent of advanced 4G/5G mobile networks, mobile phone data collected by operators now includes detailed, service-specific traffic information with high spatio-temporal resolution. In this paper, we leverage this type of data to…

Machine Learning · Computer Science 2024-11-26 Giulio Loddi , Chiara Pugliese , Francesco Lettich , Fabio Pinelli , Chiara Renso

A complex system comprises multiple interacting entities whose interdependencies form a unified whole, exhibiting emergent behaviours not present in individual components. Examples include the human brain, living cells, soft matter, Earth's…

The growing complexity of urban mobility systems has made traffic simulation indispensable for evidence-based transportation planning and policy evaluation. However, despite the analytical capabilities of platforms such as the Simulation of…

Human-Computer Interaction · Computer Science 2025-11-11 Minwoo Jeong , Jeeyun Chang , Yoonjin Yoon

We propose a spatial-constraint approach for modeling spatial-based interactions and enabling interactive visualizations, which involves the manipulation of visualizations through selection, filtering, navigation, arrangement, and…

Human-Computer Interaction · Computer Science 2024-03-21 Can Liu , Yu Zhang , Cong Wu , Chen Li , Xiaoru Yuan

Reliable traffic flow prediction is crucial to creating intelligent transportation systems. Many big-data-based prediction approaches have been developed but they do not reflect complicated dynamic interactions between roads considering…

Machine Learning · Computer Science 2023-06-21 Won Kyung Lee , Deuk Sin Kwon , So Young Sohn

We present the Qualitative Explainable Graph (QXG): a unified symbolic and qualitative representation for scene understanding in urban mobility. QXG enables the interpretation of an automated vehicle's environment using sensor data and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

Current optical flow methods exploit the stable appearance of frame (or RGB) data to establish robust correspondences across time. Event cameras, on the other hand, provide high-temporal-resolution motion cues and excel in challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Qianang Zhou , Junhui Hou , Meiyi Yang , Yongjian Deng , Youfu Li , Junlin Xiong

Text-to-image generative models can be tremendously valuable in supporting creative tasks by providing inspirations and enabling quick exploration of different design ideas. However, one common challenge is that users may still not be able…

Human-Computer Interaction · Computer Science 2025-10-06 Yuhan Guo , Xingyou Liu , Xiaoru Yuan , Kai Xu