English
Related papers

Related papers: Multimodal analogs to infer humanities visualizati…

200 papers

Visualizations have a potentially enormous influence on how data are used to make decisions across all areas of human endeavor. However, it is not clear how this power connects to ethical duties: what obligations do we have when it comes to…

Human-Computer Interaction · Computer Science 2021-04-07 Michael Correll

Recognizing spatial relations and reasoning about them is essential in multiple applications including navigation, direction giving and human-computer interaction in general. Spatial relations between objects can either be explicit --…

Computation and Language · Computer Science 2020-07-21 Soham Dan , Hangfeng He , Dan Roth

We introduce a deep multitask architecture to integrate multityped representations of multimodal objects. This multitype exposition is less abstract than the multimodal characterization, but more machine-friendly, and thus is more precise…

Machine Learning · Statistics 2016-03-07 Truyen Tran , Dinh Phung , Svetha Venkatesh

Visualization researchers and visualization professionals seek appropriate abstractions of visualization requirements that permit considering visualization solutions independently from specific problems. Abstractions can help us design,…

Human-Computer Interaction · Computer Science 2023-03-16 Michael Gleicher , Maria Riveiro , Tatiana von Landesberger , Oliver Deussen , Remco Chang , Christina Gillman

Navigating spaces is an embodied experience. Examples can vary from rescue workers trying to save people from natural disasters; a tourist finding their way to the nearest coffee shop, or a gamer solving a maze. Virtual reality allows these…

Human-Computer Interaction · Computer Science 2018-09-24 Aryabrata Basu , Kyle Johnsen

Attitudes about artificial intelligence and machine learning are recent victims of endemic misunderstanding; given our increasing reliance on these technologies, the need for widespread understanding and confidence in their use is…

Graphics · Computer Science 2026-05-04 Bokang Wang , Yingxuan Liao , Leah Lee , Jack Wesson , Anlan Yang , Ruizi Wang , Yigang Wen

In this study, conversations between humans and avatars are linguistically, organizationally, and structurally analyzed, focusing on what is necessary for creating face-to-face multimodal interfaces for machines. We videorecorded…

Human-Computer Interaction · Computer Science 2022-11-28 João Ranhel , Cacilda Vilela de Lima

Manufacturing is using Virtual Reality tools to enhance the product life cycle. Their definitions are still in flux and it is necessary to define their connections. Thus, firstly, we will introduce more closely some definitions where we…

Robotics · Computer Science 2007-07-25 Fouad Bennis , Damien Chablat , Philippe Dépincé

We present our current research on the implementation of gaze as an efficient and usable pointing modality supplementary to speech, for interacting with augmented objects in our daily environment or large displays, especially immersive…

Human-Computer Interaction · Computer Science 2007-08-28 Daniel Gepner , Jérôme Simonin , Noëlle Carbonell

Archives of libraries contain many materials, which have not yet been made available to the public. The prioritization of which content to provide and especially how to design effective access paths depend on potential users' needs. As a…

Digital Libraries · Computer Science 2024-11-05 Hermann Kroll , Christin K. Kreutz , Mathias Jehn , Thomas Risse

Due to the increase of interest in Augmented Reality (AR), the potential uses of AR are increasing also. It can benefit the user in various fields such as education, business, medicine, and other. Augmented Reality supports the real…

Understanding details of human multimodal interaction can elucidate many aspects of the type of information processing machines must perform to interact with humans. This article gives an overview of recent findings from Linguistics…

Computation and Language · Computer Science 2020-08-10 João Ranhel , Cacilda Vilela

This article explores a critical gap in Mixed Reality (MR) technology: while advances have been made, MR still struggles to authentically replicate human embodiment and socio-motor interaction. For MR to enable truly meaningful social…

Augmented reality has great potential for embedding data visualizations in the world around the user. While this can enhance users' understanding of their surroundings, it also bears the risk of overwhelming their senses with a barrage of…

Human-Computer Interaction · Computer Science 2026-02-24 Sebastian Hubenschmid , Arvind Srinivasan , Niklas Elmqvist , Dieter Schmalstieg , Michael Sedlmair

While recommender systems with multi-modal item representations (image, audio, and text), have been widely explored, learning recommendations from multi-modal user interactions (e.g., clicks and speech) remains an open problem. We study the…

Information Retrieval · Computer Science 2024-05-08 Simone Borg Bruun , Krisztian Balog , Maria Maistro

Network visualizations are commonly used to analyze relationships in various contexts. To efficiently explore a network visualization, the user needs to quickly navigate to different parts of the network and analyze local details. Recent…

Human-Computer Interaction · Computer Science 2023-03-29 Helen H. Huang , Hanspeter Pfister , Yalong Yang

Tour guidance in virtual museums encourages multi-modal interactions to boost user experiences, concerning engagement, immersion, and spatial awareness. Nevertheless, achieving the goal is challenging due to the complexity of comprehending…

Human-Computer Interaction · Computer Science 2024-01-24 Zhan Wang , Lin-Ping Yuan , Liangwei Wang , Bingchuan Jiang , Wei Zeng

Humans inhabit a world defined by interactions -- with other humans, objects, and environments. These interactive movements not only convey our relationships with our surroundings but also demonstrate how we perceive and communicate with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Kewei Sui , Anindita Ghosh , Inwoo Hwang , Bing Zhou , Jian Wang , Chuan Guo

Effective data visualization is a key part of the discovery process in the era of big data. It is the bridge between the quantitative content of the data and human intuition, and thus an essential component of the scientific path from data…

We believe that 3D visualisations should not be used alone; by coincidentally displaying alternative views the user can gain the best understanding of all situations. The different presentations signify manifold meanings and afford…

Human-Computer Interaction · Computer Science 2021-08-11 J. C. Roberts , J. W. Mearman , P. W. S. Butcher , H. M. Al-Maneea , P. D. Ritsos