English
Related papers

Related papers: Cognitive Affordances in Visualization: Related Co…

200 papers

Visual affordance learning is crucial for robots to understand and interact effectively with the physical world. Recent advances in this field attempt to leverage pre-trained knowledge of vision-language foundation models to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Qian Zhang , Lin Zhang , Xing Fang , Mingxin Zhang , Zhiyuan Wei , Ran Song , Wei Zhang

The concept of affordance is important to understand the relevance of object parts for a certain functional interaction. Affordance types generalize across object categories and are not mutually exclusive. This makes the segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Johann Sawatzky , Juergen Gall

This article studies the commonsense object affordance concept for enabling close-to-human task planning and task optimization of embodied robotic agents in urban environments. The focus of the object affordance is on reasoning how to…

The aim of visualization is to support people in dealing with large and complex information structures, to make these structures more comprehensible, facilitate exploration, and enable knowledge discovery. However, users often have problems…

Human-Computer Interaction · Computer Science 2022-03-22 Christina Stoiber , Markus Wagner , Florian Grassinger , Margit Pohl , Holger Stitz , Marc Streit , Benjamin Potzmann , Wolfgang Aigner

Annotation is a central mechanism in visualization design that enables people to communicate key insights. Prior research has provided essential accounts of the visual forms annotations take, but less attention has been paid to the…

Human-Computer Interaction · Computer Science 2026-04-10 Md Dilshadur Rahman , Devin Lange , Ghulam Jilani Quadri , Paul Rosen

The concept of metaphor, in particular graphical (or visual) metaphor, is central to the field of information visualization. Information graphics and interactive information visualization systems employ a variety of metaphorical devices to…

Human-Computer Interaction · Computer Science 2009-09-29 John S. Risch

The perceptual experience of architecture is enacted by the sensory and motor system. When we act, we change the perceived environment according to a set of expectations that depend on our body and the built environment. The continuous…

Neurons and Cognition · Quantitative Biology 2020-11-10 Zakaria Djebbara , Thomas Parr , Karl Friston

What impressions might readers form with visualizations that go beyond the data they encode? In this paper, we build on recent work that demonstrates the socio-indexical function of visualization, showing that visualizations communicate…

Human-Computer Interaction · Computer Science 2025-08-12 Amy Rae Fox , Michelle Morgenstern , Graham M. Jones , Arvind Satyanarayan

A growing number of efforts aim to understand what people see when using a visualization. These efforts provide scientific grounding to complement design intuitions, leading to more effective visualization practice. However, published…

Human-Computer Interaction · Computer Science 2020-09-16 Madison Elliott , Christine Nothelfer , Cindy Xiong , Danielle Szafir

Conventional works that learn grasping affordance from demonstrations need to explicitly predict grasping configurations, such as gripper approaching angles or grasping preshapes. Classic motion planners could then sample trajectories by…

Robotics · Computer Science 2021-08-17 Yantian Zha , Siddhant Bhambri , Lin Guan

We introduce CRAFT, a neuro-symbolic framework for interpretable affordance grounding, which identifies the objects in a scene that enable a given action (e.g., "cut"). CRAFT integrates structured commonsense priors from ConceptNet and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhou Chen , Joe Lin , Sathyanarayanan N. Aakur

Learning object affordances is an effective tool in the field of robot learning. While the data-driven models investigate affordances of single or paired objects, there is a gap in the exploration of affordances of compound objects composed…

Robotics · Computer Science 2024-12-18 Tuba Girgin , Emre Ugur

Visual modes of communication are ubiquitous in modern life --- from maps to data plots to political cartoons. Here we investigate drawing, the most basic form of visual communication. Participants were paired in an online environment to…

Other Computer Science · Computer Science 2019-12-17 Judith Fan , Robert Hawkins , Mike Wu , Noah Goodman

Visual representation learning has been a cornerstone in computer vision, involving typical forms such as visual embeddings, structural symbols, and text-based representations. Despite the success of CLIP-type visual embeddings, they often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yiwu Zhong , Zi-Yuan Hu , Michael R. Lyu , Liwei Wang

In recent years, considerable work has been devoted to explaining predictive, deep learning-based models, and in turn how to evaluate explanations. An important class of evaluation methods are ones that are human-centered, which typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yayan Zhao , Mingwei Li , Matthew Berger

The field of functional recognition or affordance estimation from images has seen a revival in recent years. As originally proposed by Gibson, the affordances of a scene were directly perceived from the ambient light: in other words,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-06 David F. Fouhey , Xiaolong Wang , Abhinav Gupta

How do people internalize visualizations: as images or information? In this study, we investigate the nature of internalization for visualizations (i.e., how the mind encodes visualizations in memory) and how memory encoding affects its…

Human-Computer Interaction · Computer Science 2023-07-24 Anjana Arunkumar , Lace Padilla , Gi-Yeul Bae , Chris Bryan

Lexical semantics and cognitive science point to affordances (i.e. the actions that objects support) as critical for understanding and representing nouns and verbs. However, study of these semantic features has not yet been integrated with…

Computation and Language · Computer Science 2022-07-07 Jack Merullo , Dylan Ebert , Carsten Eickhoff , Ellie Pavlick

As visualization researchers evaluate the impact of visualization design on decision-making, they often hold a one-dimensional perspective on the cognitive processes behind making a decision. Several psychological and economical researchers…

Human-Computer Interaction · Computer Science 2020-10-09 Melanie Bancilhon , Alvitta Ottley

Acquiring knowledge about object interactions and affordances can facilitate scene understanding and human-robot collaboration tasks. As humans tend to use objects in many different ways depending on the scene and the objects' availability,…

Artificial Intelligence · Computer Science 2023-04-13 Alexia Toumpa , Anthony G. Cohn