English
Related papers

Related papers: Inventions on GUI for Touch Sensitive Screens

200 papers

Intelligent interaction with the physical world requires perceptual abilities beyond vision and hearing; vibrant tactile sensing is essential for autonomous robots to dexterously manipulate unfamiliar objects or safely contact humans.…

Robotics · Computer Science 2023-04-24 Iris Andrussow , Huanbo Sun , Katherine J. Kuchenbecker , Georg Martius

Assistive devices for indivuals with upper-limb movement often lack controllability and intuitiveness, in particular for grasping function. In this work, we introduce a novel user interface for grasping movement control in which the user…

Quantitative Methods · Quantitative Biology 2023-06-28 Etienne Moullet , François Bailly , Justin Carpentier , Christine Azevedo Coste

Current web accessibility guidelines ask visualization designers to support screen readers via basic non-visual alternatives like textual descriptions and access to raw data tables. But charts do more than summarize data or reproduce…

Human-Computer Interaction · Computer Science 2022-05-11 Jonathan Zong , Crystal Lee , Alan Lundgard , JiWoong Jang , Daniel Hajas , Arvind Satyanarayan

This work presents One-press control, a tactile input method for pressure-sensitive keyboards based on the detection and classification of pressing movements on the already held-down key. To seamlessly integrate the added control input with…

Human-Computer Interaction · Computer Science 2021-07-30 Staas de Jong , Jeroen Jillissen , Dünya Kirkali , Alwin de Rooij , Hanna Schraffenberger , Arnout Terpstra

During social interactions, people use auditory, visual, and haptic cues to convey their thoughts, emotions, and intentions. Due to weight, energy, and other hardware constraints, it is difficult to create devices that completely capture…

Human-Computer Interaction · Computer Science 2021-12-01 M. Salvato , Sophia R. Williams , Cara M. Nunez , Xin Zhu , Ali Israr , Frances Lau , Keith Klumb , Freddy Abnousi , Allison M. Okamura , Heather Culbertson

The ubiquity and on-the-go availability of mobile devices makes them central to many tasks such as interpersonal communication and media consumption. However, despite the potential of mobile devices for on-demand exploratory data…

Human-Computer Interaction · Computer Science 2024-04-18 Luke S. Snyder , Ryan A. Rossi , Eunyee Koh , Jeffrey Heer , Jane Hoffswell

Touchscreen-based electronic devices such as smart phones and smart tablets are widely used in our daily life. While the security of electronic devices have been heavily investigated recently, the resilience of touchscreens against various…

Cryptography and Security · Computer Science 2024-02-06 Haoqi Shan , Boyi Zhang , Zihao Zhan , Dean Sullivan , Shuo Wang , Yier Jin

Developing and testing user interfaces (UIs) and training AI agents to interact with them are challenging due to the dynamic and diverse nature of real-world mobile environments. Existing methods often rely on cumbersome physical devices or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jiannan Xiang , Yun Zhu , Lei Shu , Maria Wang , Lijun Yu , Gabriel Barcik , James Lyon , Srinivas Sunkara , Jindong Chen

This paper presents Finger Based Technique (FBT) prototypes, a novel interaction system for blind users, which is especially designed and developed for non-visual touch screen devices and their applications. The FBT prototypes were…

Human-Computer Interaction · Computer Science 2017-08-18 Mohammed Fakrudeen , Sufian Yousef , Mahdi H Miraz

A recent technology known as transparent screens is transforming windows into displays. These smart windows are present in buses, airports and offices. They can remain transparent, as a normal window, or display relevant information that…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Seyed Keyarash Ghiasi , Marco Kaldenbach , Marco Zuniga

One-handed use of smartphones is a common scenario in daily life. However, use of smartphones with thumb gives limited reachability to the complete screen. This problem is more severe when targets are located at corners of the device or far…

Human-Computer Interaction · Computer Science 2022-08-19 Siddharth Mehrotra , Saurav Das , Sourabh Zanwar

Tactile sensing has seen a rapid adoption with the advent of vision-based tactile sensors. Vision-based tactile sensors provide high resolution, compact and inexpensive data to perform precise in-hand manipulation and human-robot…

Robotics · Computer Science 2021-07-26 Arpit Agarwal , Tim Man , Wenzhen Yuan

The process of developing a mobile application typically starts with the ideation and conceptualization of its user interface. This concept is then translated into a set of mock-ups to help determine how well the user interface embodies the…

Software Engineering · Computer Science 2019-01-07 Carlos Bernal-Cardenas , Kevin Moran , Michele Tufano , Zichang Liu , Linyong Nan , Zhehan Shi , Denys Poshyvanyk

As computers become more ubiquitous, traditional two-dimensional interfaces must be replaced with interfaces based on a three-dimensional metaphor. However, these interfaces must still be as simple and functional as their two-dimensional…

Human-Computer Interaction · Computer Science 2007-05-23 Tony Chang , Damon Cook , Ramona Su

Capacitive technology allows building sensors that are small, compact and have high sensitivity. For this reason it has been widely adopted in robotics. In a previous work we presented a compliant skin system based on capacitive technology…

Robotics · Computer Science 2021-06-30 Perla Maiolino , Marco Maggiali , Giorgio Cannata , Giorgio Metta , Lorenzo Natale

Tactile perception using vibration sensation helps robots recognize their environment's physical properties and perform complex tasks. A sliding motion is applied to target objects to generate tactile vibration data. However, situations…

Robotics · Computer Science 2021-04-21 Naoto Komeno , Takamitsu Matsubara

Human tactile perception of materials relies on complex multisensory touch cues, yet the relationship between low-level tactile signals and perceptual representations remains poorly understood. This knowledge gap hinders the integration of…

Robotics · Computer Science 2026-05-29 Li Zou , Yasemin Vardar

Expressive writing is an established approach for stress management. Recently, information technologies, such as smartphones, have also been explored for expressive writing. Although mobile interfaces have the potential to support various…

Human-Computer Interaction · Computer Science 2025-09-22 Shunpei Norihama , Shixian Geng , Kakeru Miyazaki , Arissa J. Sato , Mari Hirano , Simo Hosio , Koji Yatani

Despite their growing popularity, many public kiosks with touchscreens are inaccessible to blind people. Toucha11y is a working prototype that allows blind users to use existing inaccessible touchscreen kiosks independently and with little…

Robotics · Computer Science 2023-05-09 Jiasheng Li , Zeyu Yan , Arush Shah , Jonathan Lazar , Huaishu Peng

We introduce a novel approach to control physical lighting parameters by means of a pressure-sensitive touchpad. The two-dimensional area of the touchpad is subdivided into 5 virtual sliders, each controlling the intensity of a color (red,…

Human-Computer Interaction · Computer Science 2007-05-23 Alexander Haubold