English
Related papers

Related papers: Tappy Plugin for Figma: Predicting Tap Success Rat…

200 papers

We propose a method to make mobile screenshots easily searchable. In this paper, we present the workflow in which we: 1) preprocessed a collection of screenshots, 2) identified script presentin image, 3) extracted unstructured text from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Sumit Kumar , Gopi Ramena , Manoj Goyal , Debi Mohanty , Ankur Agarwal , Benu Changmai , Sukumar Moharana

Modern smartphones contain motion sensors, such as accelerometers and gyroscopes. These sensors have many useful applications; however, they can also be used to uniquely identify a phone by measuring anomalies in the signals, which are a…

Cryptography and Security · Computer Science 2015-03-09 Anupam Das , Nikita Borisov , Matthew Caesar

Spatial information can be difficult to present to a visually impaired computer user. In this paper we examine a new kind of tactile cueing for non-visual interaction as a potential solution, building on earlier work on vibrotactile…

Human-Computer Interaction · Computer Science 2012-02-20 Thomas Pietrzak , Andrew Crossan , Brewster A. Stephen , Benoît Martin , Isabelle Pecci

One of the key challenges in the field of haptic research is designing plausible stimuli using haptic interfaces with limited degrees of freedom. Although the plausible approach, which simplifies and/or exaggerates stimuli to enhance…

Human-Computer Interaction · Computer Science 2024-11-11 Ryotaro Ishikawa , Taku Hachisu

Object manipulation is fundamental to virtual reality (VR) applications, yet conventional fingertip haptic devices fail to render certain tactile features relevant for immersive and precise interactions, as i.e. detection of edges. This…

Robotics · Computer Science 2026-04-02 Rui Chen , Xianlong Mai , Alireza Sanaei , Domenico Chiaradia , Antonio Frisoli , Daniele Leonardis

This paper introduces Aptly, a platform designed to democratize mobile app development, particularly for young learners. Aptly integrates a Large Language Model (LLM) with App Inventor, enabling users to create apps using their natural…

Human-Computer Interaction · Computer Science 2025-06-17 Evan W. Patton , David Y. J. Kim , Ashley Granquist , Robin Liu , Arianna Scott , Jennet Zamanova , Harold Abelson

Excessive use of smartphones is a worldwide known issue. In this study, we proposed a notification-based intervention approach to reduce smartphone overuse without making the user feel any annoyance or irritation. Most of the work in this…

Human-Computer Interaction · Computer Science 2025-07-22 Partha Sarker , Dipto Dey , Marium-E-Jannat

Smartphones have significantly enhanced our daily learning, communication, and entertainment, becoming an essential component of modern life. However, certain populations, including the elderly and individuals with disabilities, encounter…

Robotics · Computer Science 2024-09-17 Kelin Fu , Yang Tian , Kaigui Bian

In this paper we list the sensors commonly available in modern smartphones and provide a general outlook of the different ways these sensors can be used for modeling the interaction between human and smartphones. We then provide a taxonomy…

Cryptography and Security · Computer Science 2020-06-02 Alejandro Acien , Aythami Morales , Ruben Vera-Rodriguez , Julian Fierrez

We propose Secure Pick Up (SPU), a convenient, lightweight, in-device, non-intrusive and automatic-learning system for smartphone user authentication. Operating in the background, our system implicitly observes users' phone pick-up…

Cryptography and Security · Computer Science 2017-08-31 Wei-Han Lee , Xiaochen Liu , Yilin Shen , Hongxia Jin , Ruby B. Lee

Automated code instrumentation, i.e. the insertion of measurement hooks into a target application by the compiler, is an established technique for collecting reliable, fine-grained performance data. The set of functions to instrument has to…

Performance · Computer Science 2023-03-21 Sebastian Kreutzer , Christian Iwainsky , Marta Garcia-Gasulla , Victor Lopez , Christian Bischof

Developers prefer to utilize third-party libraries when they implement some functionalities and Application Programming Interfaces (APIs) are frequently used by them. Facing an unfamiliar API, developers tend to consult tutorials as…

Software Engineering · Computer Science 2017-03-07 He Jiang , Jingxuan Zhang , Xiaochen Li , Zhilei Ren , David Lo

Smartphone-based heart rate (HR) monitoring apps using finger-over-camera photoplethysmography (PPG) face significant challenges in performance evaluation and device compatibility due to device variability and fragmentation. Manual testing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ming-Zher Poh , Jonathan Wang , Jonathan Hsu , Lawrence Cai , Eric Teasley , James A. Taylor , Jameson K. Rogers , Anupam Pathak , Shwetak Patel

Screen recordings of mobile apps are a popular and readily available way for users to share how they interact with apps, such as in online tutorial videos, user reviews, or as attachments in bug reports. Unfortunately, both people and…

Human-Computer Interaction · Computer Science 2022-07-12 Jieshan Chen , Amanda Swearngin , Jason Wu , Titus Barik , Jeffrey Nichols , Xiaoyi Zhang

As the bridge between users and software, Graphical User Interface (GUI) is critical to the app accessibility. Scaling up the font or display size of GUI can help improve the visual impact, readability, and usability of an app, and is…

Software Engineering · Computer Science 2022-12-09 Yuhui Su , Chunyang Chen , Junjie Wang , Zhe Liu , Dandan Wang , Shoubin Li , Qing Wang

Vision-based tactile sensors have recently become popular due to their combination of low cost, very high spatial resolution, and ease of integration using widely available miniature cameras. The associated field of view and focal length,…

Nowadays, the development of Web applications supporting distributed user interfaces (DUI) is straightforward. However, it is still hard to find Web sites supporting this kind of user interaction. Although studies on this field have…

Human-Computer Interaction · Computer Science 2019-06-05 Sergio Firmenich , Gabriela Bosetti , Gustavo Rossi , Marco Winckler , José María Corletto

With the popularity of smartphones and tablets, users have become accustomed to using different devices for different tasks, such as using their phones to play games and tablets to watch movies. To conquer the market, one app is often…

Human-Computer Interaction · Computer Science 2023-11-07 Han Hu , Haolan Zhan , Yujin Huang , Di Liu

We present a simple yet potentially devastating and hard-to-detect threat, called Gummy Browsers, whereby the browser fingerprinting information can be collected and spoofed without the victim's awareness, thereby compromising the privacy…

Cryptography and Security · Computer Science 2021-10-20 Zengrui Liu , Prakash Shrestha , Nitesh Saxena

We explore a new domain of learning to infer user interface attributes that helps developers automate the process of user interface implementation. Concretely, given an input image created by a designer, we learn to infer its implementation…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Philippe Schlattner , Pavol Bielik , Martin Vechev