English
Related papers

Related papers: Saliency Prediction for Mobile User Interfaces

200 papers

The process of developing a mobile application typically starts with the ideation and conceptualization of its user interface. This concept is then translated into a set of mock-ups to help determine how well the user interface embodies the…

Software Engineering · Computer Science 2019-01-07 Carlos Bernal-Cardenas , Kevin Moran , Michele Tufano , Zichang Liu , Linyong Nan , Zhehan Shi , Denys Poshyvanyk

We tackle the problem of predicting saliency maps for videos of dynamic scenes. We note that the accuracy of the maps reconstructed from the gaze data of a fixed number of observers varies with the frame, as it depends on the content of the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Ekta Prashnani , Orazio Gallo , Joohwan Kim , Josef Spjut , Pradeep Sen , Iuri Frosio

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Modern smart phones are becoming helpful in the areas of Internet-Of-Things (IoT) and ambient health intelligence. By learning data from several mobile sensors, we detect nearness of the human body to a mobile device in a three-dimensional…

Computers and Society · Computer Science 2016-11-18 Sylvester Olubolu Orimaye , Foo Chuan Leong , Chen Hui Lee , Eddy Cheng Han Ng

Tactile sensation is essential for contact-rich manipulation tasks. It provides direct feedback on object geometry, surface properties, and interaction forces, enhancing perception and enabling fine-grained control. An inherent limitation…

State-of-the-art saliency prediction methods develop upon model architectures or loss functions; while training to generate one target saliency map. However, publicly available saliency prediction datasets can be utilized to create more…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Sandeep Mishra , Oindrila Saha

Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated…

Robotics · Computer Science 2022-03-25 Ajith Anil Meera , Filip Novicky , Thomas Parr , Karl Friston , Pablo Lanillos , Noor Sajid

Mobile phones pervade our daily lives and play ever expanding roles in many contexts. Their ubiquitousness makes them pivotal in empowering disabled people. However, if no inclusive approaches are provided, it becomes a strong vehicle of…

Human-Computer Interaction · Computer Science 2014-02-06 Tiago Guerreiro

In recent years we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computational power of these…

Human-Computer Interaction · Computer Science 2023-07-04 Yaxiong Lei , Shijing He , Mohamed Khamis , Juan Ye

The movement of a user's face, easily detected by a smartphone's front camera, is an underexploited input modality for mobile interactions. We introduce three sets of face-engaged interaction techniques for augmenting the traditional mobile…

Human-Computer Interaction · Computer Science 2016-10-04 Jian Zhao , Ricardo Jota , Daniel Wigdor , Ravin Balakrishnan

Quantification of human attention is key to several tasks in mobile human-computer interaction (HCI), such as predicting user interruptibility, estimating noticeability of user interface content, or measuring user engagement. Previous works…

Human-Computer Interaction · Computer Science 2019-07-26 Mihai Bâce , Sander Staal , Andreas Bulling

Saliency maps can explain how deep neural networks classify images. But are they actually useful for humans? The present systematic review of 68 user studies found that while saliency maps can enhance human performance, null effects or even…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller

Humans' ability to detect and locate salient objects on images is remarkably fast and successful. Performing this process by using eye tracking equipment is expensive and cannot be easily applied, and computer modeling of this human…

Computer Vision and Pattern Recognition · Computer Science 2014-03-03 Hamdi Yalin Yalic

In high-stakes applications of machine learning models, interpretability methods provide guarantees that models are right for the right reasons. In medical imaging, saliency maps have become the standard tool for determining whether a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Jacob Pfau , Albert T. Young , Maria L. Wei , Michael J. Keiser

Mobile sensing plays a crucial role in generating digital traces to understand human daily lives. However, studying behaviours like mood or sleep quality in smartphone users requires carefully designed mobile sensing strategies such as…

Human-Computer Interaction · Computer Science 2024-08-23 Nan Gao , Zhuolei Yu , Yue Xu , Chun Yu , Yuntao Wang , Flora D. Salim , Yuanchun Shi

We present a novel approach for saliency prediction in images, leveraging parallel decoding in transformers to learn saliency solely from fixation maps. Models typically rely on continuous saliency maps, to overcome the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yasser Abdelaziz Dahou Djilali , Kevin McGuiness , Noel O'Connor

This paper reviews the Challenge on Video Saliency Prediction at AIM 2024. The goal of the participants was to develop a method for predicting accurate saliency maps for the provided set of video sequences. Saliency maps are widely…

Recent years have witnessed an explosive growth of mobile devices. Mobile devices are permeating every aspect of our daily lives. With the increasing usage of mobile devices and intelligent applications, there is a soaring demand for mobile…

Machine Learning · Computer Science 2018-09-12 Ji Wang , Bokai Cao , Philip S. Yu , Lichao Sun , Weidong Bao , Xiaomin Zhu

Image retargeting is the task of making images capable of being displayed on screens with different sizes. This work should be done so that high-level visual information and low-level features such as texture remain as intact as possible to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Mahdi Ahmadi , Nader Karimi , Shadrokh Samavi

Salient object detection is a prevalent computer vision task that has applications ranging from abnormality detection to abnormality processing. Context modelling is an important criterion in the domain of saliency detection. A global…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Kitty Varghese , Sauradip Nag