English
Related papers

Related papers: Leveraging Human Salience to Improve Calorie Estim…

200 papers

Many aging individuals encounter challenges in effectively tracking their dietary intake, exacerbating their susceptibility to nutrition-related health complications. Self-reporting methods are often inaccurate and suffer from substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Matthew Keller , Chi-en Amy Tai , Yuhao Chen , Pengcheng Xi , Alexander Wong

In this paper, we show that existing recognition and localization deep architectures, that have not been exposed to eye tracking data or any saliency datasets, are capable of predicting the human visual saliency. We term this as implicit…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Yutong Sun , Mohit Prabhushankar , Ghassan AlRegib

We aim to estimate food portion size, a property that is strongly related to the presence of food object in 3D space, from single monocular images under real life setting. Specifically, we are interested in end-to-end estimation of food…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Zeman Shao , Shaobo Fang , Runyu Mao , Jiangpeng He , Janine Wright , Deborah Kerr , Carol Jo Boushey , Fengqing Zhu

Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Carola Figueroa-Flores , David Berga , Joost van der Weijer , Bogdan Raducanu

Incorporating human-perceptual intelligence into model training has shown to increase the generalization capability of models in several difficult biometric tasks, such as presentation attack detection (PAD) and detection of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Colton R. Crum , Samuel Webster , Adam Czajka

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Saliency prediction models are constrained by the limited diversity and quantity of labeled data. Standard data augmentation techniques such as rotating and cropping alter scene composition, affecting saliency. We propose a novel data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

In this paper, we will investigate the contribution of color names for the task of salient object detection. An input image is first converted to color name space, which is consisted of 11 probabilistic channels. By exploiting a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Jing Lou , Huan Wang , Longtao Chen , Fenglei Xu , Qingyuan Xia , Wei Zhu , Mingwu Ren

Deep learning has driven remarkable accuracy increases in many computer vision problems. One ongoing challenge is how to achieve the greatest accuracy in cases where training data is limited. A second ongoing challenge is that trained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Aidan Boyd , Kevin Bowyer , Adam Czajka

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

Thermal images are mainly used to detect the presence of people at night or in bad lighting conditions, but perform poorly at daytime. To solve this problem, most state-of-the-art techniques employ a fusion network that uses features from…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Debasmita Ghose , Shasvat Mukeshkumar Desai , Sneha Bhattacharya , Deep Chakraborty , Madalina Fiterau , Tauhidur Rahman

Humans routinely infer taste, smell, texture, and even sound from food images a phenomenon well studied in cognitive science. However, prior vision language research on food has focused primarily on recognition tasks such as meal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sabab Ishraq , Aarushi Aarushi , Juncai Jiang , Chen Chen

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

Due to the growing concern of chronic diseases and other health problems related to diet, there is a need to develop accurate methods to estimate an individual's food and energy intake. Measuring accurate dietary intake is an open research…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Shaobo Fang , Zeman Shao , Runyu Mao , Chichen Fu , Deborah A. Kerr , Carol J. Boushey , Edward J. Delp , Fengqing Zhu

Recently, the philosophy of visual saliency and attention has started to gain popularity in the robotics community. Therefore, this paper aims to mimic this mechanism in SLAM framework by using saliency prediction model. Comparing with…

Robotics · Computer Science 2020-12-23 Ke Wang , Sai Ma , Junlan Chen , Jianbo Lu

Salient object detection has been long studied to identify the most visually attractive objects in images/videos. Recently, a growing amount of approaches have been proposed all of which rely on the contour/edge information to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Yue Song , Hao Tang , Nicu Sebe , Wei Wang

Food image analysis is the groundwork for image-based dietary assessment, which is the process of monitoring what kinds of food and how much energy is consumed using captured food or eating scene images. Existing deep learning-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrew Peng , Jiangpeng He , Fengqing Zhu

The absence of food monitoring has contributed significantly to the increase in the population's weight. Due to the lack of time and busy routines, most people do not control and record what is consumed in their diet. Some solutions have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Charles N. C. Freitas , Filipe R. Cordeiro , Valmir Macario

Data-driven saliency has recently gained a lot of attention thanks to the use of Convolutional Neural Networks for predicting gaze fixations. In this paper we go beyond standard approaches to saliency prediction, in which gaze maps are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara