English
Related papers

Related papers: MUSEFood: Multi-sensor-based Food Volume Estimatio…

200 papers

Camera-based passive dietary intake monitoring is able to continuously capture the eating episodes of a subject, recording rich visual information, such as the type and volume of food being consumed, as well as the eating behaviours of the…

Smartphone clip-on microscopes turn everyday devices into low-cost, portable imaging systems that can even reveal fungal structures at the microscopic level, enabling mold inspection beyond unaided visual checks. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Dinh Nam Pham , Leonard Prokisch , Bennet Meyer , Jonas Thumbs

The progress in artificial intelligence and machine learning algorithms over the past decade has enabled the development of new methods for the objective measurement of eating, including both the measurement of eating episodes as well as…

Human-Computer Interaction · Computer Science 2022-06-08 Christos Diou , Konstantinos Kyritsis , Vasileios Papapanagiotou , Ioannis Sarafis

Deep learning based methods have achieved impressive results in many applications for image-based diet assessment such as food classification and food portion size estimation. However, existing methods only focus on one task at a time,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Jiangpeng He , Zeman Shao , Janine Wright , Deborah Kerr , Carol Boushey , Fengqing Zhu

Assessing dietary intake accurately remains an open and challenging research problem. In recent years, image-based approaches have been developed to automatically estimate food intake by capturing eat occasions with mobile devices and…

Information Retrieval · Computer Science 2019-10-16 Zeman Shao , Runyu Mao , Fengqing Zhu

Diet is an important aspect of our health. Good dietary habits can contribute to the prevention of many diseases and improve the overall quality of life. To better understand the relationship between diet and health, image-based dietary…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Yue Han , Sri Kalyan Yarlagadda , Tonmoy Ghosh , Fengqing Zhu , Edward Sazonov , Edward J. Delp

Accurate dietary monitoring is essential for promoting healthier eating habits. A key area of research is how people interact and consume food using utensils and hands. By tracking their position and orientation, it is possible to estimate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Kevin Tan , Fan Yang , Yuhao Chen

Food image segmentation is a critical task for dietary analysis, enabling accurate estimation of food volume and nutrients. However, current methods suffer from limited multi-view data and poor generalization to new viewpoints. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Ahmad AlMughrabi , Guillermo Rivo , Carlos Jiménez-Farfán , Umair Haroon , Farid Al-Areqi , Hyunjun Jung , Benjamin Busam , Ricardo Marques , Petia Radeva

Accurate food intake monitoring is crucial for maintaining a healthy diet and preventing nutrition-related diseases. With the diverse range of foods consumed across various cultures, classic food classification models have limitations due…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hassan Kazemi Tehrani , Jun Cai , Abbas Yekanlou , Sylvia Santosa

The rise of chronic diseases related to diet, such as obesity and diabetes, emphasizes the need for accurate monitoring of food intake. While AI-driven dietary assessment has made strides in recent years, the ill-posed nature of recovering…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Gautham Vinod , Bruce Coburn , Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

We aim to estimate food portion size, a property that is strongly related to the presence of food object in 3D space, from single monocular images under real life setting. Specifically, we are interested in end-to-end estimation of food…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Zeman Shao , Shaobo Fang , Runyu Mao , Jiangpeng He , Janine Wright , Deborah Kerr , Carol Jo Boushey , Fengqing Zhu

We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses to track fine-grained dietary actions. MunchSonic emits inaudible ultrasonic waves from the eyeglass frame, with the reflected signals…

Human-Computer Interaction · Computer Science 2024-08-06 Saif Mahmud , Devansh Agarwal , Ashwin Ajit , Qikang Liang , Thalia Viranda , Francois Guimbretiere , Cheng Zhang

What we eat is one of the most frequent and important health decisions we make in daily life, yet it remains notoriously difficult to capture and understand. Effective food journaling is thus a grand challenge in personal health…

Human-Computer Interaction · Computer Science 2017-02-24 Shubham Goyal , Qi Liu , Khairina Tajul-Arifin , Waqas Awan , Bimlesh Wadhwa , Zhenguang Liu

Humans routinely infer taste, smell, texture, and even sound from food images a phenomenon well studied in cognitive science. However, prior vision language research on food has focused primarily on recognition tasks such as meal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sabab Ishraq , Aarushi Aarushi , Juncai Jiang , Chen Chen

An important aspect of health monitoring is effective logging of food consumption. This can help management of diet-related diseases like obesity, diabetes, and even cardiovascular diseases. Moreover, food logging can help fitness…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Doyen Sahoo , Wang Hao , Shu Ke , Wu Xiongwei , Hung Le , Palakorn Achananuparp , Ee-Peng Lim , Steven C. H. Hoi

The nutritional quality of diets has significantly deteriorated over the past two to three decades, a decline often underestimated by the people. This deterioration, coupled with a hectic lifestyle, has contributed to escalating health…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Assylzhan Izbassar , Pakizar Shamoi

While the task of automatically detecting eating events has been examined in prior work using various wearable devices, the use of smartphones as standalone devices to infer eating events remains an open issue. This paper proposes a…

Human-Computer Interaction · Computer Science 2022-06-01 Wageesha Bangamuarachchi , Anju Chamantha , Lakmal Meegahapola , Salvador Ruiz-Correa , Indika Perera , Daniel Gatica-Perez

Malnutrition poses a significant threat to global health, resulting from an inadequate intake of essential nutrients that adversely impacts vital organs and overall bodily functioning. Periodic examinations and mass screenings,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Ashish Marisetty , Prathistith Raj M , Praneeth Nemani , Venkanna Udutalapally , Debanjan Das

Food image classification is the fundamental step in image-based dietary assessment, which aims to estimate participants' nutrient intake from eating occasion images. A common challenge of food images is the intra-class diversity and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Xinyue Pan , Jiangpeng He , Fengqing Zhu

This work proposes for the first time to utilize the regular smartphone -- a popular assistive gadget -- to design a novel, non-invasive method for self-monitoring of one's hydration level on a scale of 1 to 4. The proposed method involves…

Signal Processing · Electrical Eng. & Systems 2024-12-04 Rose Alaslani , Levina Perzhilla , Muhammad Mahboob Ur Rahman , Taous-Meriem Laleg-Kirati , Tareq Y. Al-Naffouri