English
Related papers

Related papers: UMDFood: Vision-language models boost food composi…

200 papers

Automatic dietary assessment based on food images remains a challenge, requiring precise food detection, segmentation, and classification. Vision-Language Models (VLMs) offer new possibilities by integrating visual and textual reasoning. In…

Nutrition estimation is an important component of promoting healthy eating and mitigating diet-related health risks. Despite advances in tasks such as food classification and ingredient recognition, progress in nutrition estimation is…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Huiyan Qi , Bin Zhu , Chong-Wah Ngo , Jingjing Chen , Ee-Peng Lim

This study introduces a novel multimodal food recognition framework that effectively combines visual and textual modalities to enhance classification accuracy and robustness. The proposed approach employs a dynamic multimodal fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Prateek Mittal , Puneet Goyal , Joohi Chauhan

In the realm of food computing, segmenting ingredients from images poses substantial challenges due to the large intra-class variance among the same ingredients, the emergence of new ingredients, and the high annotation costs associated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiongwei Wu , Sicheng Yu , Ee-Peng Lim , Chong-Wah Ngo

In response to the increasing demand for efficient and non-invasive methods to estimate food weight, this paper presents a vision-based approach utilizing 2D images. The study employs a dataset of 2380 images comprising fourteen different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Chathura Wimalasiri , Prasan Kumar Sahoo

Food computing is both important and challenging in computer vision (CV). It significantly contributes to the development of CV algorithms due to its frequent presence in datasets across various applications, ranging from classification and…

77% of adults over 50 want to age in place today, presenting a major challenge to ensuring adequate nutritional intake. It has been reported that one in four older adults that are 65 years or older are malnourished and given the direct link…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Chi-en Amy Tai , Matthew Keller , Mattie Kerrigan , Yuhao Chen , Saeejith Nair , Pengcheng Xi , Alexander Wong

Malnutrition is a multidomain problem affecting 54% of older adults in long-term care (LTC). Monitoring nutritional intake in LTC is laborious and subjective, limiting clinical inference capabilities. Recent advances in automatic…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Kaylen J Pfisterer , Robert Amelard , Audrey G Chung , Braeden Syrnyk , Alexander MacLean , Heather H Keller , Alexander Wong

Accurate dietary assessment is critical for precision nutrition, yet most image-based methods rely on a single pre-consumption image and provide only coarse, meal-level estimates. These approaches cannot determine what was actually consumed…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Gautham Vinod , Siddeshwar Raghavan , Bruce Coburn , Fengqing Zhu

Background: Maintaining a healthy diet is vital to avoid health-related issues, e.g., undernutrition, obesity and many non-communicable diseases. An indispensable part of the health diet is dietary assessment. Traditional manual recording…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Wei Wang , Weiqing Min , Tianhao Li , Xiaoxiao Dong , Haisheng Li , Shuqiang Jiang

Food image segmentation is a critical and indispensible task for developing health-related applications such as estimating food calories and nutrients. Existing food image segmentation models are underperforming due to two reasons: (1)…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xiongwei Wu , Xin Fu , Ying Liu , Ee-Peng Lim , Steven C. H. Hoi , Qianru Sun

Image-based dietary assessment refers to the process of determining what someone eats and how much energy and nutrients are consumed from visual data. Food classification is the first and most crucial step. Existing methods focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Runyu Mao , Jiangpeng He , Luotao Lin , Zeman Shao , Heather A. Eicher-Miller , Fengqing Zhu

Dietary studies showed that dietary-related problem such as obesity is associated with other chronic diseases like hypertension, irregular blood sugar levels, and increased risk of heart attacks. The primary cause of these problems is poor…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Ghalib Tahir , Chu Kiong Loo

A reasonable and balanced diet is essential for maintaining good health. With the advancements in deep learning, automated nutrition estimation method based on food images offers a promising solution for monitoring daily nutritional intake…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Yuzhe Han , Qimin Cheng , Wenjin Wu , Ziyang Huang

Food image classification is the fundamental step in image-based dietary assessment, which aims to estimate participants' nutrient intake from eating occasion images. A common challenge of food images is the intra-class diversity and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Xinyue Pan , Jiangpeng He , Fengqing Zhu

Dietary intake estimation plays a crucial role in understanding the nutritional habits of individuals and populations, aiding in the prevention and management of diet-related health issues. Accurate estimation requires comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chi-en Amy Tai , Saeejith Nair , Olivia Markham , Matthew Keller , Yifan Wu , Yuhao Chen , Alexander Wong

Dietary assessment is a key contributor to monitoring health status. Existing self-report methods are tedious and time-consuming with substantial biases and errors. Image-based food portion estimation aims to estimate food energy values…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zeman Shao , Gautham Vinod , Jiangpeng He , Fengqing Zhu

Accurate estimation of food nutrition plays a vital role in promoting healthy dietary habits and personalized diet management. Most existing food datasets primarily focus on Western cuisines and lack sufficient coverage of Chinese dishes,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Dongjian Yu , Weiqing Min , Qian Jiang , Xing Lin , Xin Jin , Shuqiang Jiang

Cross-modal retrieval between food images and recipe texts is an important task with applications in nutritional management, dietary logging, and cooking assistance. Existing methods predominantly rely on dual-encoder architectures with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Keisuke Gomi , Keiji Yanai

Image-based methods to analyze food images have alleviated the user burden and biases associated with traditional methods. However, accurate portion estimation remains a major challenge due to the loss of 3D information in the 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Gautham Vinod , Jiangpeng He , Zeman Shao , Fengqing Zhu
‹ Prev 1 2 3 10 Next ›