English
Related papers

Related papers: A Closed-Loop Multi-Agent System Driven by LLMs fo…

200 papers

Students' mental well-being is vital for academic success, with activities such as studying, socializing, and sleeping playing a role. Current mobile sensing data highlight this intricate link using statistical and machine learning…

Human-Computer Interaction · Computer Science 2025-08-11 Wayupuk Sommuang , Kun Kerdthaisong , Pasin Buakhaw , Aslan B. Wong , Nutchanon Yongsatianchot

Nutrition estimation is crucial for effective dietary management and overall health and well-being. Existing methods often struggle with sub-optimal accuracy and can be time-consuming. In this paper, we propose NuNet, a transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zhengyi Kwan , Wei Zhang , Zhengkui Wang , Aik Beng Ng , Simon See

Our research investigates the capability of modern multimodal reasoning models, powered by Large Language Models (LLMs), to facilitate vision-powered assistants for multi-step daily activities. Such assistants must be able to 1) encode…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Mrinal Verghese , Brian Chen , Hamid Eghbalzadeh , Tushar Nagarajan , Ruta Desai

Accurate dietary assessment is critical for precision nutrition, yet most image-based methods rely on a single pre-consumption image and provide only coarse, meal-level estimates. These approaches cannot determine what was actually consumed…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Gautham Vinod , Siddeshwar Raghavan , Bruce Coburn , Fengqing Zhu

Worldwide, in 2014, more than 1.9 billion adults, 18 years and older, were overweight. Of these, over 600 million were obese. Accurately documenting dietary caloric intake is crucial to manage weight loss, but also presents challenges…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Chang Liu , Yu Cao , Yan Luo , Guanling Chen , Vinod Vokkarane , Yunsheng Ma

Food image classification serves as the foundation of image-based dietary assessment to predict food categories. Since there are many different food classes in real life, conventional models cannot achieve sufficiently high accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Xinyue Pan , Jiangpeng He , Andrew Peng , Fengqing Zhu

Food volume estimation is an essential step in the pipeline of dietary assessment and demands the precise depth estimation of the food surface and table plane. Existing methods based on computer vision require either multi-image input or…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Ya Lu , Thomai Stathopoulou , Stavroula Mougiakakou

Maintaining health and fitness through a balanced diet is essential for preventing non communicable diseases such as heart disease, diabetes, and cancer. NutriVision combines smart healthcare with computer vision and machine learning to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Madhumita Veeramreddy , Ashok Kumar Pradhan , Swetha Ghanta , Laavanya Rachakonda , Saraju P Mohanty

The nutritional quality of diets has significantly deteriorated over the past two to three decades, a decline often underestimated by the people. This deterioration, coupled with a hectic lifestyle, has contributed to escalating health…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Assylzhan Izbassar , Pakizar Shamoi

LLM-based agents have demonstrated strong potential for autonomous machine learning, yet their applicability to health data remains limited. Existing systems often struggle to generalize across heterogeneous health data modalities, rely…

Artificial Intelligence · Computer Science 2026-02-03 Tong Xia , Weibin Li , Gang Liu , Yong Li

Diet plays a central role in human health, and Nutrition Question Answering (QA) offers a promising path toward personalized dietary guidance and the prevention of diet-related chronic diseases. However, existing methods face two…

Computation and Language · Computer Science 2025-10-14 Kaiwen Shi , Zheyuan Zhang , Zhengqing Yuan , Keerthiram Murugesan , Vincent Galass , Chuxu Zhang , Yanfang Ye

The absence of food monitoring has contributed significantly to the increase in the population's weight. Due to the lack of time and busy routines, most people do not control and record what is consumed in their diet. Some solutions have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Charles N. C. Freitas , Filipe R. Cordeiro , Valmir Macario

Food classification is critical to the analysis of nutrients comprising foods reported in dietary assessment. Advances in mobile and wearable sensors, combined with new image based methods, particularly deep learning based approaches, have…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Zeman Shao , Jiangpeng He , Ya-Yuan Yu , Luotao Lin , Alexandra Cowan , Heather Eicher-Miller , Fengqing Zhu

BACKGROUND: Most artificial intelligence tools used to estimate nutritional content rely on image input. However, whether large language models (LLMs) can accurately predict nutritional values based solely on text descriptions of foods…

Machine Learning · Computer Science 2025-09-17 Rodrigo M Carrillo-Larco

Creating personalized and actionable exercise plans often requires iteration with experts, which can be costly and inaccessible to many individuals. This work explores the capabilities of Large Language Models (LLMs) in addressing these…

Human-Computer Interaction · Computer Science 2025-05-20 Donghoon Shin , Gary Hsieh , Young-Ho Kim

Diet quality is a leading determinant of chronic disease risk. Advances in artificial intelligence (AI) have enabled food recommendation systems to adapt suggestions to user preferences and health goals. However, most current systems rely…

Information Retrieval · Computer Science 2026-05-18 Yibin Wang , Yanjie Yang , Grace Melo Guerrero , Rodolfo M. Nayga , Azlan Zahid

The increasing trust in large language models (LLMs), especially in the form of chatbots, is often undermined by the lack of their extrinsic evaluation. This holds particularly true in nutrition, where randomised controlled trials (RCTs)…

Human-Computer Interaction · Computer Science 2025-11-27 Karen Jia-Hui Li , Simone Balloccu , Ondrej Dusek , Ehud Reiter

Agents centered around Large Language Models (LLMs) are now capable of automating mobile device operations for users. After fine-tuning to learn a user's mobile operations, these agents can adhere to high-level user instructions online.…

Human-Computer Interaction · Computer Science 2024-01-18 Tinghe Ding

In this article, we evaluate four Large Language Models (LLMs) and their effectiveness at retrieving data within a specialized Retrieval-Augmented Generation (RAG) system, using a comprehensive food composition database. Our method is…

Computation and Language · Computer Science 2026-03-12 Maks Požarnik Vavken , Matevž Ogrinc , Tome Eftimov , Barbara Koroušić Seljak

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…