English
Related papers

Related papers: Dietary Assessment with Multimodal ChatGPT: A Syst…

200 papers

This study utilizes the advanced capabilities of the GPT-4 multimodal Large Language Model (LLM) to explore its potential in iris recognition - a field less common and more specialized than face recognition. By focusing on this niche yet…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Parisa Farmanifard , Arun Ross

The utilisation of AI-driven tools, notably ChatGPT, within academic research is increasingly debated from several perspectives including ease of implementation, and potential enhancements in research efficiency, as against ethical concerns…

Human-Computer Interaction · Computer Science 2024-05-16 Aleksei Turobov , Diane Coyle , Verity Harding

Recent advances in large language models (LLMs) have enabled general-purpose systems to perform increasingly complex domain-specific reasoning without extensive fine-tuning. In the medical domain, decision-making often requires integrating…

Computation and Language · Computer Science 2025-08-14 Shansong Wang , Mingzhe Hu , Qiang Li , Mojtaba Safari , Xiaofeng Yang

OpenAI's large multimodal model, GPT-4V(ision), was recently developed for general image interpretation. However, less is known about its capabilities with medical image interpretation and diagnosis. Board-certified physicians and senior…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Senthujan Senkaiahliyan , Augustin Toma , Jun Ma , An-Wen Chan , Andrew Ha , Kevin R. An , Hrishikesh Suresh , Barry Rubin , Bo Wang

Generalist Medical AI (GMAI) systems have demonstrated expert-level performance in biomedical perception tasks, yet their clinical utility remains limited by inadequate multi-modal explainability and suboptimal prognostic capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Honglong Yang , Shanshan Song , Yi Qin , Lehan Wang , Haonan Wang , Xinpeng Ding , Qixiang Zhang , Bodong Du , Xiaomeng Li

Assessment of dietary intake has primarily relied on self-report instruments, which are prone to measurement errors. Dietary assessment methods have increasingly incorporated technological advances particularly mobile, image based…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Gautham Vinod , Zeman Shao , Fengqing Zhu

Given their ability for advanced reasoning, extensive contextual understanding, and robust question-answering abilities, large language models have become prominent in healthcare management research. Despite adeptly handling a broad…

Artificial Intelligence · Computer Science 2025-01-15 Waqar Hussain , John Grundy

Many aging individuals encounter challenges in effectively tracking their dietary intake, exacerbating their susceptibility to nutrition-related health complications. Self-reporting methods are often inaccurate and suffer from substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Matthew Keller , Chi-en Amy Tai , Yuhao Chen , Pengcheng Xi , Alexander Wong

We investigate the multilingual and multimodal performance of a large language model-based artificial intelligence (AI) system, GPT-4o, using a diverse set of physics concept inventories spanning multiple languages and subject categories.…

Physics Education · Physics 2025-07-14 Gerd Kortemeyer , Marina Babayeva , Giulia Polverini , Ralf Widenhorn , Bor Gregorcic

Regular nutrient intake monitoring in hospitalised patients plays a critical role in reducing the risk of disease-related malnutrition (DRM). Although several methods to estimate nutrient intake have been developed, there is still a clear…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ya Lu , Thomai Stathopoulou , Maria F. Vasiloglou , Stergios Christodoulidis , Beat Blum , Thomas Walser , Vinzenz Meier , Zeno Stanga , Stavroula G. Mougiakakou

This study introduces Purrfessor, an innovative AI chatbot designed to provide personalized dietary guidance through interactive, multimodal engagement. Leveraging the Large Language-and-Vision Assistant (LLaVA) model fine-tuned with food…

Human-Computer Interaction · Computer Science 2024-11-25 Linqi Lu , Yifan Deng , Chuan Tian , Sijia Yang , Dhavan Shah

The Poultry industry plays a vital role in global food security, yet small- and medium-scale farmers frequently lack timely access to expert-level support for disease diagnosis, nutrition planning, and management decisions. With rising…

Human-Computer Interaction · Computer Science 2025-12-11 Kapalik Khanal , Biswash Khatiwada , Stephen Afrifa , Ranjan Sapkota , Sanjay Shah , Frank Bai , Ramesh Bahadur Bist

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Deep learning based methods have achieved impressive results in many applications for image-based diet assessment such as food classification and food portion size estimation. However, existing methods only focus on one task at a time,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Jiangpeng He , Zeman Shao , Janine Wright , Deborah Kerr , Carol Boushey , Fengqing Zhu

ChatGPT explores a strategic blueprint of question answering (QA) in delivering medical diagnosis, treatment recommendations, and other healthcare support. This is achieved through the increasing incorporation of medical domain data via…

Computation and Language · Computer Science 2024-01-23 Qing Li , Lei Li , Yu Li

Recently, it has been recognized that large language models demonstrate high performance on various intellectual tasks. However, few studies have investigated alignment with humans in behaviors that involve sensibility, such as aesthetic…

Artificial Intelligence · Computer Science 2024-03-07 Yoshia Abe , Tatsuya Daikoku , Yasuo Kuniyoshi

Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The…

ChatGPT, the most accessible generative artificial intelligence (AI) tool, offers considerable potential for veterinary medicine, yet a dedicated review of its specific applications is lacking. This review concisely synthesizes the latest…

Computers and Society · Computer Science 2024-05-24 Candice P. Chu

Classroom observation protocols standardize the assessment of teaching effectiveness and facilitate comprehension of classroom interactions. Whereas these protocols offer teachers specific feedback on their teaching practices, the manual…

Human-Computer Interaction · Computer Science 2024-07-04 Ruikun Hou , Tim Fütterer , Babette Bühler , Efe Bozkir , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

Applications of large language models (LLMs) like ChatGPT have potential to enhance clinical decision support through conversational interfaces. However, challenges of human-algorithmic interaction and clinician trust are poorly understood.…