English
Related papers

Related papers: Dietary Assessment with Multimodal ChatGPT: A Syst…

200 papers

With the launch of ChatGPT, serious concerns have reasonably been raised of its ill-effect on the integrity of remote take-home exams. By way of mitigating the concern, in this study, a rather straightforward Artificial-Intelligence…

Physics Education · Physics 2023-06-06 P G Kubendran Amos

Large Multimodal Models (LMMs) have demonstrated impressive performance across various vision and language tasks, yet their potential applications in recommendation tasks with visual assistance remain unexplored. To bridge this gap, we…

Information Retrieval · Computer Science 2023-11-08 Peilin Zhou , Meng Cao , You-Liang Huang , Qichen Ye , Peiyan Zhang , Junling Liu , Yueqi Xie , Yining Hua , Jaeboum Kim

The emergence of large language models such as ChatGPT, Gemini, and others highlights the importance of evaluating their diverse capabilities, ranging from natural language understanding to code generation. However, their performance on…

Computation and Language · Computer Science 2025-01-06 Liuchang Xu , Shuo Zhao , Qingming Lin , Luyao Chen , Qianqian Luo , Sensen Wu , Xinyue Ye , Hailin Feng , Zhenhong Du

Food image analysis is the groundwork for image-based dietary assessment, which is the process of monitoring what kinds of food and how much energy is consumed using captured food or eating scene images. Existing deep learning-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrew Peng , Jiangpeng He , Fengqing Zhu

The recent breakthroughs in OpenAI's GPT4o model have demonstrated surprisingly good capabilities in image generation and editing, resulting in significant excitement in the community. This technical report presents the first-look…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Zhiyuan Yan , Junyan Ye , Weijia Li , Zilong Huang , Shenghai Yuan , Xiangyang He , Kaiqing Lin , Jun He , Conghui He , Li Yuan

The emergence of Large Multimodal Models (LMMs) marks a significant milestone in the development of artificial intelligence. Insurance, as a vast and complex discipline, involves a wide variety of data forms in its operational processes,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chenwei Lin , Hanjia Lyu , Jiebo Luo , Xian Xu

This paper does not present a novel method. Instead, it delves into an essential, yet must-know baseline in light of the latest advancements in Generative Artificial Intelligence (GenAI): the utilization of GPT-4 for visual understanding.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Wenhao Wu , Huanjin Yao , Mengxi Zhang , Yuxin Song , Wanli Ouyang , Jingdong Wang

Food security, a global concern, necessitates precise and diverse data-driven solutions to address its multifaceted challenges. This paper explores the integration of AI foundation models across various food security applications,…

Artificial Intelligence · Computer Science 2023-11-01 Mohamed R. Shoaib , Heba M. Emara , Jun Zhao

Reliance on images for dietary assessment is an important strategy to accurately and conveniently monitor an individual's health, making it a vital mechanism in the prevention and care of chronic diseases and obesity. However, image-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Gautham Vinod , Fengqing Zhu

Generative AI systems such as ChatGPT have a disruptive effect on learning and assessment. Computer science requires practice to develop skills in problem solving and programming that are traditionally developed using assignments.…

Computers and Society · Computer Science 2023-11-29 Kevin Wang , Seth Akins , Abdallah Mohammed , Ramon Lawrence

Food recommendation system has proven as an effective technology to provide guidance on dietary choices, and this is especially important for patients suffering from chronic diseases. Unlike other multimedia recommendations, such as books…

Information Retrieval · Computer Science 2022-10-18 Xinwei Ju , Frank Po Wen Lo , Jianing Qiu , Peilun Shi , Jiachuan Peng , Benny Lo

Significant progress has been made in advancing large multimodal conversational models (LMMs), capitalizing on vast repositories of image-text data available online. Despite this progress, these models often encounter substantial domain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Muhammad Awais , Ali Husain Salem Abdulla Alharthi , Amandeep Kumar , Hisham Cholakkal , Rao Muhammad Anwer

The ability to recognize various food-items in a generic food plate is a key determinant for an automated diet assessment system. This study motivates the need for automated diet assessment and proposes a framework to achieve this. Within…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Rameez Ismail , Zhaorui Yuan

The GPT (Generative Pre-trained Transformer) language models are an artificial intelligence and natural language processing technology that enables automatic text generation. There is a growing interest in applying GPT language models to…

Computers and Society · Computer Science 2024-03-25 Manuel de Buenaga , Francisco Javier Bueno

The field of computational pathology has witnessed remarkable progress in the development of both task-specific predictive models and task-agnostic self-supervised vision encoders. However, despite the explosive growth of generative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ming Y. Lu , Bowen Chen , Drew F. K. Williamson , Richard J. Chen , Kenji Ikamura , Georg Gerber , Ivy Liang , Long Phi Le , Tong Ding , Anil V Parwani , Faisal Mahmood

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

Pretrained large Vision-Language models have drawn considerable interest in recent years due to their remarkable performance. Despite considerable efforts to assess these models from diverse perspectives, the extent of visual cultural…

Computation and Language · Computer Science 2024-02-16 Yong Cao , Wenyan Li , Jiaang Li , Yifei Yuan , Antonia Karamolegkou , Daniel Hershcovich

We argue that a key reasoning skill that any advanced AI, say GPT-4, should master in order to qualify as 'thinking machine', or AGI, is hypothetic-deductive reasoning. Problem-solving or question-answering can quite generally be construed…

Artificial Intelligence · Computer Science 2023-08-08 Louis Vervoort , Vitaliy Mizyakov , Anastasia Ugleva

Large Language Models (LLMs) and Large Multimodal Models (LMMs) exhibit impressive problem-solving skills in many tasks and domains, but their ability in mathematical reasoning in visual contexts has not been systematically studied. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Pan Lu , Hritik Bansal , Tony Xia , Jiacheng Liu , Chunyuan Li , Hannaneh Hajishirzi , Hao Cheng , Kai-Wei Chang , Michel Galley , Jianfeng Gao