中文
相关论文

相关论文: FoodLMM: A Versatile Food Assistant using Large Mu…

200 篇论文

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

计算与语言 · 计算机科学 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Large language models (LLMs) have demonstrated significant capabilities in mathematical reasoning, particularly with text-based mathematical problems. However, current multi-modal large language models (MLLMs), especially those specialized…

计算与语言 · 计算机科学 2024-12-03 Zhen Yang , Jinhao Chen , Zhengxiao Du , Wenmeng Yu , Weihan Wang , Wenyi Hong , Zhihuan Jiang , Bin Xu , Jie Tang

Large language models (LLMs) can handle a wide variety of general tasks with simple prompts, without the need for task-specific training. Multimodal Large Language Models (MLLMs), built upon LLMs, have demonstrated impressive potential in…

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

机器学习 · 计算机科学 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Multimodal large language models (MLLMs) have broadened the scope of AI applications. Existing automatic evaluation methodologies for MLLMs are mainly limited in evaluating queries without considering user experiences, inadequately…

Fashion styling and personalized recommendations are pivotal in modern retail, contributing substantial economic value in the fashion industry. With the advent of vision-language models (VLM), new opportunities have emerged to enhance…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Kaicheng Pang , Xingxing Zou , Waikeung Wong

Deep learning based methods have achieved impressive results in many applications for image-based diet assessment such as food classification and food portion size estimation. However, existing methods only focus on one task at a time,…

计算机视觉与模式识别 · 计算机科学 2020-04-29 Jiangpeng He , Zeman Shao , Janine Wright , Deborah Kerr , Carol Boushey , Fengqing Zhu

Large Vision-Language Models (LVLMs) have shown impressive capabilities across a range of tasks that integrate visual and textual understanding, such as image captioning and visual question answering. These models are trained on large-scale…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Xiaomei Zhang , Hanyu Zheng , Xiangyu Zhu , Jinghuan Wei , Junhong Zou , Zhen Lei , Zhaoxiang Zhang

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

人工智能 · 计算机科学 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

计算与语言 · 计算机科学 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

The rapid advancement of Large Language Models (LLMs) has created numerous potentials for integration with conversational assistants (CAs) assisting people in their daily tasks, particularly due to their extensive flexibility. However,…

As a prominent direction of Artificial General Intelligence (AGI), Multimodal Large Language Models (MLLMs) have garnered increased attention from both industry and academia. Building upon pre-trained LLMs, this family of models further…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Chaoyou Fu , Yi-Fan Zhang , Shukang Yin , Bo Li , Xinyu Fang , Sirui Zhao , Haodong Duan , Xing Sun , Ziwei Liu , Liang Wang , Caifeng Shan , Ran He

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

计算与语言 · 计算机科学 2025-03-20 Shuguang Chen , Guang Lin

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

Large multimodal models (LMMs) combine unimodal encoders and large language models (LLMs) to perform multimodal tasks. Despite recent advancements towards the interpretability of these models, understanding internal representations of LMMs…

机器学习 · 计算机科学 2024-12-03 Jayneel Parekh , Pegah Khayatan , Mustafa Shukor , Alasdair Newson , Matthieu Cord

Fashion, deeply rooted in sociocultural dynamics, evolves as individuals emulate styles popularized by influencers and iconic figures. In the quest to replicate such refined tastes using artificial intelligence, traditional fashion ensemble…

计算与语言 · 计算机科学 2025-02-25 Zhan Shi , Shanglin Yang

Recent advancements in large language models (LLMs) have significantly propelled the development of large multi-modal models (LMMs), highlighting the potential for general and intelligent assistants. However, most LMMs model visual and…

计算与语言 · 计算机科学 2025-03-20 Rui Yang , Lin Song , Yicheng Xiao , Runhui Huang , Yixiao Ge , Ying Shan , Hengshuang Zhao

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel…

人工智能 · 计算机科学 2025-08-21 Hong Su