English
Related papers

Related papers: MLLM-Tool: A Multimodal Large Language Model For T…

200 papers

Large language models (LLMs) can handle a wide variety of general tasks with simple prompts, without the need for task-specific training. Multimodal Large Language Models (MLLMs), built upon LLMs, have demonstrated impressive potential in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tao Yu , Yi-Fan Zhang , Chaoyou Fu , Junkang Wu , Jinda Lu , Kun Wang , Xingyu Lu , Yunhang Shen , Guibin Zhang , Dingjie Song , Yibo Yan , Tianlong Xu , Qingsong Wen , Zhang Zhang , Yan Huang , Liang Wang , Tieniu Tan

Large language models (LLMs) have recently demonstrated remarkable capabilities to comprehend human intentions, engage in reasoning, and design planning-like behavior. To further unleash the power of LLMs to accomplish complex tasks, there…

Recent developments in video translation have further enhanced cross-lingual access to video content, with multimodal large language models (MLLMs) playing an increasingly important supporting role. With strong multimodal understanding,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bingzheng QU , Kehai Chen , Xuefeng Bai , Min Zhang

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

Computation and Language · Computer Science 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin

Recent advancements on Large Language Models (LLMs) enable AI Agents to automatically generate and execute multi-step plans to solve complex tasks. However, since LLM's content generation process is hardly controllable, current LLM-based…

Machine Learning · Computer Science 2024-08-13 Zelong Li , Wenyue Hua , Hao Wang , He Zhu , Yongfeng Zhang

Recent advances in foundation models, particularly Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), have facilitated the development of intelligent agents capable of performing complex tasks. By leveraging the…

Large language models (LLMs) have proven their remarkable versatility in handling a comprehensive range of language-centric applications. To expand LLMs' capabilities to a broader spectrum of modal inputs, multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qiang Zhou , Zhibin Wang , Wei Chu , Yinghui Xu , Hao Li , Yuan Qi

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

Significant advancements has recently been achieved in the field of multi-modal large language models (MLLMs), demonstrating their remarkable capabilities in understanding and reasoning across diverse tasks. However, these models are often…

Computation and Language · Computer Science 2024-08-06 Zhaowei Li , Wei Wang , YiQing Cai , Xu Qi , Pengyu Wang , Dong Zhang , Hang Song , Botian Jiang , Zhida Huang , Tao Wang

Large language models (LLMs) demonstrate remarkable ability to comprehend, reason, and generate following nature language instructions. However, the development of LLMs has been primarily focused on high-resource languages, such as English,…

Recently, tool learning with large language models (LLMs) has emerged as a promising paradigm for augmenting the capabilities of LLMs to tackle highly complex problems. Despite growing attention and rapid advancements in this field, the…

Computation and Language · Computer Science 2024-11-05 Changle Qu , Sunhao Dai , Xiaochi Wei , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Jun Xu , Ji-Rong Wen

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

Software Engineering · Computer Science 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the development of agents that support human-machine dialogue interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhenfei Yin , Jiong Wang , Jianjian Cao , Zhelun Shi , Dingning Liu , Mukai Li , Lu Sheng , Lei Bai , Xiaoshui Huang , Zhiyong Wang , Jing Shao , Wanli Ouyang

In the past year, Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering, visual understanding and reasoning. However, the extensive model size and high training and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yizhang Jin , Jian Li , Yexin Liu , Tianjun Gu , Kai Wu , Zhengkai Jiang , Muyang He , Bo Zhao , Xin Tan , Zhenye Gan , Yabiao Wang , Chengjie Wang , Lizhuang Ma

We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving complex real-world tasks. Despite the remarkable performance of LLMs, they still struggle with tool invocation due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhaoyang Liu , Zeqiang Lai , Zhangwei Gao , Erfei Cui , Ziheng Li , Xizhou Zhu , Lewei Lu , Qifeng Chen , Yu Qiao , Jifeng Dai , Wenhai Wang

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

Machine Learning · Computer Science 2025-01-10 Xuran Zheng , Chang D. Yoo

The advent of large language models (LLMs) has gained tremendous attention over the past year. Previous studies have shown the astonishing performance of LLMs not only in other tasks but also in emotion recognition in terms of accuracy,…

Computation and Language · Computer Science 2023-10-24 Liyizhe Peng , Zixing Zhang , Tao Pang , Jing Han , Huan Zhao , Hao Chen , Björn W. Schuller