English
Related papers

Related papers: LLaVA-Chef: A Multi-modal Generative Model for Foo…

200 papers

How to efficiently transform large language models (LLMs) into instruction followers is recently a popular research direction, while training LLM for multi-modal reasoning remains less explored. Although the recent LLaMA-Adapter…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Peng Gao , Jiaming Han , Renrui Zhang , Ziyi Lin , Shijie Geng , Aojun Zhou , Wei Zhang , Pan Lu , Conghui He , Xiangyu Yue , Hongsheng Li , Yu Qiao

This paper introduces a novel approach to efficiently feeding knowledge to language models (LLMs) during prediction by integrating retrieval and generation processes within a unified framework. While the Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-02-11 S Santosh Kumar , Rishi Gottimukkala , Supriya Devidutta , Karthikeyan S

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness…

Computation and Language · Computer Science 2025-09-03 Zirui Song , Bin Yan , Yuhan Liu , Miao Fang , Mingzhe Li , Rui Yan , Xiuying Chen

Large Language Models (LLMs) have made remarkable advancements in the field of natural language processing. However, their increasing size poses challenges in terms of computational cost. On the other hand, Small Language Models (SLMs) are…

Computation and Language · Computer Science 2023-08-03 Zhen Guo , Peiqi Wang , Yanwei Wang , Shangdi Yu

One-size-fits-all large language models (LLMs) are increasingly being used to help people with their writing. However, the style these models are trained to write in may not suit all users or use cases. LLMs would be more useful as writing…

Computation and Language · Computer Science 2024-09-10 Xinyue Liu , Harshita Diddee , Daphne Ippolito

Large Language Models (LLMs) such as GPT-4 have demonstrated their ability to understand natural language and generate complex code snippets. This paper introduces a novel Large Language Model Evolutionary Algorithm (LLaMEA) framework,…

Neural and Evolutionary Computing · Computer Science 2025-01-31 Niki van Stein , Thomas Bäck

In this study, we introduced a new benchmark consisting of a curated dataset and a defined evaluation process to assess the compositional reasoning capabilities of large language models within the chemistry domain. We designed and validated…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Nicholas Sherck , Hamidreza Mahyar , Soheila Samiee

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

Information Retrieval · Computer Science 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruction fine-tuning datasets, containing limited question-answer…

Computation and Language · Computer Science 2024-10-10 Wenhao Shi , Zhiqiang Hu , Yi Bin , Junhua Liu , Yang Yang , See-Kiong Ng , Lidong Bing , Roy Ka-Wei Lee

Large language models have demonstrated substantial advancements in reasoning capabilities. However, current Vision-Language Models (VLMs) often struggle to perform systematic and structured reasoning, especially when handling complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Guowei Xu , Peng Jin , Ziang Wu , Hao Li , Yibing Song , Lichao Sun , Li Yuan

Recent advancements indicate that scaling up Multimodal Large Language Models (MLLMs) effectively enhances performance on downstream multimodal tasks. The prevailing MLLM paradigm, \emph{e.g.}, LLaVA, transforms visual features into…

Artificial Intelligence · Computer Science 2024-03-21 Wenqiao Zhang , Tianwei Lin , Jiang Liu , Fangxun Shu , Haoyuan Li , Lei Zhang , He Wanggui , Hao Zhou , Zheqi Lv , Hao Jiang , Juncheng Li , Siliang Tang , Yueting Zhuang

Large Language Models (LLMs) have shown remarkable capabilities in code generation tasks, yet they face significant limitations in handling complex, long-context programming challenges and demonstrating complex compositional reasoning…

Artificial Intelligence · Computer Science 2025-01-14 Amr Almorsi , Mohanned Ahmed , Walid Gomaa

Large language models (LLMs) are solidifying their position in the modern world as effective tools for the automatic generation of text. Their use is quickly becoming commonplace in fields such as education, healthcare, and scientific…

Computation and Language · Computer Science 2025-10-08 Luka Terčon , Kaja Dobrovoljc

Multimodal large language models (LLMs) have achieved notable success across various domains, while research in the medical field has largely focused on unimodal images. Meanwhile, current general-domain multimodal models for videos still…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jiajie Li , Garrett Skinner , Gene Yang , Brian R Quaranto , Steven D Schwaitzberg , Peter C W Kim , Jinjun Xiong

In this paper, we introduce a Multimodal Large Language Model-based Generation Assistant (LLMGA), leveraging the vast reservoir of knowledge and proficiency in reasoning, comprehension, and response inherent in Large Language Models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bin Xia , Shiyin Wang , Yingfan Tao , Yitong Wang , Jiaya Jia

Multimodal Large Language Models (MLLMs) have shown impressive abilities in interacting with visual content with myriad potential downstream tasks. However, even though a list of benchmarks has been proposed, the capabilities and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhelun Shi , Zhipin Wang , Hongxing Fan , Zhenfei Yin , Lu Sheng , Yu Qiao , Jing Shao

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Materials discovery and development are critical for addressing global challenges. Yet, the exponential growth in materials science literature comprising vast amounts of textual data has created significant bottlenecks in knowledge…

Large Language Models (LLMs) have revolutionized a wide range of domains such as natural language processing, computer vision, and multi-modal tasks due to their ability to comprehend context and perform logical reasoning. However, the…

Artificial Intelligence · Computer Science 2025-07-31 Haoyang Li , Yiming Li , Anxin Tian , Tianhao Tang , Zhanchao Xu , Xuejia Chen , Nicole Hu , Wei Dong , Qing Li , Lei Chen

Large Language Models (LLMs) have demonstrated remarkable capabilities across various fields, from natural language understanding to text generation. Compared to non-generative LLMs like BERT and DeBERTa, generative LLMs like GPT series and…

Hardware Architecture · Computer Science 2025-06-16 Jinhao Li , Jiaming Xu , Shan Huang , Yonghua Chen , Wen Li , Jun Liu , Yaoxiu Lian , Jiayi Pan , Li Ding , Hao Zhou , Yu Wang , Guohao Dai
‹ Prev 1 3 4 5 6 7 10 Next ›