English
Related papers

Related papers: ViLLM-Eval: A Comprehensive Evaluation Suite for V…

200 papers

Large language models (LLMs) have shown impressive capabilities across various natural language tasks. However, evaluating their alignment with human preferences remains a challenge. To this end, we propose a comprehensive human evaluation…

Computation and Language · Computer Science 2023-11-10 Shuyi Xie , Wenlin Yao , Yong Dai , Shaobo Wang , Donlin Zhou , Lifeng Jin , Xinhua Feng , Pengzhi Wei , Yujie Lin , Zhichao Hu , Dong Yu , Zhengyou Zhang , Jing Nie , Yuhong Liu

In this work, we introduce the Qwen-VL series, a set of large-scale vision-language models (LVLMs) designed to perceive and understand both texts and images. Starting from the Qwen-LM as a foundation, we endow it with visual capacity by the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Jinze Bai , Shuai Bai , Shusheng Yang , Shijie Wang , Sinan Tan , Peng Wang , Junyang Lin , Chang Zhou , Jingren Zhou

This paper presents a comprehensive survey of vision-language (VL) intelligence from the perspective of time. This survey is inspired by the remarkable progress in both computer vision and natural language processing, and recent trends…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Feng Li , Hao Zhang , Yi-Fan Zhang , Shilong Liu , Jian Guo , Lionel M. Ni , PengChuan Zhang , Lei Zhang

Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models…

The use of large language models (LLMs) for evaluating outputs is becoming an increasingly effective and scalable approach. However, it remains uncertain whether this capability extends beyond task-specific evaluations to more general…

Computation and Language · Computer Science 2025-11-13 Rhitabrat Pokharel , Ameeta Agrawal

The complexity of Vietnam's legal texts presents a significant barrier to public access to justice. While Large Language Models offer a promising solution for legal text simplification, evaluating their true capabilities requires a…

Computation and Language · Computer Science 2026-04-20 Van-Truong Le

In the age of artificial intelligence, the role of large language models (LLMs) is becoming increasingly central. Despite their growing prevalence, their capacity to consolidate knowledge from different training documents - a crucial…

Computation and Language · Computer Science 2024-02-26 Gabriele Prato , Jerry Huang , Prasannna Parthasarathi , Shagun Sodhani , Sarath Chandar

The use of Large Language Models (LLMs) in hardware design has taken off in recent years, principally through its incorporation in tools that increase chip designer productivity. There has been considerable discussion about the use of LLMs…

Hardware Architecture · Computer Science 2025-05-20 Nicolas Dupuis , Ravi Nair , Shyam Ramji , Sean McClintock , Nishant Chauhan , Priyanka Nagpal , Bart Blaner , Ken Valk , Leon Stok , Ruchir Puri

Despite the rapid development of video Large Language Models (LLMs), a comprehensive evaluation is still absent. In this paper, we introduce a unified evaluation that encompasses multiple video tasks, including captioning, question and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shuailin Li , Yuang Zhang , Yucheng Zhao , Qiuyue Wang , Fan Jia , Yingfei Liu , Tiancai Wang

Existing large language model (LLM) evaluation benchmarks primarily focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-linguistic reasoning abilities. This dual limitation makes it…

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Vision Language Models (VLMs) achieved rapid progress in the recent years. However, despite their growth, VLMs development is heavily grounded on English, leading to two main limitations: (i) the lack of multilingual and multimodal datasets…

Computation and Language · Computer Science 2026-04-21 Daniela Baiamonte , Elena Fano , Matteo Gabburo , Stefano Simonazzi , Leonardo Rigutini , Andrea Zugarini

Recently, vision-language pretraining has emerged as a transformative technique that integrates the strengths of both visual and textual modalities, resulting in powerful vision-language models (VLMs). Leveraging web-scale pretraining data,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Xinyao Li , Jingjing Li , Fengling Li , Lei Zhu , Yang Yang , Heng Tao Shen

Large Vision-Language Models (VLMs) have achieved unprecedented success in several objective multimodal reasoning tasks. However, to further enhance their capabilities of empathetic and effective communication with humans, improving how…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Sree Bhattacharyya , James Z. Wang

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

Natural Language Inference (NLI) is a task within Natural Language Processing (NLP) that holds value for various AI applications. However, there have been limited studies on Natural Language Inference in Vietnamese that explore the concept…

Computation and Language · Computer Science 2024-11-22 Dat Van-Thanh Nguyen , Tin Van Huynh , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Large Language Models (LLMs) are transformative not only for daily activities but also for engineering tasks. However, current evaluations of LLMs in engineering exhibit two critical shortcomings: (i) the reliance on simplified use cases,…

Artificial Intelligence · Computer Science 2025-05-21 Rene Heesch , Sebastian Eilermann , Alexander Windmann , Alexander Diedrich , Philipp Rosenthal , Oliver Niggemann

The advances of large foundation models necessitate wide-coverage, low-cost, and zero-contamination benchmarks. Despite continuous exploration of language model evaluations, comprehensive studies on the evaluation of Large Multi-modal…

Computation and Language · Computer Science 2025-09-19 Kaichen Zhang , Bo Li , Peiyuan Zhang , Fanyi Pu , Joshua Adrian Cahyono , Kairui Hu , Shuai Liu , Yuanhan Zhang , Jingkang Yang , Chunyuan Li , Ziwei Liu

Large language models (LLMs) have notably accelerated progress towards artificial general intelligence (AGI), with their impressive zero-shot capacity for user-tailored tasks, endowing them with immense potential across a range of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Wenhai Wang , Zhe Chen , Xiaokang Chen , Jiannan Wu , Xizhou Zhu , Gang Zeng , Ping Luo , Tong Lu , Jie Zhou , Yu Qiao , Jifeng Dai

Visual language is a system of communication that conveys information through symbols, shapes, and spatial arrangements. Diagrams are a typical example of a visual language depicting complex concepts and their relationships in the form of…

Computation and Language · Computer Science 2025-05-27 Yifan Hou , Buse Giledereli , Yilei Tu , Mrinmaya Sachan