English
Related papers

Related papers: OxyEcomBench: Benchmarking Multimodal Foundation M…

200 papers

Recent advances in Multimodal Large Language Models (MLLMs) have significantly pushed the frontier of egocentric video question answering (EgocentricQA). However, existing benchmarks and studies are mainly limited to common daily activities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yanjun Li , Yuqian Fu , Tianwen Qian , Qi'ao Xu , Silong Dai , Danda Pani Paudel , Luc Van Gool , Xiaoling Wang

Recent evaluations of Large Multimodal Models (LMMs) have explored their capabilities in various domains, with only few benchmarks specifically focusing on urban environments. Moreover, existing urban benchmarks have been limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Baichuan Zhou , Haote Yang , Dairong Chen , Junyan Ye , Tianyi Bai , Jinhua Yu , Songyang Zhang , Dahua Lin , Conghui He , Weijia Li

Document content extraction is a critical task in computer vision, underpinning the data needs of large language models (LLMs) and retrieval-augmented generation (RAG) systems. Despite recent progress, current document parsing methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Linke Ouyang , Yuan Qu , Hongbin Zhou , Jiawei Zhu , Rui Zhang , Qunshu Lin , Bin Wang , Zhiyuan Zhao , Man Jiang , Xiaomeng Zhao , Jin Shi , Fan Wu , Pei Chu , Minghao Liu , Zhenxiang Li , Chao Xu , Bo Zhang , Botian Shi , Zhongying Tu , Conghui He

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

In recent years, the field of artificial intelligence has undergone a paradigm shift from task-specific small-scale models to general-purpose large language models (LLMs). With the rapid iteration of LLMs, objective, quantitative, and…

Large language models (LLMs) have demonstrated strong capabilities in various aspects. However, when applying them to the highly specialized, safe-critical legal domain, it is unclear how much legal knowledge they possess and whether they…

Computation and Language · Computer Science 2023-09-29 Zhiwei Fei , Xiaoyu Shen , Dawei Zhu , Fengzhe Zhou , Zhuo Han , Songyang Zhang , Kai Chen , Zongwen Shen , Jidong Ge

The advances of large foundation models necessitate wide-coverage, low-cost, and zero-contamination benchmarks. Despite continuous exploration of language model evaluations, comprehensive studies on the evaluation of Large Multi-modal…

Computation and Language · Computer Science 2025-09-19 Kaichen Zhang , Bo Li , Peiyuan Zhang , Fanyi Pu , Joshua Adrian Cahyono , Kairui Hu , Shuai Liu , Yuanhan Zhang , Jingkang Yang , Chunyuan Li , Ziwei Liu

The rapid advancement of large vision-language models (LVLMs) has significantly propelled applications in document understanding, particularly in optical character recognition (OCR) and multilingual translation. However, current evaluations…

Machine Learning · Computer Science 2025-05-20 Zhanglin Wu , Tengfei Song , Ning Xie , Mengli Zhu , Weidong Zhang , Shuang Wu , Pengfei Li , Chong Li , Junhao Zhu , Hao Yang , Shiliang Sun

Faces and humans are crucial elements in social interaction and are widely included in everyday photos and videos. Therefore, a deep understanding of faces and humans will enable multi-modal assistants to achieve improved response quality…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Lixiong Qin , Shilong Ou , Miaoxuan Zhang , Jiangning Wei , Yuhang Zhang , Xiaoshuai Song , Yuchen Liu , Mei Wang , Weiran Xu

Multilingual large language models (LLMs) are advancing rapidly, with new models frequently claiming support for an increasing number of languages. However, existing evaluation datasets are limited and lack cross-lingual alignment, leaving…

Computation and Language · Computer Science 2025-06-25 Wenhan Han , Yifan Zhang , Zhixun Chen , Binbin Liu , Haobin Lin , Bingni Zhang , Taifeng Wang , Mykola Pechenizkiy , Meng Fang , Yin Zheng

In the agricultural domain, the deployment of large language models (LLMs) is hindered by the lack of training data and evaluation benchmarks. To mitigate this issue, we propose AgriEval, the first comprehensive Chinese agricultural…

Computation and Language · Computer Science 2025-07-30 Lian Yan , Haotian Wang , Chen Tang , Haifeng Liu , Tianyang Sun , Liangliang Liu , Yi Guan , Jingchi Jiang

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Multimodal large language models (MLLMs) have demonstrated powerful capabilities in general spatial understanding and reasoning. However, their fine-grained spatial understanding and reasoning capabilities in complex urban scenarios have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jun Zhang , Jie Feng , Long Chen , Junhui Wang , Zhicheng Liu , Depeng Jin , Yong Li

In this work, we present Valley3, an omni multimodal large language model (MLLM) developed for diverse global e-commerce tasks, with unified understanding and reasoning capabilities across text, images, video, and audio. A key feature of…

Artificial Intelligence · Computer Science 2026-05-07 Zeyu Chen , Guanghao Zhou , Qixiang Yin , Ziwang Zhao , Huanjin Yao , Pengjiu Xia , Min Yang , Cen Chen , Minghui Qiu

Large language models excel in general tasks, yet assessing their reliability in logic-heavy, precision-critical domains like finance, law, and healthcare remains challenging. To address this, we introduce BizFinBench, the first benchmark…

Artificial Intelligence · Computer Science 2025-05-27 Guilong Lu , Xuntao Guo , Rongjunchen Zhang , Wenqiao Zhu , Ji Liu

Building robots that can perceive, reason, and act in dynamic, unstructured environments remains a core challenge. Recent embodied systems often adopt a dual-system paradigm, where System 2 handles high-level reasoning while System 1…

With the increasing integration of visual and textual content in Social Networking Services (SNS), evaluating the multimodal capabilities of Large Language Models (LLMs) is crucial for enhancing user experience, content understanding, and…

Computation and Language · Computer Science 2025-12-16 Hongcheng Guo , Zheyong Xie , Shaosheng Cao , Boyang Wang , Weiting Liu , Anjie Le , Lei Li , Zhoujun Li

Multimodal large language models (MLLMs) have broadened the scope of AI applications. Existing automatic evaluation methodologies for MLLMs are mainly limited in evaluating queries without considering user experiences, inadequately…

Real-world financial analysis involves information across multiple languages and modalities, from reports and news to scanned filings and meeting recordings. Yet most existing evaluations of LLMs in finance remain text-only, monolingual,…

Large Vision-Language Models (LVLMs) have recently played a dominant role in multimodal vision-language learning. Despite the great success, it lacks a holistic evaluation of their efficacy. This paper presents a comprehensive evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Peng Xu , Wenqi Shao , Kaipeng Zhang , Peng Gao , Shuo Liu , Meng Lei , Fanqing Meng , Siyuan Huang , Yu Qiao , Ping Luo