English
Related papers

Related papers: WisWheat: A Three-Tiered Vision-Language Dataset f…

200 papers

Vision-language models (VLMs) have made significant progress in recent visual-question-answering (VQA) benchmarks that evaluate complex visio-linguistic reasoning. However, are these models truly effective? In this work, we show that VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Baiqi Li , Zhiqiu Lin , Wenxuan Peng , Jean de Dieu Nyandwi , Daniel Jiang , Zixian Ma , Simran Khanuja , Ranjay Krishna , Graham Neubig , Deva Ramanan

Large Language Models (LLMs) have recently shown promise in streamlining hardware design processes by encapsulating vast amounts of domain-specific data. In addition, they allow users to interact with the design processes through natural…

Machine Learning · Computer Science 2024-07-04 Yongan Zhang , Zhongzhi Yu , Yonggan Fu , Cheng Wan , Yingyan Celine Lin

Effective pest recognition and management are crucial for sustainable agricultural development. However, collecting pest data in real scenarios is often challenging. Compared to other domains, pests exhibit a wide variety of species with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xueheng Li , Tao Hu , Ke Cao , Runsheng Qi , Huixin Zhang , Rui Li , Jie Zhang , Chengjun Xie

Vision-language models (VLMs) achieve remarkable success in single-image tasks. However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Juntian Zhang , Chuanqi cheng , Yuhan Liu , Wei Liu , Jian Luan , Rui Yan

Engineering drawings are fundamental to manufacturing communication, serving as the primary medium for conveying design intent, tolerances, and production details. However, interpreting complex multi-view drawings with dense annotations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Muhammad Tayyab Khan , Zane Yong , Lequn Chen , Wenhe Feng , Nicholas Yew Jin Tan , Seung Ki Moon

The rapid evolution of Vision Language Models (VLMs) has catalyzed significant advancements in artificial intelligence, expanding research across various disciplines, including Earth Observation (EO). While VLMs have enhanced image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xizhe Xue , Guoting Wei , Hao Chen , Haokui Zhang , Feng Lin , Chunhua Shen , Xiao Xiang Zhu

Despite rapid advances in multimodal large language models, agricultural applications remain constrained by the scarcity of domain-tailored models, curated vision-language corpora, and rigorous evaluation. To address these challenges, we…

Computation and Language · Computer Science 2025-12-09 Bo Yang , Yunkui Chen , Lanfei Feng , Yu Zhang , Xiao Xu , Jianyu Zhang , Nueraili Aierken , Runhe Huang , Hongjian Lin , Yibin Ying , Shijian Li

Instruction tuning is a crucial supervised training phase in Large Language Models (LLMs), aiming to enhance the LLM's ability to generalize instruction execution and adapt to user preferences. With the increasing integration of multi-modal…

Multimedia · Computer Science 2023-11-28 Chen Li , Yixiao Ge , Dian Li , Ying Shan

Vision-language models (VLMs) have gained widespread adoption in both industry and academia. In this study, we propose a unified framework for systematically evaluating gender, race, and age biases in VLMs with respect to professions. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Ashutosh Sathe , Prachi Jain , Sunayana Sitaram

Vision language models (VLM) have demonstrated remarkable performance across various downstream tasks. However, understanding fine-grained visual-linguistic concepts, such as attributes and inter-object relationships, remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wujian Peng , Sicheng Xie , Zuyao You , Shiyi Lan , Zuxuan Wu

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Developing vision-language models (VLMs) that generalize across diverse tasks requires large-scale training datasets with diverse content. In English, such datasets are typically constructed by aggregating and curating numerous existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Issa Sugiura , Keito Sasagawa , Keisuke Nakao , Koki Maeda , Ziqi Yin , Zhishen Yang , Shuhei Kurita , Yusuke Oda , Ryoko Tokuhisa , Daisuke Kawahara , Naoaki Okazaki

Soybean and cotton are major drivers of many countries' agricultural sectors, offering substantial economic returns but also facing persistent challenges from volunteer plants and weeds that hamper sustainable management. Effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Thiago H. Segreto , Juliano Negri , Paulo H. Polegato , João Manoel Herrera Pinheiro , Ricardo V. Godoy , Marcelo Becker

There is an emerging line of research on multimodal instruction tuning, and a line of benchmarks has been proposed for evaluating these models recently. Instead of evaluating the models directly, in this paper, we try to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ning Liao , Shaofeng Zhang , Renqiu Xia , Min Cao , Yu Qiao , Junchi Yan

This paper explores capabilities of Vision Language Models on spreadsheet comprehension. We propose three self-supervised challenges with corresponding evaluation metrics to comprehensively evaluate VLMs on Optical Character Recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Shiyu Xia , Junyu Xiong , Haoyu Dong , Jianbo Zhao , Yuzhang Tian , Mengyu Zhou , Yeye He , Shi Han , Dongmei Zhang

Despite significant advances in vision-language models (VLMs), most existing work follows an English-centric design process, limiting their effectiveness in multilingual settings. In this work, we provide a comprehensive empirical study…

While table understanding increasingly relies on pixel-only settings, current benchmarks predominantly use synthetic renderings that lack the complexity and visual diversity of real-world tables. Additionally, existing visual table…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Iñigo Alonso , Imanol Miranda , Eneko Agirre , Mirella Lapata

Vision-Language models (VLMs) that use contrastive language-image pre-training have shown promising zero-shot classification performance. However, their performance on imbalanced dataset is relatively poor, where the distribution of classes…

Artificial Intelligence · Computer Science 2023-06-22 Yidong Wang , Zhuohao Yu , Jindong Wang , Qiang Heng , Hao Chen , Wei Ye , Rui Xie , Xing Xie , Shikun Zhang

Students' academic emotions significantly influence their social behavior and learning performance. Traditional approaches to automatically and accurately analyze these emotions have predominantly relied on supervised machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Deliang Wang , Chao Yang , Gaowei Chen