English
Related papers

Related papers: VLsI: Verbalized Layers-to-Interactions from Large…

200 papers

Large Vision-Language Models (LVLMs) evolve rapidly as Large Language Models (LLMs) was equipped with vision modules to create more human-like models. However, we should carefully evaluate their applications in different domains, as they…

Computation and Language · Computer Science 2024-09-24 Yuhang Xiao , Yudi Lin , Ming-Chang Chiu

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Traditional volume visualization (VolVis) methods, like direct volume rendering, suffer from rigid transfer function designs and high computational costs. Although novel view synthesis approaches enhance rendering efficiency, they require…

Human-Computer Interaction · Computer Science 2025-07-21 Kuangshi Ai , Kaiyuan Tang , Chaoli Wang

Recent advancements in Surgical Visual Question Answering (Surgical-VQA) and related region grounding have shown great promise for robotic and medical applications, addressing the critical need for automated methods in personalized surgical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Guankun Wang , Long Bai , Wan Jun Nah , Jie Wang , Zhaoxi Zhang , Zhen Chen , Jinlin Wu , Mobarakol Islam , Hongbin Liu , Hongliang Ren

Recent advancements in language-grounded autonomous driving have been significantly promoted by the sophisticated cognition and reasoning capabilities of large language models (LLMs). However, current LLM-based approaches encounter critical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruifei Zhang , Wei Zhang , Xiao Tan , Sibei Yang , Xiang Wan , Xiaonan Luo , Guanbin Li

Effective scaling and a flexible task interface enable large language models to excel at many tasks. We present PaLI (Pathways Language and Image model), a model that extends this approach to the joint modeling of language and vision. PaLI…

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

Machine Learning · Computer Science 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Recent advancements in Large Language Models (LLMs)-based text embedding models primarily focus on data scaling or synthesis, yet limited exploration of training techniques and data quality, thereby constraining performance. In this work,…

In large language models (LLM), in-context learning (ICL) refers to performing new tasks by conditioning on small demonstrations provided in the input context. Recent advances in visual in-context learning (VICL) demonstrate promising…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Shao-Jun Xia , Huixin Zhang , Zhengzhong Tu

Large Language Models (LLMs) have played an important role in many fields due to their powerful capabilities.However, their massive number of parameters leads to high deployment requirements and incurs significant inference costs, which…

Large language models (LLMs) are renowned for their extensive linguistic knowledge and strong generalization capabilities, but their high computational demands make them unsuitable for resource-constrained environments. In contrast, small…

Computation and Language · Computer Science 2025-06-10 Kyeonghyun Kim , Jinhee Jang , Juhwan Choi , Yoonji Lee , Kyohoon Jin , YoungBin Kim

Large vision-language models (LVLMs) have been regarded as a breakthrough advance in an astoundingly variety of tasks, from content generation to virtual assistants and multimodal search or retrieval. However, for many of these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Kailash Hambarde , Pranita Samale , Hugo Proença

Recently, visual-language learning (VLL) has shown great potential in enhancing visual-based person re-identification (ReID). Existing VLL-based ReID methods typically focus on image-text feature alignment at the whole-body level, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yin Lin , Yehansen Chen , Baocai Yin , Jinshui Hu , Bing Yin , Cong Liu , Zengfu Wang

The unprecedented advancements in Large Language Models (LLMs) have profoundly impacted natural language processing but have yet to fully embrace the realm of scalable vector graphics (SVG) generation. While LLMs encode partial knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ximing Xing , Juncheng Hu , Guotao Liang , Jing Zhang , Dong Xu , Qian Yu

Recent breakthroughs in vision-language models (VLMs) start a new page in the vision community. The VLMs provide stronger and more generalizable feature embeddings compared to those from ImageNet-pretrained models, thanks to the training on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Jieneng Chen , Qihang Yu , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen

VLMs (Vision-Language Models) extend the capabilities of LLMs (Large Language Models) to accept multimodal inputs. Since it has been verified that LLMs can be induced to generate harmful or inaccurate content through specific test cases…

Artificial Intelligence · Computer Science 2024-01-24 Mukai Li , Lei Li , Yuwei Yin , Masood Ahmed , Zhenguang Liu , Qi Liu

Autonomous driving systems often infer pedestrian yielding behavior from geometric and kinematic cues alone, limiting their ability to reason about visual scene context and age-dependent behavioral variability. This limitation can produce…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Qingwen Pu , Kun Xie , Yuxiang Liu

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du