English
Related papers

Related papers: EVE: A Domain-Specific LLM Framework for Earth Int…

200 papers

Visual grounding is an essential capability of Visual Language Models (VLMs) to understand the real physical world. Previous state-of-the-art grounding visual language models usually have large model sizes, making them heavy for deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Guanqi Zhan , Changye Li , Zhijian Liu , Yao Lu , Yi Wu , Song Han , Ligeng Zhu

Generative models, such as GPT and BERT, have significantly improved performance in tasks like text generation and summarization. However, hallucinations "where models generate non-factual or misleading content" are especially problematic…

Computation and Language · Computer Science 2025-04-08 Mingyan Liu

Vision-Language Models (VLMs) based on Mixture-of-Experts (MoE) architectures have emerged as a pivotal paradigm in multimodal understanding, offering a powerful framework for integrating visual and linguistic information. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xiaoda Yang , JunYu Lu , Hongshun Qiu , Sijing Li , Hao Li , Shengpeng Ji , Xudong Tang , Jiayang Xu , Jiaqi Duan , Ziyue Jiang , Cong Lin , Sihang Cai , Zejian Xie , Zhuoyang Song , Songxin Zhang

Large language models (LLMs) are increasingly used in emergency first response (EFR) applications to support situational awareness (SA) and decision-making, yet most operate on text or 2D imagery and offer little support for core EFR SA…

Human-Computer Interaction · Computer Science 2026-02-18 Rodrigo Gutierrez Maquilon , Marita Hueber , Georg Regal , Manfred Tscheligi

Cross-modal alignment is one key challenge for Vision-and-Language Navigation (VLN). Most existing studies concentrate on mapping the global instruction or single sub-instruction to the corresponding trajectory. However, another critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yibo Cui , Liang Xie , Yakun Zhang , Meishan Zhang , Ye Yan , Erwei Yin

Distributional alignment enables large language models (LLMs) to predict how a target population distributes its responses across answer options, rather than collapsing disagreement into a single consensus answer. However, existing…

Machine Learning · Computer Science 2026-03-17 Viet-Thanh Pham , Lizhen Qu , Zhuang Li , Gholamreza Haffari

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha

Large Vision-Language Models (LVLMs) have recently played a dominant role in multimodal vision-language learning. Despite the great success, it lacks a holistic evaluation of their efficacy. This paper presents a comprehensive evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Peng Xu , Wenqi Shao , Kaipeng Zhang , Peng Gao , Shuo Liu , Meng Lei , Fanqing Meng , Siyuan Huang , Yu Qiao , Ping Luo

Knowledge utilization is a critical aspect of LLMs, and understanding how they adapt to evolving knowledge is essential for their effective deployment. However, existing benchmarks are predominantly static, failing to capture the evolving…

Computation and Language · Computer Science 2024-12-19 Wei Tang , Yixin Cao , Yang Deng , Jiahao Ying , Bo Wang , Yizhe Yang , Yuyue Zhao , Qi Zhang , Xuanjing Huang , Yugang Jiang , Yong Liao

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

With the rapid advancement of autonomous driving, deploying Vision-Language Models (VLMs) to enhance perception and decision-making has become increasingly common. However, the real-time application of VLMs is hindered by high latency and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lianming Huang , Haibo Hu , Yufei Cui , Jiacheng Zuo , Shangyu Wu , Nan Guan , Chun Jason Xue

The Mixture of Experts (MoE) architecture has excelled in Large Vision-Language Models (LVLMs), yet its potential in real-time open-vocabulary object detectors, which also leverage large-scale vision-language datasets but smaller models,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yehao Lu , Minghe Weng , Zekang Xiao , Rui Jiang , Wei Su , Guangcong Zheng , Ping Lu , Xi Li

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen

Vision Transformers (ViTs) have emerged as a foundational model in computer vision, excelling in generalization and adaptation to downstream tasks. However, deploying ViTs to support diverse resource constraints typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Chen Zhu , Wangbo Zhao , Huiwen Zhang , Samir Khaki , Yuhao Zhou , Weidong Tang , Shuo Wang , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Kai Wang , Dawei Yang

Machine learning and especially deep learning have garneredtremendous popularity in recent years due to their increased performanceover other methods. The availability of large amount of data has aidedin the progress of deep learning.…

Machine Learning · Computer Science 2019-09-06 Sharath M. Shankaranarayana , Davor Runje

Inquiry-based modeling is essential to scientific practice. However, modeling is difficult for novice scientists in part due to limited domain-specific knowledge and quantitative skills. VERA is an interactive tool that helps users…

Human-Computer Interaction · Computer Science 2022-09-07 Sungeun An , Robert Bates , Spencer Rugaber , Jennifer Hammock , Emily Weigel , Ashok K. Goel

Edge Intelligence (EI) has been instrumental in delivering real-time, localized services by leveraging the computational capabilities of edge networks. The integration of Large Language Models (LLMs) empowers EI to evolve into the next…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-07 Handi Chen , Weipeng Deng , Shuo Yang , Jinfeng Xu , Zhihan Jiang , Edith C. H. Ngai , Jiangchuan Liu , Xue Liu

Does seeing always mean knowing? Large Vision-Language Models (LVLMs) integrate separately pre-trained vision and language components, often using CLIP-ViT as vision backbone. However, these models frequently encounter a core issue of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yaqi Zhao , Yuanyang Yin , Lin Li , Mingan Lin , Victor Shea-Jay Huang , Siwei Chen , Weipeng Chen , Baoqun Yin , Zenan Zhou , Wentao Zhang

The enhancement of generalization in robots by large vision-language models (LVLMs) is increasingly evident. Therefore, the embodied cognitive abilities of LVLMs based on egocentric videos are of great interest. However, current datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ronghao Dang , Yuqian Yuan , Wenqi Zhang , Yifei Xin , Boqiang Zhang , Long Li , Liuyi Wang , Qinyang Zeng , Xin Li , Lidong Bing

The European Large Logistics Lander (EL3) is being designed to carry out cargo delivery missions in support of future lunar ground crews. The capacity of virtual reality (VR) to visualize and interactively simulate the unique lunar…