English
Related papers

Related papers: GeoFlowVLM: Geometry-Aware Joint Uncertainty for F…

200 papers

Autoregressive language models decode left-to-right with irreversible commitments, limiting revision during multi-step reasoning. We propose \textbf{VDLM}, a modular variable diffusion language model that separates semantic planning from…

Computation and Language · Computer Science 2026-02-19 Shuhui Qu

In recent years, learning-based underwater image enhancement (UIE) techniques have rapidly evolved. However, distribution shifts between high-quality enhanced outputs and natural images can hinder semantic cue extraction for downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guodong Fan , Shengning Zhou , Genji Yuan , Huiyu Li , Jingchun Zhou , Jinjiang Li

Vision-language models (VLMs) often fail under low illumination because their visual grounding is learned predominantly from RGB imagery, whereas thermal infrared preserves complementary scene structure when visible cues degrade. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Rusiru Thushara , Yasiru Ranasinghe , Jay Paranjape , Vishal M. Patel

Vision-language models (VLMs) have gained widespread attention for their strong zero-shot capabilities across numerous downstream tasks. However, these models assume that each test image's class label is drawn from a predefined label set…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yongguang Li , Jindong Li , Qi Wang , Qianli Xing , Runliang Niu , Shengsheng Wang , Menglin Yang

Hybrid Language Models (HLMs) combine the low-latency efficiency of Small Language Models (SLMs) on edge devices with the high accuracy of Large Language Models (LLMs) on centralized servers. Unlike traditional end-to-end LLM inference,…

Machine Learning · Computer Science 2025-07-02 Faranaksadat Solat , Joohyung Lee , Mohamed Seif , Dusit Niyato , H. Vincent Poor

As large language models (LLMs) gain popularity in conducting prediction tasks in-context, understanding the sources of uncertainty in in-context learning becomes essential to ensuring reliability. The recent hypothesis of in-context…

Machine Learning · Statistics 2025-12-08 I. Shavindra Jayasekera , Jacob Si , Filippo Valdettaro , Wenlong Chen , A. Aldo Faisal , Yingzhen Li

Most estimators collapse all uncertainty modes into a single confidence score, preventing reliable reasoning about when to allocate more compute or adjust inference. We introduce Uncertainty-Guided Inference-Time Selection, a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Divake Kumar , Patrick Poggi , Sina Tayebati , Devashri Naik , Nilesh Ahuja , Amit Ranjan Trivedi

While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they do not effectively address the specific challenges of geospatial applications. Generic VLM benchmarks are not designed to handle the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Muhammad Sohail Danish , Muhammad Akhtar Munir , Syed Roshaan Ali Shah , Kartik Kuckreja , Fahad Shahbaz Khan , Paolo Fraccaro , Alexandre Lacoste , Salman Khan

Multimodal retrieval systems typically employ Vision Language Models (VLMs) that encode images and text independently into vectors within a shared embedding space. Despite incorporating text encoders, VLMs consistently underperform…

Information Retrieval · Computer Science 2026-01-22 Xinyuan Zhang , Lina Zhang , Lisung Chen , Guangyao Liu , Shuai Nie , Jiaming Xu , Runyu Shi , Ying Huang , Guoquan Zhang

This paper proposes an embedding method for co-occurrence data aimed at visual information exploration. We consider cases where co-occurrence probabilities are measured between pairs of elements from heterogeneous domains. The proposed…

Machine Learning · Computer Science 2025-08-26 Takuro Ishida , Tetsuo Furukawa

Unified vision-language models (VLMs) promise to streamline computer vision pipelines by reframing multiple visual tasks such as classification, detection, and keypoint localization within a single language-driven interface. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Conor Wallace , Isaac Corley , Jonathan Lwowski

Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaqi Zhu , Shaofeng Cai , Fang Deng , Beng Chin Ooi , Junran Wu

Reliable Uncertainty Quantification (UQ) and failure prediction remain open challenges for Vision-Language Models (VLMs). We introduce ViLU, a new Vision-Language Uncertainty quantification framework that contextualizes uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Marc Lafon , Yannis Karmim , Julio Silva-Rodríguez , Paul Couairon , Clément Rambour , Raphaël Fournier-Sniehotta , Ismail Ben Ayed , Jose Dolz , Nicolas Thome

Value model guided search is effective in steering LLM generation but suffers from a lack of robustness. This is due to verifier failure: imperfect VMs mistakenly prune valid reasoning paths, especially when encountering unseen reasoning…

Artificial Intelligence · Computer Science 2025-10-21 Fei Yu , Yingru Li , Benyou Wang

Zero-shot learning methods rely on fixed visual and semantic embeddings, extracted from independent vision and language models, both pre-trained for other large-scale tasks. This is a weakness of current zero-shot learning frameworks as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Shah Nawaz , Jacopo Cavazza , Alessio Del Bue

Video anomaly detection aims to find the events in a video that do not conform to the expected behavior. The prevalent methods mainly detect anomalies by snippet reconstruction or future frame prediction error. However, the error is highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Congqi Cao , Yue Lu , Yanning Zhang

Although many deep-learning-based super-resolution approaches have been proposed in recent years, because no ground truth is available in the inference stage, few can quantify the errors and uncertainties of the super-resolved results. For…

Image and Video Processing · Electrical Eng. & Systems 2023-08-10 Jingyi Shen , Han-Wei Shen

Vision Large Language Models (VLLMs) usually take input as a concatenation of image token embeddings and text token embeddings and conduct causal modeling. However, their internal behaviors remain underexplored, raising the question of…

Computation and Language · Computer Science 2025-05-16 Houjing Wei , Yuting Shi , Naoya Inoue

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

Predicting product quality from multimodal item information is critical in cold-start scenarios, where user interaction history is unavailable and predictions must rely on images and textual metadata. However, existing vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yin-Loon Khor , Yi-Jie Wong , Yan Chai Hum