English
Related papers

Related papers: Explicit Abstention Knobs for Predictable Reliabil…

200 papers

Vision-Language-Action models (VLAs) have demonstrated remarkable performance in robot control. However, they remain fundamentally limited in tasks that require high precision due to their single-inference paradigm. While test-time scaling…

Robotics · Computer Science 2025-10-08 Suhyeok Jang , Dongyoung Kim , Changyeon Kim , Youngsuk Kim , Jinwoo Shin

Video Anomaly Detection (VAD) is a fundamental challenge in computer vision, particularly due to the open-set nature of anomalies. While recent training-free approaches utilizing Vision-Language Models (VLMs) have shown promise, they…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Lokman Bekit , Hamza Karim , Nghia T Nguyen , Yasin Yilmaz

The web is littered with images, once created for human consumption and now increasingly interpreted by agents using vision-language models (VLMs). These agents make visual decisions at scale, deciding what to click, recommend, or buy. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Manuel Cherep , Pranav M R , Pattie Maes , Nikhil Singh

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Wenyi Xiao , Xinchi Xu , Leilei Gan

A fundamental problem in control is to learn a model of a system from observations that is useful for controller synthesis. To provide good performance guarantees, existing methods must assume that the real system is in the class of models…

Machine Learning · Computer Science 2012-07-04 Stephane Ross , J. Andrew Bagnell

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Vision-Language Models (VLMs) and generative image models have achieved remarkable performance across multimodal tasks, yet their robustness and fairness under input transformations remain insufficiently explored. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Tarannum Mithila

Large Language Models (LLMs) have shown remarkable performances on a wide range of natural language understanding and generation tasks. We observe that the LLMs provide effective priors in exploiting $\textit{linguistic shortcuts}$ for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Dohwan Ko , Ji Soo Lee , Wooyoung Kang , Byungseok Roh , Hyunwoo J. Kim

Video prediction is a challenging computer vision task that has a wide range of applications. In this work, we present a new family of Transformer-based models for video prediction. Firstly, an efficient local spatial-temporal separation…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xi Ye , Guillaume-Alexandre Bilodeau

Deploying large language models in production requires simultaneous attention to efficiency and risk control. Prior work has shown the possibility to cut costs while maintaining similar accuracy, but has neglected to focus on risk control.…

Machine Learning · Computer Science 2024-10-04 Michael J. Zellinger , Matt Thomson

While Vision-Language Models (VLMs) have achieved remarkable performance across diverse downstream tasks, recent studies have shown that they can inherit social biases from the training data and further propagate them into downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Tangzheng Lian , Guanyu Hu , Yijing Ren , Dimitrios Kollias , Oya Celiktutan

Despite considerable recent progress in Visual Question Answering (VQA) models, inconsistent or contradictory answers continue to cast doubt on their true reasoning capabilities. However, most proposed methods use indirect strategies or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Recent advancements in Large Language Models have successfully transitioned towards System 2 reasoning, yet applying these paradigms to video understanding remains challenging. While prevailing research attributes failures in Video-LLMs to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Hongbo Jin , Jiayu Ding , Siyi Xie , Guibo Luo , Ge Li

Large language Models (LLMs) have demonstrated remarkable skills across various domains. Understanding the mechanisms behind their abilities and implementing controls over them is becoming increasingly important for developing better…

Computation and Language · Computer Science 2025-04-01 Yongce Li , Chung-En Sun , Tsui-Wei Weng

Video vision-language models (VLMs) keep paying for visual state the stream already told us was stable. The factory wall did not move, but most VLM pipelines still hand the model dense RGB frames or a fresh prefix again. We study that waste…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 JF Bastien , Sam D'Amico

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha

Vision-Language-Action (VLA) models enable general-purpose robotic policies by mapping visual observations and language instructions to low-level actions, but they often lack reliable introspection. A common practice is to compute a…

Robotics · Computer Science 2026-03-20 Yanchuan Tang , Taowen Wang , Yuefei Chen , Boxuan Zhang , Qiang Guan , Ruixiang Tang

Recent progress in BIQA has been driven by VLMs, whose semantic reasoning abilities suggest that they might extract visual features, generate descriptive text, and infer quality in a human-like manner. However, these models often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yuan Li , Zitang Sun , Yen-ju Chen , Shin'ya Nishida

Engagement recognition in video datasets, unlike traditional image classification tasks, is particularly challenged by subjective labels and noise limiting model performance. To overcome the challenges of subjective and noisy engagement…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Alexander Vedernikov , Puneet Kumar , Haoyu Chen , Tapio Seppänen , Xiaobai Li

Large language model pretraining is compute-intensive, yet many tokens contribute marginally to learning, resulting in inefficiency. We introduce Efficient Selective Language Modeling (ESLM), a risk-aware algorithm that improves training…

Machine Learning · Computer Science 2025-05-27 Melis Ilayda Bal , Volkan Cevher , Michael Muehlebach