English
Related papers

Related papers: Interpretable Multimodal Out-of-context Detection …

200 papers

Multi-modal Large Langue Models (MLLMs) often process thousands of visual tokens, which consume a significant portion of the context window and impose a substantial computational burden. Prior work has empirically explored visual token…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Dingchen Yang , Bowen Cao , Anran Zhang , Weibo Gu , Winston Hu , Guang Chen

Large language models (LLMs) can acquire new knowledge through fine-tuning, but this process exhibits a puzzling duality: models can generalize remarkably from new facts, yet are also prone to hallucinating incorrect information. However,…

Computation and Language · Computer Science 2026-02-03 Yixiao Huang , Hanlin Zhu , Tianyu Guo , Jiantao Jiao , Somayeh Sojoudi , Michael I. Jordan , Stuart Russell , Song Mei

Context reasoning is critical in a wide variety of applications where current inputs need to be interpreted in the light of previous experience and knowledge. Both spatial and temporal contextual information play a critical role in the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Mengmi Zhang , Claire Tseng , Karla Montejo , Joseph Kwon , Gabriel Kreiman

The proliferation of synthetic images generated by advanced AI models poses significant challenges in identifying and understanding manipulated visual content. Current fake image detection methods predominantly rely on binary classification…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ritabrata Chakraborty , Rajatsubhra Chakraborty , Ali Khaleghi Rahimian , Thomas MacDougall

We present a retrieval-augmented question answering framework for 5G/6G networks, where the Open Radio Access Network (O-RAN) has become central to disaggregated, virtualized, and AI-driven wireless systems. While O-RAN enables multi-vendor…

Networking and Internet Architecture · Computer Science 2026-01-07 Nathan Conger , Nathan Scollar , Kemal Davaslioglu , Yalin E. Sagduyu , Sastry Kompella

Bottom-up text detection methods play an important role in arbitrary-shape scene text detection but there are two restrictions preventing them from achieving their great potential, i.e., 1) the accumulation of false text segment detections,…

Multimedia · Computer Science 2024-04-29 Chengpei Xu , Wenjing Jia , Ruomei Wang , Xiaonan Luo , Xiangjian He

Current Large Language Models (LLMs) face inherent limitations due to their pre-defined context lengths, which impede their capacity for multi-hop reasoning within extensive textual contexts. While existing techniques like…

Computation and Language · Computer Science 2024-06-19 Weizhi Fei , Xueyan Niu , Guoqing Xie , Yanhua Zhang , Bo Bai , Lei Deng , Wei Han

Progress in image generation raises significant public security concerns. We argue that fake image detection should not operate as a "black box". Instead, an ideal approach must ensure both strong generalization and transparency. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Yikun Ji , Yan Hong , Jiahui Zhan , Haoxing Chen , jun lan , Huijia Zhu , Weiqiang Wang , Liqing Zhang , Jianfu Zhang

Natural Language Understanding (NLU) is a vital component of dialogue systems, and its ability to detect Out-of-Domain (OOD) inputs is critical in practical applications, since the acceptance of the OOD input that is unsupported by the…

Computation and Language · Computer Science 2022-05-25 Yinhe Zheng , Guanyi Chen , Minlie Huang

Although vision models such as Contrastive Language-Image Pre-Training (CLIP) show impressive generalization performance, their zero-shot robustness is still limited under Out-of-Distribution (OOD) scenarios without fine-tuning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zhuo Huang , Chang Liu , Yinpeng Dong , Hang Su , Shibao Zheng , Tongliang Liu

Vision-language models like CLIP show impressive ability to align images and text, but their training on short, concise captions makes them struggle with lengthy, detailed descriptions. Recent advances mitigate this challenge by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Chau Truong , Hieu Ta Quang , Dung D. Le

Recent surface anomaly detection methods excel at identifying structural anomalies, such as dents and scratches, but struggle with logical anomalies, such as irregular or missing object components. The best-performing logical anomaly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Matic Fučka , Vitjan Zavrtanik , Danijel Skočaj

Most recent works focus on answering first order logical queries to explore the knowledge graph reasoning via multi-hop logic predictions. However, existing reasoning models are limited by the circumscribed logical paradigms of training…

Machine Learning · Computer Science 2023-06-07 Xiaoying Xie , Biao Gong , Yiliang Lv , Zhen Han , Guoshuai Zhao , Xueming Qian

Reliable failure detection holds paramount importance in safety-critical applications. Yet, neural networks are known to produce overconfident predictions for misclassified samples. As a result, it remains a problematic matter as existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kien X. Nguyen , Tang Li , Xi Peng

\noindent Out-of-distribution (OOD) detection is essential for the safe deployment of machine learning models. Extensive work has focused on devising various scoring functions for detecting OOD samples, while only a few studies focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yifan Ding , Xixi Liu , Jonas Unger , Gabriel Eilertsen

Retrieval-Augmented Generation (RAG) enhances factual grounding in large language models (LLMs) by incorporating retrieved evidence, but LLM accuracy declines when long or noisy contexts exceed the model's effective attention span. Existing…

Computation and Language · Computer Science 2026-03-25 Debashish Chakraborty , Eugene Yang , Daniel Khashabi , Dawn Lawrie , Kevin Duh

The success of neural networks comes hand in hand with a desire for more interpretability. We focus on text classifiers and make them more interpretable by having them provide a justification, a rationale, for their predictions. We approach…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Wilker Aziz , Ivan Titov

In this paper we investigate a robust method to identify anomalies in complex scenes. This task is performed by evaluating the collective behavior by extracting the local binary patterns (LBP) and Laplacian of Gaussian (LoG) features. We…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Michalis Voutouris , Giovanni Sachi , Hina Afridi

Logical anomalies (LA) refer to data violating underlying logical constraints e.g., the quantity, arrangement, or composition of components within an image. Detecting accurately such anomalies requires models to reason about various…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Soopil Kim , Sion An , Philip Chikontwe , Myeongkyun Kang , Ehsan Adeli , Kilian M. Pohl , Sang Hyun Park

Existing research for image text retrieval mainly relies on sentence-level supervision to distinguish matched and mismatched sentences for a query image. However, semantic mismatch between an image and sentences usually happens in finer…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Zhihao Fan , Zhongyu Wei , Zejun Li , Siyuan Wang , Haijun Shan , Xuanjing Huang , Jianqing Fan