English
Related papers

Related papers: Interpretable Multimodal Out-of-context Detection …

200 papers

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

Machine Learning · Computer Science 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

As large language models (LLMs) gain popularity in conducting prediction tasks in-context, understanding the sources of uncertainty in in-context learning becomes essential to ensuring reliability. The recent hypothesis of in-context…

Machine Learning · Statistics 2025-12-08 I. Shavindra Jayasekera , Jacob Si , Filippo Valdettaro , Wenlong Chen , A. Aldo Faisal , Yingzhen Li

The goal of weakly-supervised video moment retrieval is to localize the video segment most relevant to the given natural language query without access to temporal annotations during training. Prior strongly- and weakly-supervised approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Reuben Tan , Huijuan Xu , Kate Saenko , Bryan A. Plummer

Unsupervised hallucination detection aims to identify hallucinated content generated by large language models (LLMs) without relying on labeled data. While unsupervised methods have gained popularity by eliminating labor-intensive human…

Computation and Language · Computer Science 2025-09-15 Ponhvoan Srey , Xiaobao Wu , Anh Tuan Luu

Out-of-context news is a common type of misinformation on online media platforms. This involves posting a caption, alongside a mismatched news image. Existing out-of-context news detection models only consider the scenario where pre-labeled…

Computation and Language · Computer Science 2024-08-09 Yimeng Gu , Mengqi Zhang , Ignacio Castro , Shu Wu , Gareth Tyson

Even when factually correct, social-media news previews (image-headline pairs) can induce interpretation drift: by selectively omitting crucial context, they lead readers to form judgments that diverge from what the full article supports.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Fanxiao Li , Jiaying Wu , Tingchao Fu , Dayang Li , Herun Wan , Wei Zhou , Min-Yen Kan

Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates…

Machine Learning · Computer Science 2023-01-03 John Mitros , Brian Mac Namee

The increasing realism of AI-generated images has raised serious concerns about misinformation and privacy violations, highlighting the urgent need for accurate and interpretable detection methods. While existing approaches have made…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tai-Ming Huang , Wei-Tung Lin , Kai-Lung Hua , Wen-Huang Cheng , Junichi Yamagishi , Jun-Cheng Chen

Online misinformation is increasingly pervasive, yet most existing benchmarks and methods evaluate veracity at the level of whole claims or paragraphs using coarse binary labels, obscuring how true and false details often co-exist within…

Computation and Language · Computer Science 2026-01-09 Zhiwei Liu , Paul Thompson , Jiaqi Rong , Baojie Qu , Runteng Guo , Min Peng , Qianqian Xie , Sophia Ananiadou

The widespread prevalence of misinformation poses significant societal concerns. Out-of-context misinformation, where authentic images are paired with false text, is particularly deceptive and easily misleads audiences. Most existing…

Artificial Intelligence · Computer Science 2025-02-04 Giovanni Pio Delvecchio , Huy Hong Nguyen , Isao Echizen

Multimodal large language models (MLLMs) have demonstrated impressive capabilities in visual reasoning and text generation. While previous studies have explored the application of MLLM for detecting out-of-context (OOC) misinformation, our…

Multimedia · Computer Science 2025-10-28 Fanxiao Li , Jiaying Wu , Canyuan He , Wei Zhou

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Multimodal large language models (MLLMs) have recently demonstrated remarkable reasoning and perceptual abilities for anomaly detection. However, most approaches remain confined to image-level anomaly detection and textual reasoning, while…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yizhou Jin , Yuezhu Feng , Jinjin Zhang , Peng Wang , Qingjie Liu , Yunhong Wang

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Personalizing jargon detection and explanation is essential for making technical documents accessible to readers with diverse disciplinary backgrounds. However, tailoring models to individual users typically requires substantial annotation…

Computation and Language · Computer Science 2025-10-14 Bohao Wu , Qingyun Wang , Yue Guo

Sarcasm detection identifies natural language expressions whose intended meaning is different from what is implied by its surface meaning. It finds applications in many NLP tasks such as opinion mining, sentiment analysis, etc. Today,…

Multimedia · Computer Science 2021-10-04 Sundesh Gupta , Aditya Shah , Miten Shah , Laribok Syiemlieh , Chandresh Maurya

Reasoning is central to human intelligence. However, fallacious arguments are common, and some exacerbate problems such as spreading misinformation about climate change. In this paper, we propose the task of logical fallacy detection, and…

Computation and Language · Computer Science 2022-12-13 Zhijing Jin , Abhinav Lalwani , Tejas Vaidhya , Xiaoyu Shen , Yiwen Ding , Zhiheng Lyu , Mrinmaya Sachan , Rada Mihalcea , Bernhard Schölkopf

We present a new approach to evaluate computational models for the task of text understanding by the means of out-of-context error detection. Through the novel design of our automated modification process, existing large-scale data sources…

Computation and Language · Computer Science 2018-03-28 Patrick Huber , Jan Niehues , Alex Waibel

Vision models excel in image classification but struggle to generalize to unseen data, such as classifying images from unseen domains or discovering novel categories. In this paper, we explore the relationship between logical reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Zhaorui Tan , Xi Yang , Qiufeng Wang , Anh Nguyen , Kaizhu Huang

Out-of-distribution (OOD) detection aims to discern outliers from the intended data distribution, which is crucial to maintaining high reliability and a good user experience. Most recent studies in OOD detection utilize the information from…

Computation and Language · Computer Science 2022-10-21 Hyunsoo Cho , Choonghyun Park , Jaewook Kang , Kang Min Yoo , Taeuk Kim , Sang-goo Lee