English
Related papers

Related papers: Incorporating Vision Bias into Click Models for Im…

200 papers

Learning a high-dimensional dense representation for vocabulary terms, also known as a word embedding, has recently attracted much attention in natural language processing and information retrieval tasks. The embedding vectors are typically…

Information Retrieval · Computer Science 2017-07-18 Hamed Zamani , W. Bruce Croft

Vision-language models (VLMs), such as CLIP, have gained popularity for their strong open vocabulary classification performance, but they are prone to assigning high confidence scores to misclassifications, limiting their reliability in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zhenxiang Lin , Maryam Haghighat , Will Browne , Dimity Miller

Recent research suggests that Vision Language Models (VLMs) often rely on inherent biases learned during training when responding to queries about visual properties of images. These biases are exacerbated when VLMs are asked highly specific…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Vision-Language Models have demonstrated remarkable capabilities in understanding visual content, yet systematic biases in their spatial processing remain largely unexplored. This work identifies and characterizes a systematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Aryan Chaudhary , Sanchit Goyal , Pratik Narang , Dhruv Kumar

Vision-language models (VLMs) exhibit a systematic bias when confronted with classic optical illusions: they overwhelmingly predict the illusion as "real" regardless of whether the image has been counterfactually modified. We present a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Xuesong Wang , Harry Wang

Modern search engine result pages often provide immediate value to users and organize information in such a way that it is easy to navigate. The core ranking function contributes to this and so do result snippets, smart organization of…

Information Retrieval · Computer Science 2016-09-05 Aleksandr Chuklin , Maarten de Rijke

Deep Metric Learning trains a neural network to map input images to a lower-dimensional embedding space such that similar images are closer together than dissimilar images. When used for item retrieval, a query image is embedded using the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Konstantin Kobs , Andreas Hotho

This paper investigates search in model-based reinforcement learning (RL). Conventional wisdom holds that long-term predictions and compounding errors are the primary obstacles for model-based RL. We challenge this view, showing that search…

Machine Learning · Computer Science 2026-05-25 Wei-Di Chang , Mikael Henaff , Brandon Amos , Gregory Dudek , Scott Fujimoto

We present a new task of query auto-completion for estimating instance probabilities. We complete a user query prefix conditioned upon an image. Given the complete query, we fine tune a BERT embedding for estimating probabilities of a broad…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Samuel Sharpe , Jin Yan , Fan Wu , Iddo Drori

Supervised machine learning models and their evaluation strongly depends on the quality of the underlying dataset. When we search for a relevant piece of information it may appear anywhere in a given passage. However, we observe a bias in…

Information Retrieval · Computer Science 2021-01-19 Sebastian Hofstätter , Aldo Lipani , Sophia Althammer , Markus Zlabinger , Allan Hanbury

With the recent advancements in information technology there has been a huge surge in amount of data available. But information retrieval technology has not been able to keep up with this pace of information generation resulting in over…

Computation and Language · Computer Science 2017-10-24 Nishant Nikhil , Muktabh Mayank Srivastava

Contextual information in search sessions is important for capturing users' search intents. Various approaches have been proposed to model user behavior sequences to improve document ranking in a session. Typically, training samples of…

Information Retrieval · Computer Science 2022-09-16 Yutao Zhu , Jian-Yun Nie , Yixuan Su , Haonan Chen , Xinyu Zhang , Zhicheng Dou

This study embarked on a comprehensive exploration of user preferences between Search Engines and Large Language Models (LLMs) in the context of various information retrieval scenarios. Conducted with a sample size of 100 internet users…

Information Retrieval · Computer Science 2024-01-12 Kevin Matthe Caramancion

Current theories of perception suggest that the brain represents features of the world as probability distributions, but can such uncertain foundations provide the basis for everyday vision? Perceiving objects and scenes requires knowing…

Neurons and Cognition · Quantitative Biology 2022-11-30 Andrey Chetverikov , Árni Kristjánsson

Building on the view of machine learning as search, we demonstrate the necessity of bias in learning, quantifying the role of bias (measured relative to a collection of possible datasets, or more generally, information resources) in…

Machine Learning · Computer Science 2019-07-16 George D. Montanez , Jonathan Hayase , Julius Lauw , Dominique Macias , Akshay Trikha , Julia Vendemiatti

In this work, we introduce the notion of Context-Based Prediction Models. A Context-Based Prediction Model determines the probability of a user's action (such as a click or a conversion) solely by relying on user and contextual features,…

Information Retrieval · Computer Science 2023-08-03 Jan Hartman , Assaf Klein , Davorin Kopič , Natalia Silberstein

Vision-language models (VLMs) have demonstrated impressive performance by effectively integrating visual and textual information to solve complex tasks. However, it is not clear how these models reason over the visual and textual data…

Artificial Intelligence · Computer Science 2025-04-15 Pouya Pezeshkpour , Moin Aminnaseri , Estevam Hruschka

It has been shown that word embeddings derived from large corpora tend to incorporate biases present in their training data. Various methods for mitigating these biases have been proposed, but recent work has demonstrated that these methods…

Computation and Language · Computer Science 2023-06-27 Hailey Joren , David Alvarez-Melis

Recently, deep learning has started to play an essential role in healthcare applications, including image search in digital pathology. Despite the recent progress in computer vision, significant issues remain for image searching in…

Image and Video Processing · Electrical Eng. & Systems 2023-04-19 Pooria Mazaheri , Azam Asilian Bidgoli , Shahryar Rahnamayan , H. R. Tizhoosh

Medical image diagnosis is challenging because many diseases resemble normal anatomy and exhibit substantial interpatient variability. Clinicians routinely rely on comparative diagnosis, such as referencing cross-patient healthy control…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ruinan Jin , Gexin Huang , Xinwei Shen , Qiong Zhang , Yan Shuo Tan , Xiaoxiao Li