English
Related papers

Related papers: Web-Scale Responsive Visual Search at Bing

200 papers

As user content and queries become increasingly multi-modal, the need for effective multi-modal search systems has grown. Traditional search systems often rely on textual and metadata annotations for indexed images, while multi-modal…

We tackle the problem of visual search under resource constraints. Existing systems use the same embedding model to compute representations (embeddings) for the query and gallery images. Such systems inherently face a hard…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Rahul Duggal , Hao Zhou , Shuo Yang , Yuanjun Xiong , Wei Xia , Zhuowen Tu , Stefano Soatto

The overarching goals in image-based localization are scale, robustness and speed. In recent years, approaches based on local features and sparse 3D point-cloud models have both dominated the benchmarks and seen successful realworld…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Simon Lynen , Bernhard Zeisl , Dror Aiger , Michael Bosse , Joel Hesch , Marc Pollefeys , Roland Siegwart , Torsten Sattler

The quality of user experience online is affected by the relevance and placement of advertisements. We propose a new system for selecting and displaying visual advertisements in image search result sets. Our method compares the visual…

Computer Vision and Pattern Recognition · Computer Science 2016-04-25 Yannis Kalantidis , Ayman Farahat , Lyndon Kennedy , Ricardo Baeza-Yates , David A. Shamma

An interactive image retrieval system learns which images in the database belong to a user's query concept, by analyzing the example images and feedback provided by the user. The challenge is to retrieve the relevant images with minimal…

Machine Learning · Computer Science 2018-02-13 Akshay Mehra , Jihun Hamm , Mikhail Belkin

Although traditionally binary visual representations are mainly designed to reduce computational and storage costs in the image retrieval research, this paper argues that binary visual representations can be applied to large scale…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Jianxin Wu , Jian-Hao Luo

Detecting near duplicate images is fundamental to the content ecosystem of photo sharing web applications. However, such a task is challenging when involving a web-scale image corpus containing billions of images. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Andrey Gusev , Jiajing Xu

High-resolution (HR) image perception presents a key bottleneck for multimodal large language models (MLLMs). While visual search offers a promising solution, existing methods struggle with the trade-off between coverage and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Liupeng Li , Haoqian Kang , Zhenyu Lu , Jinpeng Wang , Bin Chen , Ke Chen , Yaowei Wang

In web search, typically a candidate generation step selects a small set of documents---from collections containing as many as billions of web pages---that are subsequently ranked and pruned before being presented to the user. In Bing, the…

Information Retrieval · Computer Science 2018-08-21 Corby Rosset , Damien Jose , Gargi Ghosh , Bhaskar Mitra , Saurabh Tiwary

Modeling visual search not only offers an opportunity to predict the usability of an interface before actually testing it on real users, but also advances scientific understanding about human behavior. In this work, we first conduct a set…

Human-Computer Interaction · Computer Science 2020-05-11 Arianna Yuan , Yang Li

Handling large amounts of data has become a key for developing automated driving systems. Especially for developing highly automated driving functions, working with images has become increasingly challenging due to the sheer size of the…

Robotics · Computer Science 2023-04-24 Philipp Rigoll , Patrick Petersen , Hanno Stage , Lennart Ries , Eric Sax

The vast amounts of data collected in various domains pose great challenges to modern data exploration and analysis. To find "interesting" objects in large databases, users typically define a query using positive and negative example…

Enterprise software companies maintain thousands of user interface screens across products and versions, creating critical challenges for design consistency, pattern discovery, and compliance check. Existing approaches rely on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Maroun Ayli , Youssef Bakouny , Tushar Sharma , Nader Jalloul , Hani Seifeddine , Rima Kilany

Large-scale visual search engines are expected to solve a dual problem at once: (i) locate every image that truly contains the object described by a sentence and (ii) identify the object's bounding box or exact pixels within each hit.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Ziling Huang , Yidan Zhang , Shin'ichi Satoh

Many static benchmarks are beginning to saturate: as models rapidly improve, they achieve near-perfect scores on fixed test sets, leaving little headroom to expose genuine model weaknesses -- and even expert-curated challenge sets quickly…

Computation and Language · Computer Science 2026-05-27 Wenda Xu , Vilém Zouhar , Parker Riley , Mara Finkelstein , Markus Freitag , Daniel Deutsch

Due to the high cost of manual annotation, learning directly from the web has attracted broad attention. One issue that limits their performance is the problem of visual polysemy. To address this issue, we present an adaptive multi-model…

Information Retrieval · Computer Science 2019-05-28 Yazhou Yao , Zeren Sun , Fumin Shen , Li Liu , Limin Wang , Fan Zhu , Lizhong Ding , Gangshan Wu , Ling Shao

Similarity search finds application in specialized database systems handling complex data such as images or videos, which are typically represented by high-dimensional features and require specific indexing structures. This paper tackles…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jeff Johnson , Matthijs Douze , Hervé Jégou

Current automatic vision systems face two major challenges: scalability and extreme variability of appearance. First, the computational time required to process an image typically scales linearly with the number of pixels in the image,…

Computer Vision and Pattern Recognition · Computer Science 2014-05-22 Marc'Aurelio Ranzato

In this paper, we present a unified end-to-end approach to build a large scale Visual Search and Recommendation system for e-commerce. Previous works have targeted these problems in isolation. We believe a more effective and elegant…

Computer Vision and Pattern Recognition · Computer Science 2017-03-08 Devashish Shankar , Sujay Narumanchi , H A Ananya , Pramod Kompalli , Krishnendu Chaudhury

In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the…

Machine Learning · Computer Science 2021-01-19 Yigit Alparslan , Ethan Jacob Moyer , Isamu Mclean Isozaki , Daniel Schwartz , Adam Dunlop , Shesh Dave , Edward Kim