English
Related papers

Related papers: Ranking Info Noise Contrastive Estimation: Boostin…

200 papers

Click-through rate (CTR) prediction is a crucial area of research in online advertising. While binary cross entropy (BCE) has been widely used as the optimization objective for treating CTR prediction as a binary classification problem,…

Information Retrieval · Computer Science 2024-07-09 Zhutian Lin , Junwei Pan , Shangyu Zhang , Ximei Wang , Xi Xiao , Shudong Huang , Lei Xiao , Jie Jiang

Listwise learning-to-rank methods form a powerful class of ranking algorithms that are widely adopted in applications such as information retrieval. These algorithms learn to rank a set of items by optimizing a loss that is a function of…

Machine Learning · Computer Science 2021-02-08 Sebastian Bruch

We investigate improving the retrieval effectiveness of embedding models through the lens of corpus-specific fine-tuning. Prior work has shown that fine-tuning with queries generated using a dataset's retrieval corpus can boost retrieval…

Information Retrieval · Computer Science 2025-05-27 Manveer Singh Tamber , Suleman Kazi , Vivek Sourabh , Jimmy Lin

We propose a two-stage "Mine and Refine" contrastive training framework for semantic text embeddings to enhance multi-category e-commerce search retrieval. Large scale e-commerce search demands embeddings that generalize to long tail, noisy…

Information Retrieval · Computer Science 2026-02-20 Jiaqi Xi , Raghav Saboo , Luming Chen , Martin Wang , Sudeep Das

Reranker models aim to re-rank the passages based on the semantics similarity between the given query and passages, which have recently received more attention due to the wide application of the Retrieval-Augmented Generation. Most previous…

Computation and Language · Computer Science 2025-01-14 Junlong Liu , Yue Ma , Ruihui Zhao , Junhao Zheng , Qianli Ma , Yangyang Kang

Fabric image retrieval is beneficial to many applications including clothing searching, online shopping and cloth modeling. Learning pairwise image similarity is of great importance to an image retrieval task. With the resurgence of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Daiguo Deng , Ruomei Wang , Hefeng Wu , Huayong He , Qi Li , Xiaonan Luo

In a number of information retrieval applications (e.g., patent search, literature review, due diligence, etc.), preventing false negatives is more important than preventing false positives. However, approaches designed to reduce review…

Computation and Language · Computer Science 2023-11-28 Timo Kats , Peter van der Putten , Jan Scholtes

Previous highly scalable one-class collaborative filtering methods such as Projected Linear Recommendation (PLRec) have advocated using fast randomized SVD to embed items into a latent space, followed by linear regression methods to learn…

Information Retrieval · Computer Science 2018-11-05 Ga Wu , Maksims Volkovs , Chee Loong Soon , Scott Sanner , Himanshu Rai

Noise Contrastive Estimation (NCE) is a powerful parameter estimation method for log-linear models, which avoids calculation of the partition function or its derivatives at each training step, a computationally demanding step in many cases.…

Computation and Language · Computer Science 2018-09-07 Zhuang Ma , Michael Collins

It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A…

Machine Learning · Statistics 2014-03-11 Michael R. Smith , Tony Martinez

Noise-contrastive estimation (NCE) is a popular method for estimating unnormalised probabilistic models, such as energy-based models, which are effective for modelling complex data distributions. Unlike classical maximum likelihood (ML)…

Machine Learning · Statistics 2024-02-27 Amanda Olmin , Jakob Lindqvist , Lennart Svensson , Fredrik Lindsten

Following SimCSE, contrastive learning based methods have achieved the state-of-the-art (SOTA) performance in learning sentence embeddings. However, the unsupervised contrastive learning methods still lag far behind the supervised…

Computation and Language · Computer Science 2022-06-07 Wei Wang , Liangzhu Ge , Jingqiao Zhang , Cheng Yang

One-class collaborative filtering (OC-CF) is a common class of recommendation problem where only the positive class is explicitly observed (e.g., purchases, clicks). Autoencoder based recommenders such as AutoRec and variants demonstrate…

Information Retrieval · Computer Science 2020-08-07 Jin Peng Zhou , Ga Wu , Zheda Mai , Scott Sanner

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

Identifying influential nodes in complex networks is a fundamental task in network analysis with wide-ranging applications across domains. While deep learning has advanced node influence detection, existing supervised approaches remain…

Social and Information Networks · Computer Science 2025-09-04 Yanmei Hu , Yihang Wu , Bing Sun , Xue Yue , Biao Cai , Xiangtao Li , Yang Chen

Unsupervised person re-identification (ReID) aims at learning discriminative identity features without annotations. Recently, self-supervised contrastive learning has gained increasing attention for its effectiveness in unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hao Chen , Benoit Lagadec , Francois Bremond

Many parametric statistical models are not properly normalised and only specified up to an intractable partition function, which renders parameter estimation difficult. Examples of unnormalised models are Gibbs distributions, Markov random…

Machine Learning · Statistics 2018-06-12 Ciwan Ceylan , Michael U. Gutmann

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between distributions that differ substantially, which…

Person re identification is a challenging retrieval task that requires matching a person's acquired image across non overlapping camera views. In this paper we propose an effective approach that incorporates both the fine and coarse pose…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 M. Saquib Sarfraz , Arne Schumann , Andreas Eberle , Rainer Stiefelhagen