English
Related papers

Related papers: A Theoretical Analysis of Recommendation Loss Func…

200 papers

This paper reports on the development of a Consistency Regularized model for Bayesian Personalized Ranking (CR-BPR), addressing to the drawbacks in existing complementary clothing recommendation methods, namely limited consistency and…

Information Retrieval · Computer Science 2024-11-20 Shuiying Liao , P. Y. Mok , Li Li

Many strong decoding methods for text generation follow a sample-and-rerank paradigm: they draw multiple candidates, score each under a utility (reward) function using consensus across samples, and return the best one. Although effective,…

Machine Learning · Computer Science 2026-02-04 Yuki Ichihara , Yuu Jinnai , Kaito Ariu , Eiji Uchibe

Minimum Bayes-risk (MBR) decoding has recently gained renewed attention in text generation. MBR decoding considers texts sampled from a model as pseudo-references and selects the text with the highest similarity to the others. Therefore,…

Computation and Language · Computer Science 2024-04-02 Atsumoto Ohashi , Ukyo Honda , Tetsuro Morimura , Yuu Jinnai

Dual-encoder retrievers depend on the principle that relevant documents should score higher than irrelevant ones for a given query. Yet the dominant Noise Contrastive Estimation (NCE) objective, which underpins Contrastive Loss, optimizes a…

Information Retrieval · Computer Science 2025-10-02 Nima Sheikholeslami , Erfan Hosseini , Patrice Bechard , Srivatsava Daruru , Sai Rajeswar

In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. A risk measure often focuses on the worst returns out of the agent's experience. As a result, standard methods for risk-averse RL often…

Machine Learning · Computer Science 2022-10-13 Ido Greenberg , Yinlam Chow , Mohammad Ghavamzadeh , Shie Mannor

Classification on imbalanced datasets is a challenging task in real-world applications. Training conventional classification algorithms directly by minimizing classification error in this scenario can compromise model performance for…

Machine Learning · Computer Science 2020-03-05 Xiangrui Li , Dongxiao Zhu

Noise contrastive learning is a popular technique for unsupervised representation learning. In this approach, a representation is obtained via reduction to supervised learning, where given a notion of semantic similarity, the learner tries…

Machine Learning · Computer Science 2021-06-21 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Dipendra Misra

Denoising autoencoders (DAEs) are powerful deep learning models used for feature extraction, data generation and network pre-training. DAEs consist of an encoder and decoder which may be trained simultaneously to minimise a loss (function)…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Antonia Creswell , Kai Arulkumaran , Anil A. Bharath

Negative sampling (NS) loss plays an important role in learning knowledge graph embedding (KGE) to handle a huge number of entities. However, the performance of KGE degrades without hyperparameters such as the margin term and number of…

Machine Learning · Computer Science 2022-07-08 Hidetaka Kamigaito , Katsuhiko Hayashi

Cross-Entropy Method (CEM) is commonly used for planning in model-based reinforcement learning (MBRL) where a centralized approach is typically utilized to update the sampling distribution based on only the top-$k$ operation's results on…

Machine Learning · Computer Science 2022-12-19 Zichen Zhang , Jun Jin , Martin Jagersand , Jun Luo , Dale Schuurmans

Recommender systems (RSs) are software tools and algorithms developed to alleviate the problem of information overload, which makes it difficult for a user to make right decisions. Two main paradigms toward the recommendation problem are…

Information Retrieval · Computer Science 2021-05-24 Mehdi Afsar , Trafford Crump , Behrouz Far

We propose minimum regret search (MRS), a novel acquisition function for Bayesian optimization. MRS bears similarities with information-theoretic approaches such as entropy search (ES). However, while ES aims in each query at maximizing the…

Machine Learning · Statistics 2016-05-25 Jan Hendrik Metzen

This paper studies cross-domain lossy compression through the lens of minimum entropy coupling (MEC) with rate and classification constraints. In this setting, an encoder observes samples from a degraded source domain, while the decoder is…

Information Theory · Computer Science 2026-05-12 Nam Nguyen , Hassan Tavakoli , An Vuong , Thinh Nguyen , Bella Bose

Blind Compressed Sensing (BCS) is an extension of Compressed Sensing (CS) where the optimal sparsifying dictionary is assumed to be unknown and subject to estimation (in addition to the CS sparse coefficients). Since the emergence of BCS,…

Information Theory · Computer Science 2015-08-11 Mohammad Aghagolzadeh , Hayder Radha

Recent advances in machine translation (MT) have shown that Minimum Bayes Risk (MBR) decoding can be a powerful alternative to beam search decoding, especially when combined with neural-based utility functions. However, the performance of…

Computation and Language · Computer Science 2023-05-19 Markus Freitag , Behrooz Ghorbani , Patrick Fernandes

A choice of optimization objective is immensely pivotal in the design of a recommender system as it affects the general modeling process of a user's intent from previous interactions. Existing approaches mainly adhere to three categories of…

Machine Learning · Computer Science 2024-08-02 Hyunsoo Chung , Jungtaek Kim , Hyungeun Jo , Hyungwon Choi

Interactions between search and recommendation have recently attracted significant attention, and several studies have shown that many potential applications involve with a joint problem of producing recommendations to users with respect to…

Information Retrieval · Computer Science 2014-12-15 Lu Yu , Junming Huang , Chuang Liu , Zike Zhang

Deep learning systems have been reported to achieve state-of-the-art performances in many applications, and a key is the existence of well trained classifiers on benchmark datasets. As a main-stream loss function, the cross entropy can…

Machine Learning · Computer Science 2022-09-22 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao

In this paper, we study the problem of compressed sensing using binary measurement matrices and $\ell_1$-norm minimization (basis pursuit) as the recovery algorithm. We derive new upper and lower bounds on the number of measurements to…

Machine Learning · Statistics 2020-04-28 Mahsa Lotfi , Mathukumalli Vidyasagar

Sequential recommendation is a popular task in academic research and close to real-world application scenarios, where the goal is to predict the next action(s) of the user based on his/her previous sequence of actions. In the training…

Information Retrieval · Computer Science 2022-04-26 Yuli Liu , Christian Walder , Lexing Xie