English
Related papers

Related papers: Direct Learning to Rank and Rerank

200 papers

This article introduces the concept of optimization learning, a methodology to design optimization proxies that learn the input/output mapping of parametric optimization problems. These optimization proxies are trustworthy by design: they…

Optimization and Control · Mathematics 2025-01-08 Pascal Van Hentenryck

This paper studies a stylized, yet natural, learning-to-rank problem and points out the critical incorrectness of a widely used nearest neighbor algorithm. We consider a model with $n$ agents (users) $\{x_i\}_{i \in [n]}$ and $m$…

Machine Learning · Computer Science 2018-07-11 Ao Liu , Qiong Wu , Zhenming Liu , Lirong Xia

Nowadays, state-of-the-art learning-to-rank methods are based on gradient-boosted decision trees (GBDT). The most well-known algorithm is LambdaMART which was proposed more than a decade ago. Recently, several other GBDT-based ranking…

Machine Learning · Computer Science 2023-10-10 Ivan Lyzhin , Aleksei Ustimenko , Andrey Gulin , Liudmila Prokhorenkova

We address the problem of learning a ranking by using adaptively chosen pairwise comparisons. Our goal is to recover the ranking accurately but to sample the comparisons sparingly. If all comparison outcomes are consistent with the ranking,…

Machine Learning · Statistics 2017-06-16 Lucas Maystre , Matthias Grossglauser

We investigate learning heuristics for domain-specific planning. Prior work framed learning a heuristic as an ordinary regression problem. However, in a greedy best-first search, the ordering of states induced by a heuristic is more…

Artificial Intelligence · Computer Science 2016-08-04 Caelan Reed Garrett , Leslie Pack Kaelbling , Tomas Lozano-Perez

Low-rank matrix recovery problems are inverse problems which naturally arise in various fields like signal processing, imaging and machine learning. They are non-convex and NP-hard in full generality. It is therefore a delicate problem to…

Optimization and Control · Mathematics 2021-05-24 Irène Waldspurger

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

Machine Learning · Computer Science 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

To accelerate DNNs inference, low-rank approximation has been widely adopted because of its solid theoretical rationale and efficient implementations. Several previous works attempted to directly approximate a pre-trained model by low-rank…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Yuhui Xu , Yuxi Li , Shuai Zhang , Wei Wen , Botao Wang , Wenrui Dai , Yingyong Qi , Yiran Chen , Weiyao Lin , Hongkai Xiong

We study the computational complexity of (deterministic or randomized) algorithms based on point samples for approximating or integrating functions that can be well approximated by neural networks. Such algorithms (most prominently…

Machine Learning · Computer Science 2021-04-08 Philipp Grohs , Felix Voigtlaender

Graded labels are ubiquitous in real-world learning-to-rank applications, especially in human rated relevance data. Traditional learning-to-rank techniques aim to optimize the ranked order of documents. They typically, however, ignore…

Information Retrieval · Computer Science 2023-06-21 Le Yan , Zhen Qin , Gil Shamir , Dong Lin , Xuanhui Wang , Mike Bendersky

Learning-to-rank has been intensively studied and has shown significantly increasing values in a wide range of domains. The performance of learning-to-rank methods is commonly evaluated using rank-sensitive metrics, such as average…

Information Retrieval · Computer Science 2020-09-01 Hai-Tao Yu

The problem of relevance ranking consists of sorting a set of objects with respect to a given criterion. Since users may prefer different relevance criteria, the ranking algorithms should be adaptable to the user needs. Two main approaches…

Machine Learning · Computer Science 2023-11-06 Leonardo Rigutini , Tiziano Papini , Marco Maggini , Franco Scarselli

Object ranking is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects, which are typically represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2018-12-07 Karlson Pfannschmidt , Pritha Gupta , Eyke Hüllermeier

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

Low-rank regularization (LRR) has been widely applied in various machine learning tasks, but the associated optimization is challenging. Directly optimizing the rank function under constraints is NP-hard in general. To overcome this…

Machine Learning · Computer Science 2025-05-22 Naiqi Li , Yuqiu Xie , Peiyuan Liu , Tao Dai , Yong Jiang , Shu-Tao Xia

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

Information Retrieval · Computer Science 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

According to the Probability Ranking Principle (PRP), ranking documents in decreasing order of their probability of relevance leads to an optimal document ranking for ad-hoc retrieval. The PRP holds when two conditions are met: [C1] the…

Information Retrieval · Computer Science 2021-01-13 Gustavo Penha , Claudia Hauff

Low rank regularization, in essence, involves introducing a low rank or approximately low rank assumption for matrix we aim to learn, which has achieved great success in many fields including machine learning, data mining and computer…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Zhanxuan Hu , Feiping Nie , Rong Wang , Xuelong Li

Answering multiple-choice questions in a setting in which no supporting documents are explicitly provided continues to stand as a core problem in natural language processing. The contribution of this article is two-fold. First, it describes…

Computation and Language · Computer Science 2019-11-15 George-Sebastian Pîrtoacă , Traian Rebedea , Stefan Ruseti

Online learning to rank is a core problem in machine learning. In Lattimore et al. (2018), a novel online learning algorithm was proposed based on topological sorting. In the paper they provided a set of self-normalized inequalities (a) in…

Machine Learning · Statistics 2020-01-22 Victor de la Pena , Haolin Zou