English
Related papers

Related papers: Listwise Learning to Rank with Deep Q-Networks

200 papers

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Minghan Li , Xialei Liu , Joost van de Weijer , Bogdan Raducanu

It is common to evaluate the performance of a machine learning model by measuring its predictive power on a test dataset. This approach favors complicated models that can smoothly fit complex functions and generalize well from training data…

Machine Learning · Computer Science 2022-10-07 Hugo Cisneros , Josef Sivic , Tomas Mikolov

Interpretable Learning to Rank (LtR) is an emerging field within the research area of explainable AI, aiming at developing intelligible and accurate predictive models. While most of the previous research efforts focus on creating post-hoc…

Information Retrieval · Computer Science 2022-06-02 Claudio Lucchese , Franco Maria Nardini , Salvatore Orlando , Raffaele Perego , Alberto Veneri

Deep Q-Network (DQN) based multi-agent systems (MAS) for reinforcement learning (RL) use various schemes where in the agents have to learn and communicate. The learning is however specific to each agent and communication may be…

Machine Learning · Computer Science 2020-08-11 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat

Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive efforts have been spent on developing more powerful neural…

Machine Learning · Computer Science 2022-12-22 Nan Wang , Zhen Qin , Le Yan , Honglei Zhuang , Xuanhui Wang , Michael Bendersky , Marc Najork

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left…

Computation and Language · Computer Science 2016-09-29 Shihao Ji , Hyokun Yun , Pinar Yanardag , Shin Matsushima , S. V. N. Vishwanathan

This paper describes a machine learning algorithm for document (re)ranking, in which queries and documents are firstly encoded using BERT [1], and on top of that a learning-to-rank (LTR) model constructed with TF-Ranking (TFR) [2] is…

Information Retrieval · Computer Science 2020-06-11 Shuguang Han , Xuanhui Wang , Mike Bendersky , Marc Najork

This study examines the potential of integrating Learning-to-Rank (LTR) with Query-focused Summarization (QFS) to enhance the summary relevance via content prioritization. Using a shared secondary decoder with the summarization decoder, we…

Computation and Language · Computer Science 2024-11-04 Sajad Sotudeh , Nazli Goharian

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

List-wise learning to rank methods are considered to be the state-of-the-art. One of the major problems with these methods is that the ambiguous nature of relevance labels in learning to rank data is ignored. Ambiguity of relevance labels…

Information Retrieval · Computer Science 2017-07-26 Rolf Jagerman , Julia Kiseleva , Maarten de Rijke

In this paper, we propose a novel multi-task learning method based on the deep convolutional network. The proposed deep network has four convolutional layers, three max-pooling layers, and two parallel fully connected layers. To adjust the…

Machine Learning · Computer Science 2019-04-17 Fang Su , Hai-Yang Shang , Jing-Yan Wang

Value estimation is one key problem in Reinforcement Learning. Albeit many successes have been achieved by Deep Reinforcement Learning (DRL) in different fields, the underlying structure and learning dynamics of value function, especially…

Machine Learning · Computer Science 2021-11-22 Tong Sang , Hongyao Tang , Jianye Hao , Yan Zheng , Zhaopeng Meng

We present a novel algorithm to train a deep Q-learning agent using natural-gradient techniques. We compare the original deep Q-network (DQN) algorithm to its natural-gradient counterpart, which we refer to as NGDQN, on a collection of…

Machine Learning · Computer Science 2018-11-15 Ethan Knight , Osher Lerner

Predictive coding has been widely used in legal matters to find relevant or privileged documents in large sets of electronically stored information. It saves the time and cost significantly. Logistic Regression (LR) and Support Vector…

Information Retrieval · Computer Science 2019-04-04 Fusheng Wei , Han Qin , Shi Ye , Haozhen Zhao

In this paper, we propose new listwise learning-to-rank models that mitigate the shortcomings of existing ones. Existing listwise learning-to-rank models are generally derived from the classical Plackett-Luce model, which has three major…

Information Retrieval · Computer Science 2020-01-24 Xiaofeng Zhu , Diego Klabjan

Ranking models lie at the heart of research on information retrieval (IR). During the past decades, different techniques have been proposed for constructing ranking models, from traditional heuristic methods, probabilistic methods, to…

Information Retrieval · Computer Science 2019-06-28 Jiafeng Guo , Yixing Fan , Liang Pang , Liu Yang , Qingyao Ai , Hamed Zamani , Chen Wu , W. Bruce Croft , Xueqi Cheng

Supervisory signals are a critical resource for training learning to rank models. In many real-world search and retrieval scenarios, these signals may not be readily available or could be costly to obtain for some queries. The examples…

Information Retrieval · Computer Science 2024-10-10 Xuyang Wu , Ajit Puthenputhussery , Hongwei Shang , Changsung Kang , Yi Fang

Deep learning has enjoyed tremendous success in a variety of applications but its application to quantile regressions remains scarce. A major advantage of the deep learning approach is its flexibility to model complex data in a more…

Statistics Theory · Mathematics 2021-06-14 Qixian Zhong , Jane-Ling Wang

Deep Research Agents are a prominent category of LLM-based agents. By autonomously orchestrating multistep web exploration, targeted retrieval, and higher-order synthesis, they transform vast amounts of online information into…

Computation and Language · Computer Science 2025-06-16 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

Object ranking or "learning to rank" is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2017-12-05 Mohsen Ahmadi Fahandar , Eyke Hüllermeier
‹ Prev 1 4 5 6 7 8 10 Next ›