English
Related papers

Related papers: Efficient and Effective Tree-based and Neural Lear…

200 papers

Dynamic regression trees are an attractive option for automatic regression and classification with complicated response surfaces in on-line application settings. We create a sequential tree model whose state changes in time with the…

Methodology · Statistics 2010-11-23 Matthew A. Taddy , Robert B. Gramacy , Nicholas G. Polson

We investigate the exploitation of both lexical and neural relevance signals for ad-hoc passage retrieval. Our exploration involves a large-scale training dataset in which dense neural representations of MS-MARCO queries and passages are…

Information Retrieval · Computer Science 2025-10-21 Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto , Salvatore Trani

Recent efforts to learn reward functions from human feedback have tended to use deep neural networks, whose lack of transparency hampers our ability to explain agent behaviour or verify alignment. We explore the merits of learning…

Machine Learning · Computer Science 2022-10-04 Tom Bewley , Jonathan Lawry , Arthur Richards , Rachel Craddock , Ian Henderson

Dual-encoder-based dense retrieval models have become the standard in IR. They employ large Transformer-based language models, which are notoriously inefficient in terms of resources and latency. We propose Fast-Forward indexes -- vector…

Information Retrieval · Computer Science 2023-11-03 Jurek Leonhardt , Henrik Müller , Koustav Rudra , Megha Khosla , Abhijit Anand , Avishek Anand

Based on decision trees, many fields have arguably made tremendous progress in recent years. In simple words, decision trees use the strategy of "divide-and-conquer" to divide the complex problem on the dependency between input features and…

Machine Learning · Computer Science 2021-01-22 Jinxiong Zhang

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Giorgio Roffo

The design of algorithms that generate personalized ranked item lists is a central topic of research in the field of recommender systems. In the past few years, in particular, approaches based on deep learning (neural) techniques have…

Information Retrieval · Computer Science 2021-01-08 Maurizio Ferrari Dacrema , Simone Boglio , Paolo Cremonesi , Dietmar Jannach

With the rapid advance of the Internet, search engines (e.g., Google, Bing, Yahoo!) are used by billions of users for each day. The main function of a search engine is to locate the most relevant webpages corresponding to what the user…

Applications · Statistics 2018-03-15 Xinzhi Han , Sen Lei

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

Computation and Language · Computer Science 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

With the rise of social networks, information on the internet is no longer solely organized by web pages. Rather, content is generated and shared among users and organized around their social relations on social networks. This presents new…

Information Retrieval · Computer Science 2020-05-12 Yunzhong He , Wenyuan Li , Liang-Wei Chen , Gabriel Forgues , Xunlong Gui , Sui Liang , Bo Hou

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation and the vision of the Internet-of-Things fuel the interest in resource efficient approaches. These approaches require a carefully…

For ambiguous queries, conventional retrieval systems are bound by two conflicting goals. On the one hand, they should diversify and strive to present results for as many query intents as possible. On the other hand, they should provide…

Information Retrieval · Computer Science 2015-03-19 Karthik Raman , Thorsten Joachims , Pannaga Shivaswamy

In real-world search, recommendation, and advertising systems, the multi-stage ranking architecture is commonly adopted. Such architecture usually consists of matching, pre-ranking, ranking, and re-ranking stages. In the pre-ranking stage,…

Information Retrieval · Computer Science 2021-05-18 Xu Ma , Pengjie Wang , Hui Zhao , Shaoguo Liu , Chuhan Zhao , Wei Lin , Kuang-Chih Lee , Jian Xu , Bo Zheng

In recent years, representation learning has become the research focus of the machine learning community. Large-scale neural networks are a crucial step toward achieving general intelligence, with their success largely attributed to their…

Machine Learning · Computer Science 2025-04-22 Lifeng Gu

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

Information Retrieval · Computer Science 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

Recently, neural models for information retrieval are becoming increasingly popular. They provide effective approaches for product search due to their competitive advantages in semantic matching. However, it is challenging to use…

Information Retrieval · Computer Science 2019-01-25 Yuan Zhang , Dong Wang , Yan Zhang

Deep research agents, which synthesize information across diverse sources, are significantly constrained by the sequential nature of reasoning. This bottleneck results in high latency, poor runtime adaptability, and inefficient resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-31 Lunyiu Nie , Nedim Lipka , Ryan A. Rossi , Swarat Chaudhuri

We present a context-aware neural ranking model to exploit users' on-task search activities and enhance retrieval performance. In particular, a two-level hierarchical recurrent neural network is introduced to learn search context…

Information Retrieval · Computer Science 2019-06-07 Wasi Uddin Ahmad , Kai-Wei Chang , Hongning Wang

Deep learning is pervasive in our daily life, including self-driving cars, virtual assistants, social network services, healthcare services, face recognition, etc. However, deep neural networks demand substantial compute resources during…

We study the problem of balancing effectiveness and efficiency in automated feature selection. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection is mostly efficient, but…

Machine Learning · Computer Science 2020-10-07 Wei Fan , Kunpeng Liu , Hao Liu , Yong Ge , Hui Xiong , Yanjie Fu