English
Related papers

Related papers: Next-Scale Generative Reranking: A Tree-based Gene…

200 papers

Histogram-based template fits are the main technique used for estimating parameters of high energy physics Monte Carlo generators. Parametrized neural network reweighting can be used to extend this fitting procedure to many dimensions and…

High Energy Physics - Phenomenology · Physics 2021-04-08 Anders Andreassen , Shih-Chieh Hsu , Benjamin Nachman , Natchanon Suaysom , Adi Suresh

Generative adversarial networks (GAN) have recently been shown to be efficient for speech enhancement. However, most, if not all, existing speech enhancement GANs (SEGAN) make use of a single generator to perform one-stage enhancement…

Machine Learning · Computer Science 2020-10-28 Huy Phan , Ian V. McLoughlin , Lam Pham , Oliver Y. Chén , Philipp Koch , Maarten De Vos , Alfred Mertins

Recently, a novel generative retrieval (GR) paradigm has been proposed, where a single sequence-to-sequence model is learned to directly generate a list of relevant document identifiers (docids) given a query. Existing GR models commonly…

Information Retrieval · Computer Science 2024-03-20 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Xueqi Cheng

Learning to Rank (LTR) algorithms are usually evaluated using Information Retrieval metrics like Normalised Discounted Cumulative Gain (NDCG) or Mean Average Precision. As these metrics rely on sorting predicted items' scores (and thus, on…

Information Retrieval · Computer Science 2021-05-25 Przemysław Pobrotyn , Radosław Białobrzeski

Recent generative models based on score matching and flow matching have significantly advanced generation tasks, but their potential in discriminative tasks remains underexplored. Previous approaches, such as generative classifiers, have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Rongkun Xue , Jinouwen Zhang , Yazhe Niu , Dazhong Shen , Bingqi Ma , Yu Liu , Jing Yang

Large-scale recommendations commonly adopt a multi-stage cascading ranking system paradigm to balance effectiveness and efficiency. Early Stage Ranking (ESR) systems utilize the "user-item decoupling" approach, where independently learned…

We introduce MCTS-RAG, a novel approach that enhances the reasoning capabilities of small language models on knowledge-intensive tasks by leveraging retrieval-augmented generation (RAG) to provide relevant context and Monte Carlo Tree…

Computation and Language · Computer Science 2025-10-09 Yunhai Hu , Yilun Zhao , Chen Zhao , Arman Cohan

The goal of knowledge graph completion (KGC) is to predict missing facts among entities. Previous methods for KGC re-ranking are mostly built on non-generative language models to obtain the probability of each candidate. Recently,…

Artificial Intelligence · Computer Science 2024-03-27 Yilin Wang , Minghao Hu , Zhen Huang , Dongsheng Li , Dong Yang , Xicheng Lu

Recommendation system delivers substantial economic benefits by providing personalized predictions. Generative recommendation (GR) integrates LLMs to enhance the understanding of long user-item sequences. Despite employing attention-based…

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

Despite the rise to dominance of deep learning in unstructured data domains, tree-based methods such as Random Forests (RF) and Gradient Boosted Decision Trees (GBDT) are still the workhorses for handling discriminative tasks on tabular…

Machine Learning · Computer Science 2025-04-21 João Bravo

Generative Recommenders (GRs), exemplified by the Hierarchical Sequential Transduction Unit (HSTU), have emerged as a powerful paradigm for modeling long user interaction sequences. However, we observe that their "flat-sequence" assumption…

Information Retrieval · Computer Science 2026-03-03 Zerui Chen , Heng Chang , Tianying Liu , Chuantian Zhou , Yi Cao , Jiandong Ding , Ming Liu , Bing Qin

The goal of modern sequential recommender systems is often formulated in terms of next-item prediction. In this paper, we explore the applicability of generative transformer-based models for the Top-K sequential recommendation task, where…

Information Retrieval · Computer Science 2025-08-19 Anna Volodkevich , Danil Gusak , Anton Klenitskiy , Alexey Vasilev

Real-world optimization problems may have a different underlying structure. In black-box optimization, the dependencies between decision variables remain unknown. However, some techniques can discover such interactions accurately. In Large…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Marcin Michal Komarnicki , Michal Witold Przewozniczek , Halina Kwasnicka , Krzysztof Walkowiak

Conversational recommender systems have attracted immense attention recently. The most recent approaches rely on neural models trained on recorded dialogs between humans, implementing an end-to-end learning process. These systems are…

Information Retrieval · Computer Science 2022-05-26 Ahtsham Manzoor , Dietmar Jannach

Binary Neural Networks (BNNs) have garnered significant attention due to their immense potential for deployment on edge devices. However, the non-differentiability of the quantization function poses a challenge for the optimization of BNNs,…

Machine Learning · Computer Science 2024-12-17 Xinquan Chen , Junqi Gao , Biqing Qi , Dong Li , Yiang Luo , Fangyuan Li , Pengfei Li

Generative recommendation aims to learn the underlying generative process over the entire item set to produce recommendations for users. Although it leverages non-linear probabilistic models to surpass the limited modeling capacity of…

Information Retrieval · Computer Science 2025-04-24 Yi Zhang , Yiwen Zhang , Yu Wang , Tong Chen , Hongzhi Yin

Sequence generation with reinforcement learning (RL) has received significant attention recently. However, a challenge with such methods is the sparse-reward problem in the RL training process, in which a scalar guiding signal is often only…

Computation and Language · Computer Science 2018-11-05 Ruiyi Zhang , Changyou Chen , Zhe Gan , Wenlin Wang , Liqun Chen , Dinghan Shen , Guoyin Wang , Lawrence Carin

Generative Recommendation (GR) has become a promising end-to-end approach with high FLOPS utilization for resource-efficient recommendation. Despite the effectiveness, we show that current GR models suffer from a critical \textbf{bias…

Information Retrieval · Computer Science 2026-02-05 Xinyu Lin , Pengyuan Liu , Wenjie Wang , Yicheng Hu , Chen Xu , Fuli Feng , Qifan Wang , Tat-Seng Chua

Although advancements in deep learning have significantly enhanced the recommendation accuracy of deep recommendation models, these methods still suffer from low recommendation efficiency. Recently proposed tree-based deep recommendation…

Information Retrieval · Computer Science 2026-01-29 Ze Liu , Jin Zhang , Chao Feng , Defu Lian , Jie Wang , Enhong Chen