English
Related papers

Related papers: Context Uncertainty in Contextual Bandits with App…

200 papers

Current Deep Learning methods for environment segmentation and velocity estimation rely on Convolutional Recurrent Neural Networks to exploit spatio-temporal relationships within obtained sensor data. These approaches derive scene dynamics…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Marco Braun , Moritz Luszek , Mirko Meuter , Dominic Spata , Kevin Kollek , Anton Kummert

The Evidential Regression Network (ERN) represents a novel approach that integrates deep learning with Dempster-Shafer's theory to predict a target and quantify the associated uncertainty. Guided by the underlying theory, specific…

Machine Learning · Computer Science 2024-01-04 Kai Ye , Tiejin Chen , Hua Wei , Liang Zhan

As one of the prevalent topic mining tools, neural topic modeling has attracted a lot of interests for the advantages of high efficiency in training and strong generalisation abilities. However, due to the lack of context in each short…

Information Retrieval · Computer Science 2020-08-12 Jiachun Feng , Zusheng Zhang , Cheng Ding , Yanghui Rao , Haoran Xie

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

Micro-segmentation of customers in the finance sector is a non-trivial task and has been an atypical omission from recent scientific literature. Where traditional segmentation classifies customers based on coarse features such as…

Machine Learning · Computer Science 2021-12-13 Charl Maree , Christian W. Omlin

Targeted sentiment classification aims at determining the sentimental tendency towards specific targets. Most of the previous approaches model context and target words with RNN and attention. However, RNNs are difficult to parallelize and…

Computation and Language · Computer Science 2019-09-24 Youwei Song , Jiahai Wang , Tao Jiang , Zhiyue Liu , Yanghui Rao

Uniform random exploration in decision-making systems supports off-policy learning via supervision but incurs high regret, making it impractical for many applications. Conversely, non-uniform exploration offers better immediate performance…

Machine Learning · Computer Science 2025-07-11 Akhila Vangara , Alex Egg

The contextual bandit problem, which is a type of reinforcement learning tasks, provides an effective framework for solving challenges in recommendation systems, such as satisfying real-time requirements, enabling personalization,…

Machine Learning · Computer Science 2025-01-16 Shogo Ito , Tatsuji Takahashi , Yu Kono

Recurrent Neural Networks (RNNs) are very successful at solving challenging problems with sequential data. However, this observed efficiency is not yet entirely explained by theory. It is known that a certain class of multiplicative RNNs…

Machine Learning · Computer Science 2019-01-31 Valentin Khrulkov , Oleksii Hrinchuk , Ivan Oseledets

Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some…

Computation and Language · Computer Science 2017-03-24 Youssef Oualil , Clayton Greenberg , Mittul Singh , Dietrich Klakow

Personalized recommendations for new users, also known as the cold-start problem, can be formulated as a contextual bandit problem. Existing contextual bandit algorithms generally rely on features alone to capture user variability. Such…

Machine Learning · Computer Science 2016-04-25 Li Zhou , Emma Brunskill

In this paper, we propose a deep neural network architecture for object recognition based on recurrent neural networks. The proposed network, called ReNet, replaces the ubiquitous convolution+pooling layer of the deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2015-07-24 Francesco Visin , Kyle Kastner , Kyunghyun Cho , Matteo Matteucci , Aaron Courville , Yoshua Bengio

This paper addresses two persistent challenges in sequential recommendation: (i) evidence insufficiency-cold-start sparsity together with noisy, length-varying item texts; and (ii) opaque modeling of dynamic, multi-faceted intents across…

Information Retrieval · Computer Science 2026-04-29 Yuchen Miao , Mingxuan Cui , Yitong Zhu , Yu Wang , Siyang Xu

We study a general class of contextual bandits, where each context-action pair is associated with a raw feature vector, but the reward generating function is unknown. We propose a novel learning algorithm that transforms the raw feature…

Machine Learning · Computer Science 2020-12-04 Pan Xu , Zheng Wen , Handong Zhao , Quanquan Gu

Real-world sequential signals, such as audio or video, contain critical information that is often embedded within long periods of silence or noise. While recurrent neural networks (RNNs) are designed to process such data efficiently, they…

Machine Learning · Computer Science 2026-05-01 Bojian Yin , Shurong Wang , Haoyu Tan , Sander Bohte , Federico Corradi , Guoqi Li

Detecting structure in noisy time series is a difficult task. One intuitive feature is the notion of trend. From theoretical hints and using simulated time series, we empirically investigate the efficiency of standard recurrent neural…

Machine Learning · Computer Science 2021-10-22 Alexandre Miot , Gilles Drigout

We present a new recommendation setting for picking out two items from a given set to be highlighted to a user, based on contextual input. These two items are presented to a user who chooses one of them, possibly stochastically, with a bias…

Machine Learning · Computer Science 2016-01-26 Daniel Barsky , Koby Crammer

The key component in forecasting demand and consumption of resources in a supply network is an accurate prediction of real-valued time series. Indeed, both service interruptions and resource waste can be reduced with the implementation of…

Neural and Evolutionary Computing · Computer Science 2018-07-24 Filippo Maria Bianchi , Enrico Maiorino , Michael C. Kampffmeyer , Antonello Rizzi , Robert Jenssen

We study an online decision making problem where on each round a learner chooses a list of items based on some side information, receives a scalar feedback value for each individual item, and a reward that is linearly related to this…

Machine Learning · Computer Science 2016-11-07 Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudik

The artificial neural network shows powerful ability of inference, but it is still criticized for lack of interpretability and prerequisite needs of big dataset. This paper proposes the Rule-embedded Neural Network (ReNN) to overcome the…

Machine Learning · Computer Science 2018-09-03 Hu Wang