English
Related papers

Related papers: Clustering Items through Bandit Feedback: Finding …

200 papers

The contextual linear bandit is an important online learning problem where given arm features, a learning agent selects an arm at each round to maximize the cumulative rewards in the long run. A line of works, called the clustering of…

Machine Learning · Computer Science 2023-10-11 Zhiyong Wang , Jize Xie , Xutong Liu , Shuai Li , John C. S. Lui

Motivated by problems of learning to rank long item sequences, we introduce a variant of the cascading bandit model that considers flexible length sequences with varying rewards and losses. We formulate two generative models for this…

Machine Learning · Computer Science 2022-09-05 Anirban Santara , Claudio Gentile , Gaurav Aggarwal , Shuai Li

Patchwork learning arises as a new and challenging data collection paradigm where both samples and features are observed in fragmented subsets. Due to technological limits, measurement expense, or multimodal data integration, such patchwork…

Methodology · Statistics 2024-06-21 Lili Zheng , Andersen Chang , Genevera I. Allen

We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is…

Machine Learning · Computer Science 2022-10-17 Jasmin Brandt , Viktor Bengs , Björn Haddenhorst , Eyke Hüllermeier

Clustering is an unsupervised machine learning task that consists of identifying groups of similar objects. It has numerous applications and is increasingly used in fairness-sensitive domains where objects represent individuals, such as…

Machine Learning · Computer Science 2026-05-14 Claudio Mantuano , Manuel Kammermann , Philipp Baumann

Clustering is a widely-used data mining tool, which aims to discover partitions of similar items in data. We introduce a new clustering paradigm, \emph{accordant clustering}, which enables the discovery of (predefined) group level insights.…

Machine Learning · Computer Science 2017-04-11 Amit Dhurandhar , Margareta Ackerman , Xiang Wang

A contextual bandit problem is studied in a highly non-stationary environment, which is ubiquitous in various recommender systems due to the time-varying interests of users. Two models with disjoint and hybrid payoffs are considered to…

Machine Learning · Computer Science 2020-03-03 Xiao Xu , Fang Dong , Yanghua Li , Shaojian He , Xin Li

We propose a new analysis framework for clustering $M$ items into an unknown number of $K$ distinct groups using noisy and actively collected responses. At each time step, an agent is allowed to query pairs of items and observe bandit…

Machine Learning · Computer Science 2026-02-06 Rachel S. Y. Teo , P. N. Karthik , Ramya Korlakai Vinayak , Vincent Y. F. Tan

Many datasets take the form of a bipartite graph where two types of nodes are connected by relationships, like the movies watched by a user or the tags associated with a file. The partitioning of the bipartite graph could be used to fasten…

Information Retrieval · Computer Science 2021-10-01 Gaëlle Candel , David Naccache

We present a new recommendation setting for picking out two items from a given set to be highlighted to a user, based on contextual input. These two items are presented to a user who chooses one of them, possibly stochastically, with a bias…

Machine Learning · Computer Science 2016-01-26 Daniel Barsky , Koby Crammer

We introduce vector optimization problems with stochastic bandit feedback, in which preferences among designs are encoded by a polyhedral ordering cone $C$. Our setup generalizes the best arm identification problem to vector-valued rewards…

Machine Learning · Computer Science 2023-03-09 Çağın Ararat , Cem Tekin

We study identifying user clusters in contextual multi-armed bandits (MAB). Contextual MAB is an effective tool for many real applications, such as content recommendation and online advertisement. In practice, user dependency plays an…

Machine Learning · Computer Science 2023-03-27 Yikun Ban , Jingrui He

The recent advances of conversational recommendations provide a promising way to efficiently elicit users' preferences via conversational interactions. To achieve this, the recommender system conducts conversations with users, asking their…

Information Retrieval · Computer Science 2022-09-14 Jinhang Zuo , Songwen Hu , Tong Yu , Shuai Li , Handong Zhao , Carlee Joe-Wong

The objective of clustering is to discover natural groups in datasets and to identify geometrical structures which might reside there, without assuming any prior knowledge on the characteristics of the data. The problem can be seen as…

Computational Geometry · Computer Science 2018-01-26 Luis-Evaristo Caraballo , José-Miguel Díaz-Báñez , Nadine Kroher

Rapid advancements in the E-commerce sector over the last few decades have led to an imminent need for personalised, efficient and dynamic recommendation systems. To sufficiently cater to this need, we propose a novel method for generating…

Information Retrieval · Computer Science 2020-12-07 Anubha Kabra , Anu Agarwal , Anil Singh Parihar

High-dimensional clustering analysis is a challenging problem in statistics and machine learning, with broad applications such as the analysis of microarray data and RNA-seq data. In this paper, we propose a new clustering procedure called…

Methodology · Statistics 2022-10-31 Tianqi Liu , Yu Lu , Biqing Zhu , Hongyu Zhao

We introduce an unsupervised approach to efficiently discover the underlying features in a data set via crowdsourcing. Our queries ask crowd members to articulate a feature common to two out of three displayed examples. In addition we also…

Machine Learning · Statistics 2015-04-02 James Y. Zou , Kamalika Chaudhuri , Adam Tauman Kalai

The problem of hierarchical clustering items from pairwise similarities is found across various scientific disciplines, from biology to networking. Often, applications of clustering techniques are limited by the cost of obtaining…

Machine Learning · Statistics 2012-07-20 Brian Eriksson

The large size of nowadays' online multimedia databases makes retrieving their content a difficult and time-consuming task. Users of online sound collections typically submit search queries that express a broad intent, often making the…

Information Retrieval · Computer Science 2020-06-16 Xavier Favory , Frederic Font , Xavier Serra

We study the online clustering problem where data items arrive in an online fashion. The algorithm maintains a clustering of data items into similarity classes. Upon arrival of v, the relation between v and previously arrived items is…

Data Structures and Algorithms · Computer Science 2010-02-03 Claire Mathieu , Ocan Sankur , Warren Schudy