English
Related papers

Related papers: The Tsetlin Machine -- A Game Theoretic Bandit Dri…

200 papers

Feature Selection (FS) is crucial for improving model interpretability, reducing complexity, and sometimes for enhancing accuracy. The recently introduced Tsetlin machine (TM) offers interpretable clause-based learning, but lacks…

Machine Learning · Computer Science 2025-08-12 Vojtech Halenka , Ole-Christoffer Granmo , Lei Jiao , Per-Arne Andersen

A set of variables is the Markov blanket of a random variable if it contains all the information needed for predicting the variable. If the blanket cannot be reduced without losing useful information, it is called a Markov boundary.…

Machine Learning · Computer Science 2023-09-13 Ole-Christoffer Granmo , Per-Arne Andersen , Lei Jiao , Xuan Zhang , Christian Blakely , Tor Tveit

The multi-armed bandit problem is a classical decision-making problem where an agent has to learn an optimal action balancing exploration and exploitation. Properly managing this trade-off requires a correct assessment of uncertainty; in…

Machine Learning · Computer Science 2020-08-18 Fabio Massimo Zennaro , Audun Jøsang

Analogical Reasoning problems challenge both connectionist and symbolic AI systems as these entail a combination of background knowledge, reasoning and pattern recognition. While symbolic systems ingest explicit domain knowledge and perform…

Artificial Intelligence · Computer Science 2022-09-20 Vishwa Shah , Aditya Sharma , Gautam Shroff , Lovekesh Vig , Tirtharaj Dash , Ashwin Srinivasan

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

Machine Learning · Computer Science 2018-12-04 Jun Geng , Lifeng Lai

We consider a sequential assortment selection problem where the user choice is given by a multinomial logit (MNL) choice model whose parameters are unknown. In each period, the learning agent observes a $d$-dimensional contextual…

Machine Learning · Statistics 2021-03-26 Min-hwan Oh , Garud Iyengar

Many real-world systems can be described by mathematical models that are human-comprehensible, easy to analyze and help explain the system's behavior. Symbolic regression is a method that can automatically generate such models from data.…

Neural and Evolutionary Computing · Computer Science 2023-06-28 Jiří Kubalík , Erik Derner , Robert Babuška

As large language models (LLMs) become increasingly popular, there is a growing need to predict which out of a set of LLMs will yield a successful answer to a given query at low cost. This problem promises to become even more relevant as…

Computation and Language · Computer Science 2026-04-23 Baran Atalar , Eddie Zhang , Carlee Joe-Wong

Recent research in novelty detection focuses mainly on document-level classification, employing deep neural networks (DNN). However, the black-box nature of DNNs makes it difficult to extract an exact explanation of why a document is…

Computation and Language · Computer Science 2021-05-12 Bimal Bhattarai , Ole-Christoffer Granmo , Lei Jiao

Large language models (LLMs) have been adopted to solve sequential decision-making tasks such as multi-armed bandits (MAB), in which an LLM is directly instructed to select the arms to pull in every iteration. However, this paradigm of…

Machine Learning · Computer Science 2025-02-04 Jiahang Sun , Zhiyong Wang , Runhan Yang , Chenjun Xiao , John C. S. Lui , Zhongxiang Dai

Active learning methods have shown great promise in reducing the number of samples necessary for learning. As automated learning systems are adopted into real-time, real-world decision-making pipelines, it is increasingly important that…

Machine Learning · Computer Science 2022-06-23 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

In pure-exploration problems, information is gathered sequentially to answer a question on the stochastic environment. While best-arm identification for linear bandits has been extensively studied in recent years, few works have been…

Machine Learning · Statistics 2022-06-10 Marc Jourdan , Rémy Degenne

Many engineering tasks require solving families of nonlinear constrained optimization problems, parametrized in setting-specific variables. This is computationally demanding, particularly, if solutions have to be computed across strongly…

Optimization and Control · Mathematics 2025-12-24 Matthias K. Hoffmann , Amine Othmane , Kathrin Flaßkamp

We present a new algorithm for the contextual bandit learning problem, where the learner repeatedly takes one of $K$ actions in response to the observed context, and observes the reward only for that chosen action. Our method assumes access…

Machine Learning · Computer Science 2014-10-15 Alekh Agarwal , Daniel Hsu , Satyen Kale , John Langford , Lihong Li , Robert E. Schapire

Large language models (LLMs) have shown to be increasingly capable of performing reasoning tasks, but their ability to make sequential decisions under uncertainty only using natural language remains underexplored. We introduce a novel…

Computation and Language · Computer Science 2025-10-17 Jimin Lim , Arjun Damerla , Arthur Jiang , Nam Le

Machine unlearning aims to unlearn data points from a learned model, offering a principled way to process data-deletion requests and mitigate privacy risks without full retraining. Prior work has mainly studied unsupervised / supervised…

Machine Learning · Computer Science 2026-05-04 Zichun Ye , Runqi Wang , Xuchuang Wang , Xutong Liu , Shuai Li , Mohammad Hajiesmaili

This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic…

Neural and Evolutionary Computing · Computer Science 2023-02-16 Deniz Preil , Michael Krapp

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

Computer Science and Game Theory · Computer Science 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins

A key feature of sequential decision making under uncertainty is a need to balance between exploiting--choosing the best action according to the current knowledge, and exploring--obtaining information about values of other actions. The…

Machine Learning · Computer Science 2021-08-27 Dimitrije Markovic , Hrvoje Stojic , Sarah Schwoebel , Stefan J. Kiebel

Meta-learning is characterized by its ability to learn how to learn, enabling the adaptation of learning strategies across different tasks. Recent research introduced the Meta-Thompson Sampling (Meta-TS), which meta-learns an unknown prior…

Machine Learning · Statistics 2024-09-12 Hao Li , Dong Liang , Zheng Xie