English
Related papers

Related papers: Adaptive Metamorphic Testing with Contextual Bandi…

200 papers

In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While…

Machine Learning · Computer Science 2020-10-08 Dylan J. Foster , Alexander Rakhlin , David Simchi-Levi , Yunzong Xu

Metamorphic testing has recently been used to check the safety of neural NLP models. Its main advantage is that it does not rely on a ground truth to generate test cases. However, existing studies are mostly concerned with robustness-like…

Computation and Language · Computer Science 2022-04-27 Edoardo Manino , Julia Rozanova , Danilo Carvalho , Andre Freitas , Lucas Cordeiro

Contextual bandits are widely used in industrial personalization systems. These online learning frameworks learn a treatment assignment policy in the presence of treatment effects that vary with the observed contextual features of the…

Machine Learning · Computer Science 2022-05-11 Claudia Roberts , Maria Dimakopoulou , Qifeng Qiao , Ashok Chandrashekhar , Tony Jebara

Metamorphic testing (MT) is widely used for testing programs that face the oracle problem. It uses a set of metamorphic relations (MRs), which are relations among multiple inputs and their corresponding outputs to determine whether the…

Software Engineering · Computer Science 2021-09-22 Madhusudan Srinivasan , Upulee Kanewala

In order to make good decision under uncertainty an agent must learn from observations. To do so, two of the most common frameworks are Contextual Bandits and Markov Decision Processes (MDPs). In this paper, we study whether there exist…

Machine Learning · Computer Science 2019-11-05 Andrea Zanette , Emma Brunskill

Adversarial attacks are small, carefully crafted perturbations, imperceptible to the naked eye; that when added to an image cause deep learning models to misclassify the image with potentially detrimental outcomes. With the rise of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Rohan Reddy Mekala , Gudjon Einar Magnusson , Adam Porter , Mikael Lindvall , Madeline Diep

In statistical learning, algorithms for model selection allow the learner to adapt to the complexity of the best hypothesis class in a sequence. We ask whether similar guarantees are possible for contextual bandit learning.

Machine Learning · Computer Science 2020-06-22 Dylan J. Foster , Akshay Krishnamurthy , Haipeng Luo

Large language models and deep learning models designed for code intelligence have revolutionized the software engineering field due to their ability to perform various code-related tasks. These models can process source code and software…

Software Engineering · Computer Science 2025-07-31 Ali Asgari , Milan de Koning , Pouria Derakhshanfar , Annibale Panichella

Contextual bandits often provide simple and effective personalization in decision making problems, making them popular tools to deliver personalized interventions in mobile health as well as other health applications. However, when bandits…

Machine Learning · Computer Science 2021-07-28 Jiayu Yao , Emma Brunskill , Weiwei Pan , Susan Murphy , Finale Doshi-Velez

Contextual bandit and reinforcement learning algorithms have been successfully used in various interactive learning systems such as online advertising, recommender systems, and dynamic pricing. However, they have yet to be widely adopted in…

Machine Learning · Computer Science 2022-09-23 Sorawit Saengkyongam , Nikolaj Thams , Jonas Peters , Niklas Pfister

While contextual bandit has a mature theory, effectively leveraging different feedback patterns to enhance the pace of learning remains unclear. Bandits with feedback graphs, which interpolates between the full information and bandit…

Machine Learning · Computer Science 2023-10-30 Mengxiao Zhang , Yuheng Zhang , Olga Vrousgou , Haipeng Luo , Paul Mineiro

Contextual bandits have emerged as a cornerstone in reinforcement learning, enabling systems to make decisions with partial feedback. However, as contexts grow in complexity, traditional bandit algorithms can face challenges in adequately…

Machine Learning · Computer Science 2023-11-07 Ali Baheri , Cecilia O. Alm

Large language models have shown tremendous performance in a variety of tasks. In-context learning -- the ability to improve at a task after being provided with a number of demonstrations -- is seen as one of the main contributors to their…

Computation and Language · Computer Science 2023-05-23 Julian Coda-Forno , Marcel Binz , Zeynep Akata , Matthew Botvinick , Jane X. Wang , Eric Schulz

Contextual multi-armed bandits are a popular choice to model sequential decision-making. E.g., in a healthcare application we may perform various tests to asses a patient condition (exploration) and then decide on the best treatment to give…

Machine Learning · Computer Science 2025-04-08 Mirco Mutti , Jeongyeol Kwon , Shie Mannor , Aviv Tamar

Collaborative bandit learning, i.e., bandit algorithms that utilize collaborative filtering techniques to improve sample efficiency in online interactive recommendation, has attracted much research attention as it enjoys the best of both…

Machine Learning · Computer Science 2021-04-16 Chuanhao Li , Qingyun Wu , Hongning Wang

Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Nyee Thoang Lim , Meng Yi Kuan , Muxin Pu , Mei Kuan Lim , Chun Yong Chong

Metamorphic testing (MT) is a general approach for the testing of a specific kind of software systems -- so-called ``non-testable'', where the ``classical'' testing approaches are difficult to apply. MT is an effective approach for…

Software Engineering · Computer Science 2022-11-23 Nasser Alzahrani , Maria Spichkova , James Harland

Metamorphic Testing (MT) is a testing technique that can effectively alleviate the oracle problem. MT uses Metamorphic Relations (MRs) to determine if a test case passes or fails. MRs specify how the outputs should vary in response to…

Software Engineering · Computer Science 2023-05-19 Alejandra Duque-Torres , Dietmar Pfahl , Claus Klammer , Stefan Fischer

Contextual Multi-Armed Bandits is a well-known and accepted online optimization algorithm, that is used in many Web experiences to tailor content or presentation to users' traffic. Much has been published on theoretical guarantees (e.g.…

Information Retrieval · Computer Science 2019-07-12 David Abensur , Ivan Balashov , Shaked Bar , Ronny Lempel , Nurit Moscovici , Ilan Orlov , Danny Rosenstein , Ido Tamir

Metamorphic Testing (MT) addresses the test oracle problem by examining the relationships between input-output pairs in consecutive executions of the System Under Test (SUT). These relations, known as Metamorphic Relations (MRs), specify…

Software Engineering · Computer Science 2023-10-23 Alejandra Duque-Torres , Dietmar Pfahl