English
Related papers

Related papers: Constrained Contextual Bandit Learning for Adaptiv…

200 papers

This paper addresses the problem of fast learning of radar detectors with a limited amount of training data. In current data-driven approaches for radar detection, re-training is generally required when the operating environment changes,…

Signal Processing · Electrical Eng. & Systems 2021-12-06 Wei Jiang , Alexander M. Haimovich , Mark Govoni , Timothy Garner , Osvaldo Simeone

Speculative decoding has emerged as a popular method to accelerate the inference of Large Language Models (LLMs) while retaining their superior text generation performance. Previous methods either adopt a fixed speculative decoding…

Machine Learning · Computer Science 2025-11-21 Yunlong Hou , Fengzhuo Zhang , Cunxiao Du , Xuan Zhang , Jiachun Pan , Tianyu Pang , Chao Du , Vincent Y. F. Tan , Zhuoran Yang

We consider the following variant of contextual linear bandits motivated by routing applications in navigational engines and recommendation systems. We wish to learn a hidden $d$-dimensional value $w^*$. Every round, we are presented with a…

Machine Learning · Computer Science 2021-06-10 Sreenivas Gollapudi , Guru Guruganesh , Kostas Kollias , Pasin Manurangsi , Renato Paes Leme , Jon Schneider

Motivated by problems of learning to rank long item sequences, we introduce a variant of the cascading bandit model that considers flexible length sequences with varying rewards and losses. We formulate two generative models for this…

Machine Learning · Computer Science 2022-09-05 Anirban Santara , Claudio Gentile , Gaurav Aggarwal , Shuai Li

In real-world streaming recommender systems, user preferences often dynamically change over time (e.g., a user may have different preferences during weekdays and weekends). Existing bandit-based streaming recommendation models only consider…

Information Retrieval · Computer Science 2023-08-17 Chenglei Shen , Xiao Zhang , Wei Wei , Jun Xu

Multifidelity approximation is an important technique in scientific computation and simulation. In this paper, we introduce a bandit-learning approach for leveraging data of varying fidelities to achieve precise estimates of the parameters…

Numerical Analysis · Mathematics 2022-02-22 Yiming Xu , Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

The concept of cognitive radar (CR) enables radar systems to achieve intelligent adaption to a changeable environment with feedback facility from receiver to transmitter. However, the implementation of CR in a fast-changing environment…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Pengfei Liu , Yimin Liu , Tianyao Huang , Yuxiang Lu , Xiqin Wang

Cognitive Radar Networks were proposed by Simon Haykin in 2006 to address problems with large legacy radar implementations - primarily, single-point vulnerabilities and lack of adaptability. This work proposes to leverage the adaptability…

Signal Processing · Electrical Eng. & Systems 2023-10-27 William W. Howard , Samuel R. Shebert , Benjamin H. Kirk , R. Michael Buehrer

We propose a learning-based method for adaptively generating low probability of detection (LPD) radar waveforms that blend into their operating environment. Our waveforms are designed to follow a distribution that is indistinguishable from…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Matthew R. Ziemann , Christopher A. Metzler

The rise of large-scale pretrained models has made it feasible to generate predictive or synthetic features at low cost, raising the question of how to incorporate such surrogate predictions into downstream decision-making. We study this…

Machine Learning · Statistics 2026-04-03 Hao Yan , Heyan Zhang , Yongyi Guo

Efficient online decision-making in contextual bandits is challenging, as methods without informative priors often suffer from computational or statistical inefficiencies. In this work, we leverage pre-trained diffusion models as expressive…

Machine Learning · Computer Science 2025-10-29 Imad Aouali

In many biomedical, science, and engineering problems, one must sequentially decide which action to take next so as to maximize rewards. One general class of algorithms for optimizing interactions with the world, while simultaneously…

Machine Learning · Statistics 2021-05-05 Iñigo Urteaga , Chris H. Wiggins

In this study, we develop a holistic framework for space-time adaptive processing (STAP) in connected and automated vehicle (CAV) radar systems. We investigate a CAV system consisting of multiple vehicles that transmit frequency-modulated…

Signal Processing · Electrical Eng. & Systems 2024-01-18 Zahra Esmaeilbeig , Kumar Vijay Mishra , Mojtaba Soltanalian

The standard contextual bandit framework assumes fully observable and actionable contexts. In this work, we consider a new bandit setting with partially observable, correlated contexts and linear payoffs, motivated by the applications in…

Machine Learning · Computer Science 2024-09-19 Sihan Zeng , Sujay Bhatt , Alec Koppel , Sumitra Ganesh

We study sequential decision-making with known rewards and unknown constraints, motivated by situations where the constraints represent expensive-to-evaluate human preferences, such as safe and comfortable driving behavior. We formalize the…

Machine Learning · Computer Science 2022-06-13 David Lindner , Sebastian Tschiatschek , Katja Hofmann , Andreas Krause

Using an amalgamation of techniques from classical radar, computer vision, and deep learning, we characterize our ongoing data-driven approach to space-time adaptive processing (STAP) radar. We generate a rich example dataset of received…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Shyam Venkatasubramanian , Chayut Wongkamthong , Mohammadreza Soltani , Bosung Kang , Sandeep Gogineni , Ali Pezeshki , Muralidhar Rangaswamy , Vahid Tarokh

In previous work, we have argued that measurement using a radar can be viewed as taking the expected value of an operator. The operator usually represents some aspect of the characteristics of the object being tracked (such as Doppler,…

Instrumentation and Detectors · Physics 2011-05-02 John E Gray , Allen D Parks

We study the best-arm identification problem with fixed confidence when contextual (covariate) information is available in stochastic bandits. Although we can use contextual information in each round, we are interested in the marginalized…

Machine Learning · Computer Science 2024-02-27 Masahiro Kato , Kaito Ariu

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

Data Structures and Algorithms · Computer Science 2014-05-21 Aleksandrs Slivkins

We study the constrained variant of the \emph{multi-armed bandit} (MAB) problem, in which the learner aims not only at minimizing the total loss incurred during the learning dynamic, but also at controlling the violation of multiple…

Machine Learning · Computer Science 2026-02-17 Francesco Emanuele Stradi , Kalana Kalupahana , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti
‹ Prev 1 8 9 10 Next ›