English
Related papers

Related papers: Online waveform selection for cognitive radar

200 papers

Beamforming-capable antenna arrays with many elements enable higher data rates in next generation 5G and 6G networks. In current practice, analog beamforming uses a codebook of pre-configured beams with each of them radiating towards a…

Machine Learning · Computer Science 2025-12-08 Alexander Mattick , George Yammine , Georgios Kontes , Setareh Maghsudi , Christopher Mutschler

Deep reinforcement learning includes a broad family of algorithms that parameterise an internal representation, such as a value function or policy, by a deep neural network. Each algorithm optimises its parameters with respect to an…

Machine Learning · Computer Science 2020-07-17 Zhongwen Xu , Hado van Hasselt , Matteo Hessel , Junhyuk Oh , Satinder Singh , David Silver

One of the main obstacles to broad application of reinforcement learning methods is the parameter sensitivity of our core learning algorithms. In many large-scale applications, online computation and function approximation represent key…

Artificial Intelligence · Computer Science 2016-10-25 Martha White , Adam White

In this work we combine two distinct machine learning methodologies, sequential Monte Carlo and Bayesian experimental design, and apply them to the problem of inferring the dynamical parameters of a quantum system. We design the algorithm…

Quantum Physics · Physics 2012-10-10 Christopher E. Granade , Christopher Ferrie , Nathan Wiebe , D. G. Cory

Designing a multi-layer optical system with designated optical characteristics is an inverse design problem in which the resulting design is determined by several discrete and continuous parameters. In particular, we consider three design…

Machine Learning · Computer Science 2021-11-17 Heribert Wankerl , Maike L. Stern , Ali Mahdavi , Christoph Eichler , Elmar W. Lang

We study the problem of estimating a continuous ability parameter from sequential binary responses by actively asking questions with varying difficulties, a setting that arises naturally in adaptive testing and online preference learning.…

Machine Learning · Statistics 2025-10-10 Sanghwa Kim , Dohyun Ahn , Seungki Min

In this paper, the trajectory optimization problem for a multi-aerial base station (ABS) communication network is investigated. The objective is to find the trajectory of the ABSs so that the sum-rate of the users served by each ABS is…

Signal Processing · Electrical Eng. & Systems 2019-07-02 Behzad Khamidehi , Elvino S. Sousa

Adaptive filtering algorithms are pervasive throughout signal processing and have had a material impact on a wide variety of domains including audio processing, telecommunications, biomedical sensing, astrophysics and cosmology, seismology,…

Sound · Computer Science 2022-11-23 Jonah Casebeer , Nicholas J. Bryan , Paris Smaragdis

Cognitive sensing refers to a reconfigurable sensor that dynamically adapts its sensing mechanism by using stochastic control to optimize its sensing resources. For example, cognitive radars are sophisticated dynamical systems; they use…

Signal Processing · Electrical Eng. & Systems 2020-02-26 Vikram Krishnamurthy

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Path Planning methods for autonomous control of Unmanned Aerial Vehicle (UAV) swarms are on the rise because of all the advantages they bring. There are more and more scenarios where autonomous control of multiple UAVs is required. Most of…

Artificial Intelligence · Computer Science 2023-08-28 Alejandro Puente-Castro , Daniel Rivero , Eurico Pedrosa , Artur Pereira , Nuno Lau , Enrique Fernandez-Blanco

In this paper, we develop algorithms for joint user scheduling and three types of mmWave link configuration: relay selection, codebook optimization, and beam tracking in millimeter wave (mmWave) networks. Our goal is to design an online…

Networking and Internet Architecture · Computer Science 2022-10-25 Yi Zhang , Robert W. Heath

With new applications for radar networks such as automotive control or indoor localization, the need for spectrum sharing and general interoperability is expected to rise. This paper describes the application of multi-player bandit…

Information Theory · Computer Science 2021-02-02 William W. Howard , Charles E. Thornton , Anthony F. Martone , R. Michael Buehrer

This paper considers meta-cognitive radars in an adversarial setting. A cognitive radar optimally adapts its waveform (response) in response to maneuvers (probes) of a possibly adversarial moving target. A meta-cognitive radar is aware of…

Signal Processing · Electrical Eng. & Systems 2022-05-05 Kunal Pattanayak , Vikram Krishnamurthy , Christopher Berry

We introduce a reinforcement learning (RL) based adaptive optimization algorithm for aerodynamic shape optimization focused on dimensionality reduction. The form in which RL is applied here is that of a surrogate-based, actor-critic policy…

The concept of cognitive radar (CR) enables radar systems to achieve intelligent adaption to a changeable environment with feedback facility from receiver to transmitter. However, the implementation of CR in a fast-changing environment…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Pengfei Liu , Yimin Liu , Tianyao Huang , Yuxiang Lu , Xiqin Wang

The performance of reinforcement learning (RL) algorithms is sensitive to the choice of hyperparameters, with the learning rate being particularly influential. RL algorithms fail to reach convergence or demand an extensive number of samples…

Machine Learning · Computer Science 2024-08-09 Aida Afshar , Aldo Pacchiano

Automatic parameter tuning methods for planning algorithms, which integrate pipeline approaches with learning-based techniques, are regarded as promising due to their stability and capability to handle highly constrained environments. While…

Robotics · Computer Science 2025-03-25 Lu Wangtao , Wei Yufei , Xu Jiadong , Jia Wenhao , Li Liang , Xiong Rong , Wang Yue

This paper presents a machine learning approach for tuning the parameters of a family of stabilizing controllers for orbital tracking. An augmented random search algorithm is deployed, which aims at minimizing a cost function combining…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Gianni Bianchini , Andrea Garulli , Antonio Giannitrapani , Mirko Leomanni , Renato Quartullo

We consider an inverse reinforcement learning problem involving us versus an enemy radar equipped with a Bayesian tracker. By observing the emissions of the enemy radar,how can we identify if the radar is cognitive (constrained utility…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Vikram Krishnamurthy , Daniel Angley , Robin Evans , William Moran