English
Related papers

Related papers: Bayesian Optimisation-Assisted Neural Network Trai…

200 papers

Robots and intelligent systems that sense or interact with the world are increasingly being used to automate a wide array of tasks. The ability of these systems to complete these tasks depends on a large range of technologies such as the…

Robotics · Computer Science 2022-09-02 Charles Schaff

Neural networks with binary weights are computation-efficient and hardware-friendly, but their training is challenging because it involves a discrete optimization problem. Surprisingly, ignoring the discrete nature of the problem and using…

Machine Learning · Computer Science 2020-08-19 Xiangming Meng , Roman Bachmann , Mohammad Emtiyaz Khan

Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However,…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Christopher König , Raamadaas Krishnadas , Efe C. Balta , Alisa Rupenyan

A promising approach to accurate positioning of robots is ground texture based localization. It is based on the observation that visual features of ground images enable fingerprint-like place recognition. We tackle the issue of efficient…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Jan Fabian Schmid , Stephan F. Simon , Rudolf Mester

In this paper we examine a novel addition to the known methods for learning Bayesian networks from data that improves the quality of the learned networks. Our approach explicitly represents and learns the local structure in the conditional…

Artificial Intelligence · Computer Science 2013-02-18 Nir Friedman , Moises Goldszmidt

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

Deep learning is a form of machine learning for nonlinear high dimensional pattern matching and prediction. By taking a Bayesian probabilistic perspective, we provide a number of insights into more efficient algorithms for optimisation and…

Machine Learning · Statistics 2018-01-23 Nicholas Polson , Vadim Sokolov

Bayesian Federated Learning (FL) has been recently introduced to provide well-calibrated Machine Learning (ML) models quantifying the uncertainty of their predictions. Despite their advantages compared to frequentist FL setups, Bayesian FL…

Machine Learning · Computer Science 2024-05-12 Luca Barbieri , Stefano Savazzi , Monica Nicoli

We consider the problem of estimating an RF-device's location based on observations, such as received signal strength, from a set of transmitters with known locations. We survey the literature on this problem, showing that previous authors…

Networking and Internet Architecture · Computer Science 2017-03-09 Nachikethas A. Jagadeesan , Bhaskar Krishnamachari

Real-world robots are becoming increasingly complex and commonly act in poorly understood environments where it is extremely challenging to model or learn their true dynamics. Therefore, it might be desirable to take a task-specific…

Systems and Control · Computer Science 2017-09-25 Somil Bansal , Roberto Calandra , Ted Xiao , Sergey Levine , Claire J. Tomlin

Indoor localization systems are most commonly based on Received Signal Strength Indicator (RSSI) measurements of either WiFi or Bluetooth-Low-Energy (BLE) beacons. In such systems, the two most common techniques are trilateration and…

Networking and Internet Architecture · Computer Science 2020-06-17 Ramdoot Pydipaty , Johnu George , Krishna Selvaraju , Amit Saha

Batch normalization (BN) is a popular and ubiquitous method in deep learning that has been shown to decrease training time and improve generalization performance of neural networks. Despite its success, BN is not theoretically well…

Machine Learning · Computer Science 2022-01-21 Susanna Lange , Kyle Helfrich , Qiang Ye

Machine Learning algorithms, such as Boosted Decisions Trees and Deep Neural Network, are widely used in High-Energy-Physics. The aim of this study is to apply Bayesian Optimization to tune the hyperparameters used in a machine learning…

Data Analysis, Statistics and Probability · Physics 2019-11-12 Oriel Kiss

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian optimization (BO) is a popular methodology to tune the hyperparameters of expensive black-box functions. Traditionally, BO focuses on a single task at a time and is not designed to leverage information from related functions, such…

Machine Learning · Statistics 2021-04-20 David Salinas , Huibin Shen , Valerio Perrone

This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification…

Systems and Control · Electrical Eng. & Systems 2022-06-02 Hongpeng Zhou , Chahine Ibrahim , Wei Xing Zheng , Wei Pan

Future intelligent indoor wireless environments require fast and reliable beam alignment to sustain high-throughput links under mobility and blockage. Exhaustive beam training achieves optimal performance but is prohibitively costly. In…

Networking and Internet Architecture · Computer Science 2026-02-19 Parth Ashokbhai Shiroya , Amod Ashtekar , Swarnagowri Shashidhar , Mohammed E. Eltayeb

Position-aided beam selection methods have been shown to be an effective approach to achieve high beamforming gain while limiting the overhead and latency of initial access in millimeter wave (mmWave) communications. Most research in the…

Signal Processing · Electrical Eng. & Systems 2021-10-14 Sajad Rezaie , Elisabeth de Carvalho , Carles Navarro Manchón

In typical applications of Bayesian optimization, minimal assumptions are made about the objective function being optimized. This is true even when researchers have prior information about the shape of the function with respect to one or…

Machine Learning · Statistics 2016-12-30 Michael Jauch , Víctor Peña

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…