English
Related papers

Related papers: ProtoBeam: Generalizing Deep Beam Prediction to Un…

200 papers

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainty by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have focused…

Machine Learning · Statistics 2021-06-25 Cooper Lorsung

Deep learning-based approaches have been developed to solve challenging problems in wireless communications, leading to promising results. Early attempts adopted neural network architectures inherited from applications such as computer…

Information Theory · Computer Science 2022-11-07 Yifei Shen , Jun Zhang , S. H. Song , Khaled B. Letaief

Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training…

Machine Learning · Computer Science 2022-03-21 Yi Zhang , Arushi Gupta , Nikunj Saunshi , Sanjeev Arora

Deep learning provides powerful means to learn from spectrum data and solve complex tasks in 5G and beyond such as beam selection for initial access (IA) in mmWave communications. To establish the IA between the base station (e.g., gNodeB)…

Signal Processing · Electrical Eng. & Systems 2021-03-26 Brian Kim , Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus

A pretrain-finetune strategy is widely used to reduce the overfitting that can occur when data is insufficient for CNN training. First few layers of a CNN pretrained on a large-scale RGB dataset are capable of acquiring general image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Hyungtae Lee , Sungmin Eum , Heesung Kwon

Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long time prediction of the evolution of the unknown system. Training a DNN with low…

Machine Learning · Computer Science 2022-12-28 Victor Churchill , Steve Manns , Zhen Chen , Dongbin Xiu

Deep Learning is a consolidated, state-of-the-art Machine Learning tool to fit a function when provided with large data sets of examples. However, in regression tasks, the straightforward application of Deep Learning models provides a point…

Machine Learning · Computer Science 2018-07-25 Axel Brando , Jose A. Rodríguez-Serrano , Mauricio Ciprian , Roberto Maestre , Jordi Vitrià

Hardware imperfections in RF transmitters introduce features that can be used to identify a specific transmitter amongst others. Supervised deep learning has shown good performance in this task but using datasets not applicable to real…

Signal Processing · Electrical Eng. & Systems 2019-05-21 Cyrille Morin , Leonardo Cardoso , Jakob Hoydis , Jean-Marie Gorce , Thibaud Vial

Learning features from massive unlabelled data is a vast prevalent topic for high-level tasks in many machine learning applications. The recent great improvements on benchmark data sets achieved by increasingly complex unsupervised learning…

Neural and Evolutionary Computing · Computer Science 2015-09-29 Wentao Zhu , Jun Miao , Laiyun Qing , Xilin Chen

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Ngan Le

Bayesian neural networks (BNN) and deep ensembles are principled approaches to estimate the predictive uncertainty of a deep learning model. However their practicality in real-time, industrial-scale applications are limited due to their…

Machine Learning · Computer Science 2020-10-27 Jeremiah Zhe Liu , Zi Lin , Shreyas Padhy , Dustin Tran , Tania Bedrax-Weiss , Balaji Lakshminarayanan

We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks…

Machine Learning · Computer Science 2017-06-21 Jake Snell , Kevin Swersky , Richard S. Zemel

Deep learning models have gained great success in many real-world applications. However, most existing networks are typically designed in heuristic manners, thus lack of rigorous mathematical principles and derivations. Several recent…

Computer Vision and Pattern Recognition · Computer Science 2017-12-18 Risheng Liu , Xin Fan , Shichao Cheng , Xiangyu Wang , Zhongxuan Luo

Large-scale pre-trained models have achieved remarkable success in many applications, but how to leverage them to improve the prediction reliability of downstream models is undesirably under-explored. Moreover, modern neural networks have…

Machine Learning · Computer Science 2023-10-31 Peng Cui , Dan Zhang , Zhijie Deng , Yinpeng Dong , Jun Zhu

Currently, it is hard to reap the benefits of deep learning for Bayesian methods, which allow the explicit specification of prior knowledge and accurately capture model uncertainty. We present Prior-Data Fitted Networks (PFNs). PFNs…

Machine Learning · Computer Science 2024-08-14 Samuel Müller , Noah Hollmann , Sebastian Pineda Arango , Josif Grabocka , Frank Hutter

Many recent efforts have been devoted to designing sophisticated deep learning structures, obtaining revolutionary results on benchmark datasets. The success of these deep learning methods mostly relies on an enormous volume of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Jiaji Huang , Qiang Qiu , Robert Calderbank , Guillermo Sapiro

Beyond data communications, commercial-off-the-shelf Wi-Fi devices can be used to monitor human activities, track device locomotion, and sense the ambient environment. In particular, spatial beam attributes that are inherently available in…

Machine Learning · Computer Science 2022-05-19 Toshiaki Koike-Akino , Pu Wang , Ye Wang

Modern machine learning systems based on neural networks have shown great success in learning complex data patterns while being able to make good predictions on unseen data points. However, the limited interpretability of these systems…

Machine Learning · Computer Science 2020-07-22 Sarath Shekkizhar , Antonio Ortega

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Minh Do

In human learning, it is common to use multiple sources of information jointly. However, most existing feature learning approaches learn from only a single task. In this paper, we propose a novel multi-task deep network to learn…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Zhongzheng Ren , Yong Jae Lee