English
Related papers

Related papers: Training independent subnetworks for robust predic…

200 papers

The benefit of multi-antenna receivers is investigated in wireless ad hoc networks, and the main finding is that network throughput can be made to scale linearly with the number of receive antennas nR even if each transmitting node uses…

Information Theory · Computer Science 2016-11-17 Nihar Jindal , Jeffrey G. Andrews , Steven Weber

In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in accordance with the…

Machine Learning · Computer Science 2021-07-12 Grzegorz Dudek , Paweł Pełka

Reinforcement Learning is divided in two main paradigms: model-free and model-based. Each of these two paradigms has strengths and limitations, and has been successfully applied to real world domains that are appropriate to its…

Machine Learning · Computer Science 2017-10-19 Somil Bansal , Roberto Calandra , Kurtland Chua , Sergey Levine , Claire Tomlin

This work presents a method for adapting a single, fixed deep neural network to multiple tasks without affecting performance on already learned tasks. By building upon ideas from network quantization and pruning, we learn binary masks that…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Arun Mallya , Dillon Davis , Svetlana Lazebnik

Improvement of time series forecasting accuracy through combining multiple models is an important as well as a dynamic area of research. As a result, various forecasts combination methods have been developed in literature. However, most of…

Artificial Intelligence · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

Adaptive inference is a promising technique to improve the computational efficiency of deep models at test time. In contrast to static models which use the same computation graph for all instances, adaptive networks can dynamically adjust…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Hao Li , Hong Zhang , Xiaojuan Qi , Ruigang Yang , Gao Huang

Deep learning has achieved remarkable success across many domains, but it has also created a growing demand for interpretability in model predictions. Although many explainable machine learning methods have been proposed, post-hoc…

Machine Learning · Computer Science 2026-01-28 Shijian Xu , Marcello Massimo Negri , Volker Roth

We present a general framework for training deep neural networks without backpropagation. This substantially decreases training time and also allows for construction of deep networks with many sorts of learners, including networks whose…

Machine Learning · Statistics 2017-06-09 Chris Hettinger , Tanner Christensen , Ben Ehlert , Jeffrey Humpherys , Tyler Jarvis , Sean Wade

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

New hardware can substantially increase the speed and efficiency of deep neural network training. To guide the development of future hardware architectures, it is pertinent to explore the hardware and machine learning properties of…

Machine Learning · Computer Science 2021-04-13 Atli Kosson , Vitaliy Chiley , Abhinav Venigalla , Joel Hestness , Urs Köster

Cell-free massive multiple-input multiple-output (mMIMO) offers significant advantages in mobility scenarios, mainly due to the elimination of cell boundaries and strong macro diversity. In this paper, we examine the downlink performance of…

Information Theory · Computer Science 2024-12-04 Ziheng Liu , Jiayi Zhang , Yiyang Zhu , Enyu Shi , Bo Ai

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

Massive multiple-input multiple-output (mMIMO) regime reaps the benefits of spatial diversity and multiplexing gains, subject to precise channel state information (CSI) acquisition. In the current communication architecture, the downlink…

Information Theory · Computer Science 2022-08-26 Muhammad Karam Shehzad , Luca Rose , Stefan Wesemann , Mohamad Assaad , Syed Ali Hassan

For efficient and safe autonomous driving, it is essential that autonomous vehicles can predict the motion of other traffic agents. While highly accurate, current motion prediction models often impose significant challenges in terms of…

Robotics · Computer Science 2024-09-26 Alexander Prutsch , Horst Bischof , Horst Possegger

Federated bilevel optimization (FBO) has shown great potential recently in machine learning and edge computing due to the emerging nested optimization structure in meta-learning, fine-tuning, hyperparameter tuning, etc. However, existing…

Machine Learning · Computer Science 2023-12-29 Yifan Yang , Peiyao Xiao , Kaiyi Ji

The contribution of this work is twofold: (1) We introduce a collection of ensemble methods for time series forecasting to combine predictions from base models. We demonstrate insights on the power of ensemble learning for forecasting,…

Machine Learning · Computer Science 2021-04-26 Julia Gastinger , Sébastien Nicolas , Dušica Stepić , Mischa Schmidt , Anett Schülke

Adversarial attacks have rendered high security risks on modern deep learning systems. Adversarial training can significantly enhance the robustness of neural network models by suppressing the non-robust features. However, the models often…

Machine Learning · Computer Science 2021-03-30 Yi Cai , Xuefei Ning , Huazhong Yang , Yu Wang

This work revisits a recently proposed precoding design for massive multiple-input multiple output (MIMO) systems that is based on the use of an instantaneous total power constraint. The main advantages of this technique lie in its…

Information Theory · Computer Science 2016-06-02 Houssem Sifaou , Abla Kammoun , Mohamed-Slim Alouini

Deep reinforcement learning has achieved remarkable performance in various domains by leveraging deep neural networks for approximating value functions and policies. However, using neural networks to approximate value functions or policy…

Machine Learning · Computer Science 2023-10-31 Yiqin Tan , Ling Pan , Longbo Huang

While large language models (LLMs) fine-tuned with lightweight adapters achieve strong performance across diverse tasks, their performance on individual tasks depends on the fine-tuning strategy. Fusing independently trained models with…

Machine Learning · Computer Science 2026-03-05 Sanae Lotfi , Lucas Caccia , Alessandro Sordoni , Jordan T. Ash , Miroslav Dudik