English
Related papers

Related papers: Rapid Network Adaptation: Learning to Adapt Neural…

200 papers

In order to robustly execute a task under environmental uncertainty, a robot needs to be able to reactively adapt to changes arising in its environment. The environment changes are usually reflected in deviation from expected sensory…

Robotics · Computer Science 2018-09-19 Giovanni Sutanto , Zhe Su , Stefan Schaal , Franziska Meier

The method presented extends a given regression neural network to make its performance improve. The modification affects the learning procedure only, hence the extension may be easily omitted during evaluation without any change in…

Machine Learning · Computer Science 2016-12-07 Konrad Zolna

In resource-constrained environments, one can employ spatial multiplexing cameras to acquire a small number of measurements of a scene, and perform effective reconstruction or high-level inference using purely data-driven neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Suhas Lohit , Rajhans Singh , Kuldeep Kulkarni , Pavan Turaga

This paper considers methods for delivering ultra reliable low latency communication (URLLC) to enable mission-critical Internet of Things (IoT) services in wireless environments with unknown channel distribution. The methods rely upon the…

Information Theory · Computer Science 2025-02-18 Hongsen Peng , Tobias Kallehauge , Meixia Tao , Petar Popovski

Through deep learning and computer vision techniques, driving manoeuvres can be predicted accurately a few seconds in advance. Even though adapting a learned model to new drivers and different vehicles is key for robust driver-assistance…

Machine Learning · Computer Science 2019-03-12 Michele Tonutti , Emanuele Ruffaldi , Alessandro Cattaneo , Carlo Alberto Avizzano

Distribution network reconfiguration (DNR) has proved to be an economical and effective way to improve the reliability of distribution systems. As optimal network configuration depends on system operating states (e.g., loads at each node),…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Mukesh Gautam , Narayan Bhusal , Mohammed Benidris

A key functionality of emerging connected autonomous systems such as smart transportation systems, smart cities, and the industrial Internet-of-Things, is the ability to process and learn from data collected at different physical locations.…

Machine Learning · Computer Science 2021-01-26 Konstantinos Gatsis

Neural architecture search has attracted wide attentions in both academia and industry. To accelerate it, researchers proposed weight-sharing methods which first train a super-network to reuse computation among different operators, from…

Machine Learning · Computer Science 2020-12-16 Xin Chen , Lingxi Xie , Jun Wu , Longhui Wei , Yuhui Xu , Qi Tian

This paper examines the problem of adapting neural machine translation systems to new, low-resourced languages (LRLs) as effectively and rapidly as possible. We propose methods based on starting with massively multilingual "seed models",…

Computation and Language · Computer Science 2018-08-14 Graham Neubig , Junjie Hu

Neural networks have achieved remarkable success in time series classification, but their reliance on large amounts of labeled data for training limits their applicability in cold-start scenarios. Moreover, they lack interpretability,…

Machine Learning · Computer Science 2025-07-15 Jintao Qu , Zichong Wang , Chenhao Wu , Wenbin Zhang

Neural networks are traditionally trained under the assumption that data come from a stationary distribution. However, settings which violate this assumption are becoming more popular; examples include supervised learning under…

Machine Learning · Computer Science 2024-11-11 Alexandre Galashov , Michalis K. Titsias , András György , Clare Lyle , Razvan Pascanu , Yee Whye Teh , Maneesh Sahani

Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Existing methods update the source model by (re-)training on each target domain. While effective,…

Machine Learning · Computer Science 2023-06-22 Jin Gao , Jialing Zhang , Xihui Liu , Trevor Darrell , Evan Shelhamer , Dequan Wang

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Adaptive inference is an effective mechanism to achieve a dynamic tradeoff between accuracy and computational cost in deep networks. Existing works mainly exploit architecture redundancy in network depth or width. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Le Yang , Yizeng Han , Xi Chen , Shiji Song , Jifeng Dai , Gao Huang

Minimization of distribution matching losses is a principled approach to domain adaptation in the context of image classification. However, it is largely overlooked in adapting segmentation networks, which is currently dominated by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Georg Pichler , Jose Dolz , Ismail Ben Ayed , Pablo Piantanida

In previous studies, we introduced a neural network framework based on symmetric differential equations, along with one of its training methods. In this article, we present another training approach for this neural network. This method…

Neural and Evolutionary Computing · Computer Science 2025-02-18 Kun Jiang

Test-time adaptation (TTA) enables neural forecasters to adapt to distribution shifts in streaming time series, but existing methods apply the same adaptation intensity regardless of the nature of the shift. We propose Regime-Guided…

Machine Learning · Computer Science 2026-03-31 Indar Kumar , Akanksha Tiwari , Sai Krishna Jasti , Ankit Hemant Lade

The accuracy of deep neural networks is significantly affected by how well mini-batches are constructed during the training step. In this paper, we propose a novel adaptive batch selection algorithm called Recency Bias that exploits the…

Machine Learning · Computer Science 2020-12-24 Hwanjun Song , Minseok Kim , Sundong Kim , Jae-Gil Lee

Regularization is commonly used for alleviating overfitting in machine learning. For convolutional neural networks (CNNs), regularization methods, such as DropBlock and Shake-Shake, have illustrated the improvement in the generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yi Wang , Zhen-Peng Bian , Junhui Hou , Lap-Pui Chau

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung