English
Related papers

Related papers: Transfer Learning for Neural Networks-based Equali…

200 papers

Parameter-efficient fine-tuning approaches have recently garnered a lot of attention. Having considerably lower number of trainable weights, these methods can bring about scalability and computational effectiveness. In this paper, we look…

Computation and Language · Computer Science 2023-02-23 Mohammad Akbar-Tajari , Sara Rajaee , Mohammad Taher Pilehvar

This paper studies fast adaptive beamforming optimization for the signal-to-interference-plus-noise ratio balancing problem in a multiuser multiple-input single-output downlink system. Existing deep learning based approaches to predict…

Information Theory · Computer Science 2020-11-03 Yi Yuan , Gan Zheng , Kai-Kit Wong , Björn Ottersten , Zhi-Quan Luo

Sparse neural networks are important for achieving better generalization and enhancing computation efficiency. This paper proposes a novel learning approach to obtain sparse fully connected layers in neural networks (NNs) automatically. We…

Machine Learning · Computer Science 2021-04-28 Mengqiao Han , Xiabi Liu , Zhaoyang Hai , Zhengwen Li

Domain adaptation aims at training a classifier in one dataset and applying it to a related but not identical dataset. One successfully used framework of domain adaptation is to learn a transformation to match both the distribution of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-03 Xu Zhang , Felix Xinnan Yu , Shih-Fu Chang , Shengjin Wang

We introduce learned attention models into the radio machine learning domain for the task of modulation recognition by leveraging spatial transformer networks and introducing new radio domain appropriate transformations. This attention…

Machine Learning · Computer Science 2016-05-04 Timothy J O'Shea , Latha Pemula , Dhruv Batra , T. Charles Clancy

Transfer learning from natural image datasets, particularly ImageNet, using standard large models and corresponding pretrained weights has become a de-facto method for deep learning applications to medical imaging. However, there are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Maithra Raghu , Chiyuan Zhang , Jon Kleinberg , Samy Bengio

Beyond data communications, commercial-off-the-shelf Wi-Fi devices can be used to monitor human activities, track device locomotion, and sense the ambient environment. In particular, spatial beam attributes that are inherently available in…

Machine Learning · Computer Science 2022-05-19 Toshiaki Koike-Akino , Pu Wang , Ye Wang

We present a deep learning-based method for propagating spatially-varying visual material attributes (e.g. texture maps or image stylizations) to larger samples of the same or similar materials. For training, we leverage images of the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Carlos Rodriguez-Pardo , Elena Garces

We propose a method for adapting neural networks to distribution shifts at test-time. In contrast to training-time robustness mechanisms that attempt to anticipate and counter the shift, we create a closed-loop system and make use of a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Teresa Yeo , Oğuzhan Fatih Kar , Zahra Sodagar , Amir Zamir

Learning generic representations with deep networks requires massive training samples and significant computer resources. To learn a new specific task, an important issue is to transfer the generic teacher's representation to a student…

Machine Learning · Computer Science 2021-03-01 Xuhong Li , Yves Grandvalet , Rémi Flamary , Nicolas Courty , Dejing Dou

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

Recent papers have shown that neural networks obtain state-of-the-art performance on several different sequence tagging tasks. One appealing property of such systems is their generality, as excellent performance can be achieved with a…

Computation and Language · Computer Science 2017-03-21 Zhilin Yang , Ruslan Salakhutdinov , William W. Cohen

Convolutional Neural Networks (CNNs) are very effective for many pattern recognition tasks. However, training deep CNNs needs extensive computation and large training data. In this paper we propose Bank of Filter-Trees (BFT) as a trans- fer…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Suresh Kirthi Kumaraswamy , PS Sastry , KR Ramakrishnan

Machine-learning models in chemistry - when based on descriptors of atoms embedded within molecules - face essential challenges in transferring the quality of predictions of local electronic structures and their associated properties across…

Chemical Physics · Physics 2024-09-27 Frederik Ø. Kjeldal , Janus J. Eriksen

Transfer learning aims to optimize performance in a target task by learning from a related source problem. In this work, we propose an efficient transfer learning method using a tensor kernel machine. Our method takes inspiration from the…

Machine Learning · Computer Science 2025-12-03 Seline J. S. de Rooij , Borbála Hunyadi

Transfer learning (TL) is a well-established machine learning technique to boost the generalization performance on a specific (target) task using information gained from a related (source) task, and it crucially depends on the ability of a…

Disordered Systems and Neural Networks · Physics 2024-07-11 Alessandro Ingrosso , Rosalba Pacelli , Pietro Rotondo , Federica Gerace

Continual learning is the ability to acquire new knowledge without forgetting the previously learned one, assuming no further access to past training data. Neural network approximators trained with gradient descent are known to fail in this…

Machine Learning · Computer Science 2021-11-05 Rodrigue Siry

Transfer learning is a powerful tool to adapt trained neural networks to new tasks. Depending on the similarity of the original task to the new task, the selection of the cut-off layer is critical. For medical applications like tissue…

Neural and Evolutionary Computing · Computer Science 2018-06-25 Nadezhda Prodanova , Johannes Stegmaier , Stephan Allgeier , Sebastian Bohn , Oliver Stachs , Bernd Köhler , Ralf Mikut , Andreas Bartschat

Neural Transfer Learning (TL) is becoming ubiquitous in Natural Language Processing (NLP), thanks to its high performance on many tasks, especially in low-resourced scenarios. Notably, TL is widely used for neural domain adaptation to…

Computation and Language · Computer Science 2021-06-10 Sara Meftah , Nasredine Semmar , Youssef Tamaazousti , Hassane Essafi , Fatiha Sadat

Transformation Synchronization is the problem of recovering absolute transformations from a given set of pairwise relative motions. Despite its usefulness, the problem remains challenging due to the influences from noisy and outlier…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zi Jian Yew , Gim Hee Lee