English
Related papers

Related papers: Parameter Transfer Extreme Learning Machine based …

200 papers

Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean…

Machine Learning · Computer Science 2025-10-24 Kaicheng Zhang , Sinian Zhang , Doudou Zhou , Yidong Zhou

We consider the Hypothesis Transfer Learning (HTL) problem where one incorporates a hypothesis trained on the source domain into the learning procedure of the target domain. Existing theoretical analysis either only studies specific…

Machine Learning · Statistics 2017-11-07 Simon Shaolei Du , Jayanth Koushik , Aarti Singh , Barnabas Poczos

Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research institutions release…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yuncheng Yang , Meng Wei , Junjun He , Jie Yang , Jin Ye , Yun Gu

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

The ability of a human being to extrapolate previously gained knowledge to other domains inspired a new family of methods in machine learning called transfer learning. Transfer learning is often based on the assumption that objects in both…

Machine Learning · Statistics 2016-10-21 Ievgen Redko , Younès Bennani

Transfer learning methods endeavor to leverage relevant knowledge from existing source pre-trained models or datasets to solve downstream target tasks. With the increase in the scale and quantity of available pre-trained models nowadays, it…

Machine Learning · Computer Science 2024-02-26 Yuhe Ding , Bo Jiang , Aijing Yu , Aihua Zheng , Jian Liang

This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source…

Statistics Theory · Mathematics 2024-03-29 T. Tony Cai , Dongwoo Kim , Hongming Pu

High-dimensional data in modern applications, such as COVID-19 mortality, often span multiple domains. Leveraging auxiliary information from source domains to improve performance in a target domain motivates the use of transfer learning.…

Methodology · Statistics 2026-04-09 Haoming Shi , Yang Feng , Xiaoqian Liu

Practical networks for edge devices adopt shallow depth and small convolutional kernels to save memory and computational cost, which leads to a restricted receptive field. Conventional efficient learning methods focus on lightweight…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Peijie Dong , Xin Niu , Zhiliang Tian , Lujun Li , Xiaodong Wang , Zimian Wei , Hengyue Pan , Dongsheng Li

The study of healthy brain development helps to better understand the brain transformation and brain connectivity patterns which happen during childhood to adulthood. This study presents a sparse machine learning solution across whole-brain…

Machine Learning · Computer Science 2019-04-03 Peyman Hosseinzadeh Kassani , Alexej Gossmann , Yu-Ping Wang

This paper addresses the limited transfer and adaptation capabilities of large language models in low-resource language scenarios. It proposes a unified framework that combines a knowledge transfer module with parameter-efficient…

Computation and Language · Computer Science 2025-07-03 Shuangquan Lyu , Yingnan Deng , Guiran Liu , Zhen Qi , Ruotong Wang

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been…

Machine Learning · Statistics 2025-07-09 Javan Tahir , Surya Ganguli , Grant M. Rotskoff

An extreme learning machine (ELM) can be regarded as a two stage feed-forward neural network (FNN) learning system which randomly assigns the connections with and within hidden neurons in the first stage and tunes the connections with…

Machine Learning · Computer Science 2014-01-27 Shaobo Lin , Xia Liu , Jian Fang , Zongben Xu

In this paper, we introduce a novel concept for learning of the parameters in a neural network. Our idea is grounded on modeling a learning problem that addresses a trade-off between (i) satisfying local objectives at each node and (ii)…

Machine Learning · Computer Science 2019-02-04 Dimche Kostadinov , Behrooz Razdehi , Slava Voloshynovskiy

Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Lei Li , Veronika A. Zimmer , Wangbin Ding , Fuping Wu , Liqin Huang , Julia A. Schnabel , Xiahai Zhuang

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

Transfer learning techniques aim to leverage information from multiple related datasets to enhance prediction quality against a target dataset. Such methods have been adopted in the context of high-dimensional sparse regression, and some…

Machine Learning · Statistics 2025-01-31 Koki Okajima , Tomoyuki Obuchi

In electromyogram (EMG)-based motion recognition, a subject-specific classifier is typically trained with sufficient labeled data. However, this process demands extensive data collection over extended periods, burdening the subject. To…

Signal Processing · Electrical Eng. & Systems 2025-05-22 Seitaro Yoneda , Akira Furui

Extreme value theory (EVT) is a statistical tool for analysis of extreme events. It has a strong theoretical background, however, we need to choose hyper-parameters to apply EVT. In recent studies of machine learning, techniques of choosing…

Machine Learning · Computer Science 2021-07-14 Chikara Nakamura

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur