English
Related papers

Related papers: Enhancing Inference for Small Cohorts via Transfer…

200 papers

End-to-end Spoken Language Understanding (SLU) models are made increasingly large and complex to achieve the state-ofthe-art accuracy. However, the increased complexity of a model can also introduce high risk of over-fitting, which is a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Xueli Jia , Jianzong Wang , Zhiyong Zhang , Ning Cheng , Jing Xiao

Existing work within transfer learning often follows a two-step process -- pre-training over a large-scale source domain and then finetuning over limited samples from the target domain. Yet, despite its popularity, this methodology has been…

Machine Learning · Computer Science 2025-01-03 Akul Goyal , Carl Edwards

The pattern of Electroencephalogram (EEG) signal differs significantly across different subjects, and poses challenge for EEG classifiers in terms of 1) effectively adapting a learned classifier onto a new subject, 2) retaining knowledge of…

Machine Learning · Computer Science 2021-03-02 Tiehang Duan , Mihir Chauhan , Mohammad Abuzar Shaikh , Jun Chu , Sargur Srihari

Transfer Learning enables Convolutional Neural Networks (CNN) to acquire knowledge from a source domain and transfer it to a target domain, where collecting large-scale annotated examples is time-consuming and expensive. Conventionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 S. H. Shabbeer Basha , Debapriya Tula , Sravan Kumar Vinakota , Shiv Ram Dubey

Current neural networks architectures are many times harder to train because of the increasing size and complexity of the used datasets. Our objective is to design more efficient training algorithms utilizing causal relationships inferred…

Machine Learning · Computer Science 2021-05-03 Adrian Moldovan , Angel Caţaron , Răzvan Andonie

In the context of supervised learning of a function by a neural network, we claim and empirically verify that the neural network yields better results when the distribution of the data set focuses on regions where the function to learn is…

Machine Learning · Statistics 2022-09-28 Paul Novello , Gaël Poëtte , David Lugato , Pietro Congedo

Annotating medical images for disease detection is often tedious and expensive. Moreover, the available training samples for a given task are generally scarce and imbalanced. These conditions are not conducive for learning effective deep…

Image and Video Processing · Electrical Eng. & Systems 2023-01-24 Fouzia Altaf , Syed M. S. Islam , Naeem K. Janjua , Naveed Akhtar

This work considers the problem of transferring causal knowledge between tasks for Individual Treatment Effect (ITE) estimation. To this end, we theoretically assess the feasibility of transferring ITE knowledge and present a practical…

Machine Learning · Computer Science 2023-06-07 Ahmed Aloui , Juncheng Dong , Cat P. Le , Vahid Tarokh

Classification of ultrasound (US) kidney images for diagnosis of congenital abnormalities of the kidney and urinary tract (CAKUT) in children is a challenging task. It is desirable to improve existing pattern classification models that are…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Qiang Zheng , Gregory Tasian , Yong Fan

In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is often a domain shift…

Machine Learning · Computer Science 2020-06-23 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

How do we transfer the relevant knowledge from ever larger foundation models into small, task-specific downstream models that can run at much lower costs? Standard transfer learning using pre-trained weights as the initialization transfers…

Machine Learning · Computer Science 2024-06-12 Shikai Qiu , Boran Han , Danielle C. Maddix , Shuai Zhang , Yuyang Wang , Andrew Gordon Wilson

Diagnosing pre-existing heart diseases early in life is important as it helps prevent complications such as pulmonary hypertension, heart rhythm problems, blood clots, heart failure and sudden cardiac arrest. To identify such diseases,…

Current machine learning models aiming to predict sepsis from Electronic Health Records (EHR) do not account for the heterogeneity of the condition, despite its emerging importance in prognosis and treatment. This work demonstrates the…

Quantitative Methods · Quantitative Biology 2020-11-24 Zina Ibrahim , Honghan Wu , Ahmed Hamoud , Lukas Stappen , Richard Dobson , Andrea Agarossi

Knowledge sharing is crucial in healthcare, especially when leveraging data from multiple clinical sites to address data scarcity, reduce costs, and enable timely interventions. Transfer learning can facilitate cross-site knowledge…

Computation and Language · Computer Science 2024-09-24 Yuhe Gao , Runxue Bao , Yuelyu Ji , Yiming Sun , Chenxi Song , Jeffrey P. Ferraro , Ye Ye

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

Federated learning (FL) has been proposed as a method to train a model on different units without exchanging data. This offers great opportunities in the healthcare sector, where large datasets are available but cannot be shared to ensure…

Machine Learning · Computer Science 2022-04-21 Arash Mehrjou , Ashkan Soleymani , Annika Buchholz , Jürgen Hetzel , Patrick Schwab , Stefan Bauer

The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in…

Machine Learning · Computer Science 2019-07-03 Axel Uran , Coert van Gemeren , Rosanne van Diepen , Ricardo Chavarriaga , José del R. Millán

Transfer learning has recently attracted significant research attention, as it simultaneously learns from different source domains, which have plenty of labeled data, and transfers the relevant knowledge to the target domain with limited…

Machine Learning · Statistics 2018-06-14 Alireza Karbalayghareh , Xiaoning Qian , Edward R. Dougherty

Sepsis remains one of the most complex and heterogeneous syndromes in intensive care, characterized by diverse physiological trajectories and variable responses to treatment. While deep learning models perform well in the early prediction…

Machine Learning · Computer Science 2026-04-01 Vincent Lemaire , Nédra Meloulli , Pierre Jaquet

Transfer learning is a classic paradigm by which models pretrained on large "upstream" datasets are adapted to yield good results on "downstream" specialized datasets. Generally, more accurate models on the "upstream" dataset tend to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Eugenia Iofinova , Alexandra Peste , Mark Kurtz , Dan Alistarh