English
Related papers

Related papers: Learning to select data for transfer learning with…

200 papers

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Updating $\textit{a priori}$ information given some observed data is the core tenet of Bayesian inference. Bayesian transfer learning extends this idea by incorporating information from a related dataset to improve the inference on the…

Bayesian optimization (BO) is a popular black-box function optimization method, which makes sequential decisions based on a Bayesian model, typically a Gaussian process (GP), of the function. To ensure the quality of the model, transfer…

Machine Learning · Computer Science 2024-02-15 Zhou Fan , Xinran Han , Zi Wang

In supervised learning, training and test datasets are often sampled from distinct distributions. Domain adaptation techniques are thus required. Covariate shift adaptation yields good generalization performance when domains differ only by…

Machine Learning · Statistics 2022-01-11 Felipe Maia Polo , Renato Vicente

In this work, we explore the possibility of utilizing transfer learning techniques to address the financial portfolio optimization problem. We introduce a novel concept called "transfer risk", within the optimization framework of transfer…

Portfolio Management · Quantitative Finance 2023-07-26 Haoyang Cao , Haotian Gu , Xin Guo , Mathieu Rosenbaum

We study the issue of PAC-Bayesian domain adaptation: We want to learn, from a source domain, a majority vote model dedicated to a target one. Our theoretical contribution brings a new perspective by deriving an upper-bound on the target…

Machine Learning · Statistics 2016-07-27 Pascal Germain , Amaury Habrard , François Laviolette , Emilie Morvant

Supervised learning has been very successful for automatic segmentation of images from a single scanner. However, several papers report deteriorated performances when using classifiers trained on images from one scanner to segment images…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Veronika Cheplygina , Annegreet van Opbroek , M. Arfan Ikram , Meike W. Vernooij , Marleen de Bruijne

Recent advances in NLP demonstrate the effectiveness of training large-scale language models and transferring them to downstream tasks. Can fine-tuning these models on tasks other than language modeling further improve performance? In this…

Computation and Language · Computer Science 2020-10-08 Tu Vu , Tong Wang , Tsendsuren Munkhdalai , Alessandro Sordoni , Adam Trischler , Andrew Mattarella-Micke , Subhransu Maji , Mohit Iyyer

Transfer learning is a popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. It has enjoyed numerous empirical successes and inspired a growing number of theoretical studies.…

Machine Learning · Computer Science 2023-05-23 Haoyang Cao , Haotian Gu , Xin Guo

Domain adaptation for sentiment analysis is challenging due to the fact that supervised classifiers are very sensitive to changes in domain. The two most prominent approaches to this problem are structural correspondence learning and…

Computation and Language · Computer Science 2018-06-15 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

Machine Learning · Computer Science 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

Entity matching (EM) identifies data records that refer to the same real-world entity. Despite the effort in the past years to improve the performance in EM, the existing methods still require a huge amount of labeled data in each domain…

Machine Learning · Computer Science 2022-04-21 Mohamed Trabelsi , Jeff Heflin , Jin Cao

We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization scenario is the unavailability of any target domain data during training, resulting…

Machine Learning · Computer Science 2022-02-17 Zehao Xiao , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Acute respiratory infections have epidemic and pandemic potential and thus are being studied worldwide, albeit in many different contexts and study formats. Predicting infection from symptom data is critical, though using symptom data from…

Machine Learning · Computer Science 2018-06-26 Nabeel Abdur Rehman , Maxwell Matthaios Aliapoulios , Disha Umarwani , Rumi Chunara

In this paper, we propose a novel learning framework for the problem of domain transfer learning. We map the data of two domains to one single common space, and learn a classifier in this common space. Then we adapt the common classifier to…

Machine Learning · Computer Science 2016-08-17 Ru-Ze Liang , Wei Xie , Weizhi Li , Hongqi Wang , Jim Jing-Yan Wang , Lisa Taylor

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

F-measures are popular performance metrics, particularly for tasks with imbalanced data sets. Algorithms for learning to maximize F-measures follow two approaches: the empirical utility maximization (EUM) approach learns a classifier having…

Machine Learning · Computer Science 2012-06-22 Ye Nan , Kian Ming Chai , Wee Sun Lee , Hai Leong Chieu

Despite much research targeted at enabling conventional machine learning models to continually learn tasks and data distributions sequentially without forgetting the knowledge acquired, little effort has been devoted to account for more…

Machine Learning · Computer Science 2021-06-11 Sandra Servia-Rodriguez , Cecilia Mascolo , Young D. Kwon

Unsupervised models can provide supplementary soft constraints to help classify new, "target" data since similar instances in the target set are more likely to share the same class label. Such models can also help detect possible…

Machine Learning · Computer Science 2012-06-06 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Sreangsu Acharyya