English
Related papers

Related papers: Transfer Learning with Large-Scale Quantile Regres…

200 papers

Through this project, we researched on transfer learning methods and their applications on real world problems. By implementing and modifying various methods in transfer learning for our problem, we obtained an insight in the advantages and…

Machine Learning · Computer Science 2017-07-11 Hailin Chen , Shengping Cui , Sebastian Li

Quantile regression provides a framework for modeling statistical quantities of interest other than the conditional mean. The regression methodology is well developed for linear models, but less so for nonparametric models. We consider…

Statistics Theory · Mathematics 2009-09-29 Mi-Ok Kim

Spectrum analysis systems in online water quality testing are designed to detect types and concentrations of pollutants and enable regulatory agencies to respond promptly to pollution incidents. However, spectral data-based testing devices…

Machine Learning · Computer Science 2023-08-15 Haiwen Du , Zheng Ju , Yu An , Honghui Du , Dongjie Zhu , Zhaoshuo Tian , Aonghus Lawlor , Ruihai Dong

When we transfer a pretrained language model to a new language, there are many axes of variation that change at once. To disentangle the impact of different factors like syntactic similarity and vocabulary similarity, we propose a set of…

Computation and Language · Computer Science 2024-01-25 Zhengxuan Wu , Alex Tamkin , Isabel Papadimitriou

We address the challenge of multi-target quantum optimization, where the objective is to simultaneously optimize multiple cost functions defined over the same quantum search space. To accelerate optimization and reduce quantum resource…

Quantum Physics · Physics 2025-09-30 Vu Tuan Hai , Bui Cao Doanh , Le Vu Trung Duong , Pham Hoai Luan , Yasuhiko Nakashima

We address the problem of ensemble selection in transfer learning: Given a large pool of source models we want to select an ensemble of models which, after fine-tuning on the target training set, yields the best performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrea Agostinelli , Jasper Uijlings , Thomas Mensink , Vittorio Ferrari

Pre-trained models have become pivotal in enhancing the efficiency and accuracy of time series forecasting on target data sets by leveraging transfer learning. While benchmarks validate the performance of model generalization on various…

Machine Learning · Computer Science 2024-07-08 Claudia Ehrig , Benedikt Sonnleitner , Ursula Neumann , Catherine Cleophas , Germain Forestier

Many existing transfer learning methods rely on leveraging information from source data that closely resembles the target data. However, this approach often overlooks valuable knowledge that may be present in different yet potentially…

Machine Learning · Computer Science 2023-09-14 Xin Xiong , Zijian Guo , Tianxi Cai

Randomized clinical trials are the gold standard for analyzing treatment effects, but high costs and ethical concerns can limit recruitment, potentially leading to invalid inferences. Incorporating external trial data with similar…

Methodology · Statistics 2024-09-09 Yujia Gu , Hanzhong Liu , Wei Ma

Different flavors of transfer learning have shown tremendous impact in advancing research and applications of machine learning. In this work we study the use of a specific family of transfer learning, where the target domain is mapped to…

Computation and Language · Computer Science 2020-11-06 Mahdi Namazifar , Alexandros Papangelis , Gokhan Tur , Dilek Hakkani-Tür

Molecules have a number of distinct properties whose importance and application vary. Often, in reality, labels for some properties are hard to achieve despite their practical importance. A common solution to such data scarcity is to use…

Machine Learning · Computer Science 2024-10-02 Chanhui Lee , Dae-Woong Jeong , Sung Moon Ko , Sumin Lee , Hyunseung Kim , Soorin Yim , Sehui Han , Sungwoong Kim , Sungbin Lim

Transfer-learning and meta-learning are two effective methods to apply knowledge learned from large data sources to new tasks. In few-class, few-shot target task settings (i.e. when there are only a few classes and training examples…

Machine Learning · Computer Science 2019-02-11 Amir Erfan Eshratifar , Mohammad Saeed Abrishami , David Eigen , Massoud Pedram

The scarcity of labelled data is specifically an urgent challenge in the field of quantum machine learning (QML). Two transfer fusion frameworks are proposed in this paper to predict the labels of a target domain data by aligning its…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xi He , Feiyu Du , Xiaohan Yu , Yang Zhao , Tao Lei

Recent advances in NLP demonstrate the effectiveness of training large-scale language models and transferring them to downstream tasks. Can fine-tuning these models on tasks other than language modeling further improve performance? In this…

Computation and Language · Computer Science 2020-10-08 Tu Vu , Tong Wang , Tsendsuren Munkhdalai , Alessandro Sordoni , Adam Trischler , Andrew Mattarella-Micke , Subhransu Maji , Mohit Iyyer

Quantile regression has become a valuable tool to analyze heterogeneous covaraite-response associations that are often encountered in practice. The development of quantile regression methodology for high-dimensional covariates primarily…

Methodology · Statistics 2015-07-06 Qi Zheng , Limin Peng , Xuming He

When labeled data is scarce for a specific target task, transfer learning often offers an effective solution by utilizing data from a related source task. However, when transferring knowledge from a less related source, it may inversely…

Machine Learning · Computer Science 2019-10-08 Zirui Wang , Zihang Dai , Barnabás Póczos , Jaime Carbonell

Numerous applications of machine learning involve representing probability distributions over high-dimensional data. We propose autoregressive quantile flows, a flexible class of normalizing flow models trained using a novel objective based…

Machine Learning · Computer Science 2023-02-17 Phillip Si , Allan Bishop , Volodymyr Kuleshov

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

Machine learning-based performance models are increasingly being used to build critical job scheduling and application optimization decisions. Traditionally, these models assume that data distribution does not change as more samples are…

Machine Learning · Computer Science 2023-10-27 Ray A. O. Sinurat , Anurag Daram , Haryadi S. Gunawi , Robert B. Ross , Sandeep Madireddy

We study transfer learning for estimation in latent variable network models. In our setting, the conditional edge probability matrices given the latent variables are represented by $P$ for the source and $Q$ for the target. We wish to…

Machine Learning · Computer Science 2024-06-07 Akhil Jalan , Arya Mazumdar , Soumendu Sundar Mukherjee , Purnamrita Sarkar