English
Related papers

Related papers: Evaluating the Values of Sources in Transfer Learn…

200 papers

Parameter-efficient transfer learning (PETL) has emerged as a flourishing research field for adapting large pre-trained models to downstream tasks, greatly reducing trainable parameters while grappling with memory challenges during…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Haiwen Diao , Bo Wan , Xu Jia , Yunzhi Zhuge , Ying Zhang , Huchuan Lu , Long Chen

Efficient data annotation stands as a significant bottleneck in training contemporary machine learning models. The Programmatic Weak Supervision (PWS) pipeline presents a solution by utilizing multiple weak supervision sources to…

Machine Learning · Computer Science 2025-03-18 Naiqing Guan , Nick Koudas

Style transfer is the task of rewriting a sentence into a target style while approximately preserving content. While most prior literature assumes access to a large style-labelled corpus, recent work (Riley et al. 2021) has attempted…

Computation and Language · Computer Science 2022-03-15 Kalpesh Krishna , Deepak Nathani , Xavier Garcia , Bidisha Samanta , Partha Talukdar

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

Computation and Language · Computer Science 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung

Authorship style transfer involves altering text to match the style of a target author whilst preserving the original meaning. Existing unsupervised approaches like STRAP have largely focused on style transfer to target authors with many…

Computation and Language · Computer Science 2024-11-05 Ajay Patel , Nicholas Andrews , Chris Callison-Burch

Benefiting from deep learning research and large-scale datasets, saliency prediction has achieved significant success in the past decade. However, it still remains challenging to predict saliency maps on images in new domains that lack…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

This paper describes our system developed for the SemEval-2023 Task 12 "Sentiment Analysis for Low-resource African Languages using Twitter Dataset". Sentiment analysis is one of the most widely studied applications in natural language…

Computation and Language · Computer Science 2024-01-08 Mingyang Wang , Heike Adel , Lukas Lange , Jannik Strötgen , Hinrich Schütze

In this work, we introduce a "score-based assessment" framework for estimating the transferability of pre-trained speech models (PSMs) for fine-tuning target tasks. We leverage upon two representation theories, Bayesian likelihood…

Computation and Language · Computer Science 2024-02-07 Zih-Ching Chen , Chao-Han Huck Yang , Bo Li , Yu Zhang , Nanxin Chen , Shuo-Yiin Chang , Rohit Prabhavalkar , Hung-yi Lee , Tara N. Sainath

Prompt tuning in natural language processing (NLP) has become an increasingly popular method for adapting large language models to specific tasks. However, the transferability of these prompts, especially continuous prompts, between…

Computation and Language · Computer Science 2024-07-15 Zijun Wu , Yongkang Wu , Lili Mou

Transfer learning is a very important tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2020-01-24 Daniel Jakubovitz , Miguel R. D. Rodrigues , Raja Giryes

We propose to help weakly supervised object localization for classes where location annotations are not available, by transferring things and stuff knowledge from a source set with available annotations. The source and target classes might…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Miaojing Shi , Holger Caesar , Vittorio Ferrari

Recently, the pre-trained Transformer models have received a rising interest in the field of speech processing thanks to their great success in various downstream tasks. However, most fine-tuning approaches update all the parameters of the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Junyi Peng , Themos Stafylakis , Rongzhi Gu , Oldřich Plchot , Ladislav Mošner , Lukáš Burget , Jan Černocký

We propose novel model transfer-learning methods that refine a decision forest model M learned within a "source" domain using a training set sampled from a "target" domain, assumed to be a variation of the source. We present two random…

Machine Learning · Computer Science 2018-05-01 Noam Segev , Maayan Harel , Shie Mannor , Koby Crammer , Ran El-Yaniv

The shapes of functions provide highly interpretable summaries of their trajectories. This article develops a novel transfer learning methodology to tackle the challenge of data scarcity in functional linear models. The methodology…

Methodology · Statistics 2025-10-16 Shuhao Jiao , Ian W. Mckeague

Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values…

Machine Learning · Statistics 2020-02-07 Kjersti Aas , Martin Jullum , Anders Løland

Multi-source entity linkage focuses on integrating knowledge from multiple sources by linking the records that represent the same real world entity. This is critical in high-impact applications such as data cleaning and user stitching. The…

Machine Learning · Computer Science 2021-10-28 Di Jin , Bunyamin Sisman , Hao Wei , Xin Luna Dong , Danai Koutra

Transfer Learning is an area of statistics and machine learning research that seeks answers to the following question: how do we build successful learning algorithms when the data available for training our model is qualitatively different…

Machine Learning · Computer Science 2022-11-09 Brandon Tse Wei Chow

Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional…

Computation and Language · Computer Science 2021-02-24 Hossein Sadr , Mozhdeh Nazari Solimandarabi , Mir Mohsen Pedram , Mohammad Teshnehlab

Deep text matching approaches have been widely studied for many applications including question answering and information retrieval systems. To deal with a domain that has insufficient labeled data, these approaches can be used in a…

Information Retrieval · Computer Science 2019-01-01 Chen Qu , Feng Ji , Minghui Qiu , Liu Yang , Zhiyu Min , Haiqing Chen , Jun Huang , W. Bruce Croft

Quantifying the value of data within a machine learning workflow can play a pivotal role in making more strategic decisions in machine learning initiatives. The existing Shapley value based frameworks for data valuation in machine learning…

Machine Learning · Computer Science 2024-07-10 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Hong Ming Tan , Bowei Chen , Mohan Kankanhalli