English
Related papers

Related papers: KITE: A Kernel-based Improved Transferability Esti…

200 papers

While balancing covariates between groups is central for observational causal inference, selecting which features to balance remains a challenging problem. Kernel balancing is a promising approach that first estimates a kernel that captures…

Methodology · Statistics 2025-12-15 Andy A. Shen , Eli Ben-Michael , Avi Feller , Luke Keele , Jared Murray

Parameter-Efficient Transfer Learning (PETL) aims at efficiently adapting large models pre-trained on massive data to downstream tasks with limited task-specific data. In view of the practicality of PETL, previous works focus on tuning a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Hengyuan Zhao , Hao Luo , Yuyang Zhao , Pichao Wang , Fan Wang , Mike Zheng Shou

Software-controlled heterogeneous memory systems have the potential to improve performance, efficiency, and cost tradeoffs in emerging systems. Delivering on this promise requires an efficient operating system (OS) mechanisms and policies…

Operating Systems · Computer Science 2020-04-13 Sudarsun Kannan , Yujie Ren , Abhishek Bhatacharjee

Large-scale pre-training has been proven to be crucial for various computer vision tasks. However, with the increase of pre-training data amount, model architecture amount, and the private/inaccessible data, it is not very efficient or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ruifei He , Shuyang Sun , Jihan Yang , Song Bai , Xiaojuan Qi

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

Machine Learning · Computer Science 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff

Quality Estimation (QE) is the task of automatically predicting Machine Translation quality in the absence of reference translations, making it applicable in real-time settings, such as translating online social media conversations. Recent…

Computation and Language · Computer Science 2021-07-02 Amit Gajbhiye , Marina Fomicheva , Fernando Alva-Manchego , Frédéric Blain , Abiola Obamuyide , Nikolaos Aletras , Lucia Specia

Since early machine learning models, metrics such as accuracy and precision have been the de facto way to evaluate and compare trained models. However, a single metric number doesn't fully capture the similarities and differences between…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Ahmad Mustapha , Wael Khreich , Wes Masri

The success of deep learning algorithms generally depends on large-scale data, while humans appear to have inherent ability of knowledge transfer, by recognizing and applying relevant knowledge from previous learning experiences when…

Machine Learning · Computer Science 2022-01-19 Junguang Jiang , Yang Shu , Jianmin Wang , Mingsheng Long

Intelligent Tutoring Systems (ITS), such as Massive Open Online Courses, offer new opportunities for human learning. At the core of such systems, knowledge tracing (KT) predicts students' future performance by analyzing their historical…

Computers and Society · Computer Science 2025-09-23 Hengyu Liu , Yushuai Li , Minghe Yu , Tiancheng Zhang , Ge Yu , Torben Bach Pedersen , Kristian Torp , Christian S. Jensen , Tianyi Li

Frailty is a condition in aging medicine characterized by diminished physiological reserve and increased vulnerability to stressors. However, frailty assessment remains subjective, heterogeneous, and difficult to scale in clinical practice.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Laura McDaniel , Basudha Pal , Crystal Szczesny , Yuxiang Guo , Zhaoyang Wang , Ryan Roemmich , Peter Abadir , Rama Chellappa

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

The goal of data attribution is to trace model predictions back to training data. Despite a long line of work towards this goal, existing approaches to data attribution tend to force users to choose between computational tractability and…

Machine Learning · Statistics 2023-04-04 Sung Min Park , Kristian Georgiev , Andrew Ilyas , Guillaume Leclerc , Aleksander Madry

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

Machine learning models used in medical applications often face challenges due to the covariate shift, which occurs when there are discrepancies between the distributions of training and target data. This can lead to decreased predictive…

Machine Learning · Computer Science 2024-12-24 Mingyang Cai , Thomas Klausch , Mark A. van de Wiel

In traditional Machine Learning, the algorithms predictions are based on the assumption that the data follows the same distribution in both the training and the test datasets. However, in real world data this condition does not hold and,…

Machine Learning · Computer Science 2024-02-05 Laura Fdez-Díaz , Sara González Tomillo , Elena Montañés , José Ramón Quevedo

Neural networks have become the dominant technique for accurate pitch and periodicity estimation. Although a lot of research has gone into improving network architectures and training paradigms, most approaches operate directly on the raw…

Sound · Computer Science 2025-07-16 David Marttila , Joshua D. Reiss

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

While natural language offers a convenient shared interface for humans and robots, enabling robots to interpret and follow language commands remains a longstanding challenge in manipulation. A crucial step to realizing a performant…

Robotics · Computer Science 2023-10-13 Priya Sundaresan , Suneel Belkhale , Dorsa Sadigh , Jeannette Bohg

Quantum kernel methods, i.e., kernel methods with quantum kernels, offer distinct advantages as a hybrid quantum-classical approach to quantum machine learning (QML), including applicability to Noisy Intermediate-Scale Quantum (NISQ)…

Quantum Physics · Physics 2022-11-29 Daniel T. Chang

Object detection is a central downstream task used to test if pre-trained network parameters confer benefits, such as improved accuracy or training speed. The complexity of object detection methods can make this benchmarking non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Yanghao Li , Saining Xie , Xinlei Chen , Piotr Dollar , Kaiming He , Ross Girshick