English
Related papers

Related papers: Model Transferability With Responsive Decision Sub…

200 papers

We consider transferability estimation, the problem of estimating how well deep learning models transfer from a source to a target task. We focus on regression tasks, which received little previous attention, and propose two simple and…

Machine Learning · Computer Science 2023-12-05 Cuong N. Nguyen , Phong Tran , Lam Si Tung Ho , Vu Dinh , Anh T. Tran , Tal Hassner , Cuong V. Nguyen

This paper studies the performative policy learning problem, where agents adjust their features in response to a released policy to improve their potential outcomes, inducing an endogenous distribution shift. There has been growing interest…

Machine Learning · Computer Science 2025-02-25 Qianyi Chen , Ying Chen , Bo Li

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

Machine Learning · Statistics 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

Most research designing novel predictive models, or employing existing ones, assumes that training and testing data are independent and identically distributed. In practice, the data encountered at serving time often deviate from the…

Machine Learning · Computer Science 2026-03-30 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

In distributed processing, agents generally collect data generated by the same underlying unknown model (represented by a vector of parameters) and then solve an estimation or inference task cooperatively. In this paper, we consider the…

Information Theory · Computer Science 2015-06-16 Sheng-Yuan Tu , Ali H. Sayed

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

State of the art reinforcement learning has enabled training agents on tasks of ever increasing complexity. However, the current paradigm tends to favor training agents from scratch on every new task or on collections of tasks with a view…

Machine Learning · Computer Science 2023-02-09 Jacob Walker , Eszter Vértes , Yazhe Li , Gabriel Dulac-Arnold , Ankesh Anand , Théophane Weber , Jessica B. Hamrick

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a…

Artificial Intelligence · Computer Science 2018-06-21 Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , Supriyo Chakraborty

Learning guarantees often rely on assumptions of i.i.d. data, which will likely be violated in practice once predictors are deployed to perform real-world tasks. Domain adaptation approaches thus appeared as a useful framework yielding…

Machine Learning · Computer Science 2021-06-29 Joao Monteiro , Xavier Gibert , Jianqiao Feng , Vincent Dumoulin , Dar-Shyang Lee

Machine learning is used for inference and decision making in wearable sensor systems. However, recent studies have found that machine learning algorithms are easily fooled by the addition of adversarial perturbations to their inputs. What…

Machine Learning · Computer Science 2021-07-16 Ramesh Kumar Sah , Hassan Ghasemzadeh

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

Machine Learning · Statistics 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

We consider methods for transporting a prediction model and assessing its performance for use in a new target population, when outcome and covariate information for model development is available from a simple random sample from the source…

Applications · Statistics 2021-04-15 Jon A. Steingrimsson , Constantine Gatsonis , Issa J. Dahabreh

Adjustable autonomy refers to entities dynamically varying their own autonomy, transferring decision-making control to other entities (typically agents transferring control to human users) in key situations. Determining whether and when…

Artificial Intelligence · Computer Science 2011-06-24 D. V. Pynadath , P. Scerri , M. Tambe

Economists often estimate models using data from a particular domain, e.g. estimating risk preferences in a particular subject pool or for a specific class of lotteries. Whether a model's predictions extrapolate well across domains depends…

Theoretical Economics · Economics 2025-03-05 Isaiah Andrews , Drew Fudenberg , Lihua Lei , Annie Liang , Chaofeng Wu

Emotion recognition from speech is one of the key steps towards emotional intelligence in advanced human-machine interaction. Identifying emotions in human speech requires learning features that are robust and discriminative across diverse…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-30 Alison Marczewski , Adriano Veloso , Nívio Ziviani

We discuss the feasibility of predicting, managing and subsequently manipulating, the future evolution of a Complex Adaptive System. Our archetypal system mimics a population of adaptive, interacting objects, such as those arising in the…

Physics and Society · Physics 2007-05-23 David M. D. Smith , Neil F. Johnson

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

We consider robustness to distribution shifts in the context of diagnostic models in healthcare, where the prediction target $Y$, e.g., the presence of a disease, is causally upstream of the observations $X$, e.g., a biomarker. Distribution…

Transfer learning methods, and in particular domain adaptation, help exploit labeled data in one domain to improve the performance of a certain task in another domain. However, it is still not clear what factors affect the success of domain…

Computation and Language · Computer Science 2021-06-25 Nicolai Pogrebnyakov , Shohreh Shaghaghian