English
Related papers

Related papers: Expectation maximization transfer learning and its…

200 papers

Learning with identical train and test distributions has been extensively investigated both practically and theoretically. Much remains to be understood, however, in statistical learning under distribution shifts. This paper focuses on a…

Machine Learning · Computer Science 2024-11-01 Omar Montasser , Han Shao , Emmanuel Abbe

In most machine learning training paradigms a fixed, often handcrafted, loss function is assumed to be a good proxy for an underlying evaluation metric. In this work we assess this assumption by meta-learning an adaptive loss function to…

Machine Learning · Computer Science 2019-05-16 Chen Huang , Shuangfei Zhai , Walter Talbott , Miguel Angel Bautista , Shih-Yu Sun , Carlos Guestrin , Josh Susskind

Transfer learning is a conceptually-enticing paradigm in pursuit of truly intelligent embodied agents. The core concept -- reusing prior knowledge to learn in and from novel situations -- is successfully leveraged by humans to handle novel…

Many existing transfer learning methods rely on leveraging information from source data that closely resembles the target data. However, this approach often overlooks valuable knowledge that may be present in different yet potentially…

Machine Learning · Computer Science 2023-09-14 Xin Xiong , Zijian Guo , Tianxi Cai

Most research designing novel predictive models, or employing existing ones, assumes that training and testing data are independent and identically distributed. In practice, the data encountered at serving time often deviate from the…

Machine Learning · Computer Science 2026-03-30 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Mohammad Javad Shafiee , Parthipan Siva , Paul Fieguth , Alexander Wong

Many people suffer from the loss of a limb. Learning to get by without an arm or hand can be very challenging, and existing prostheses do not yet fulfil the needs of individuals with amputations. One promising solution is to provide greater…

Artificial Intelligence · Computer Science 2014-08-11 Adam S. R. Parker , Ann L. Edwards , Patrick M. Pilarski

Model-based optimization (MBO) is increasingly applied to design problems in science and engineering. A common scenario involves using a fixed training set to train models, with the goal of designing new samples that outperform those…

Machine Learning · Computer Science 2023-11-10 Farhan Damani , David H Brookes , Theodore Sternlieb , Cameron Webster , Stephen Malina , Rishi Jajoo , Kathy Lin , Sam Sinai

Due to the complexity of modeling the elastic properties of materials, the use of machine learning algorithms is continuously increasing for tactile sensing applications. Recent advances in deep neural networks applied to computer vision…

Robotics · Computer Science 2020-06-05 Carmelo Sferrazza , Raffaello D'Andrea

Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is…

Classical machine learning approaches are sensitive to non-stationarity. Transfer learning can address non-stationarity by sharing knowledge from one system to another, however, in areas like machine prognostics and defense, data is…

Machine Learning · Computer Science 2022-09-07 Tyler Cody , Stephen Adams , Peter A. Beling

We observe standard transfer learning can improve prediction accuracies of target tasks at the cost of lowering their prediction fairness -- a phenomenon we named discriminatory transfer. We examine prediction fairness of a standard…

Computers and Society · Computer Science 2017-08-09 Chao Lan , Jun Huan

The growing scale of deep learning models has rendered standard hyperparameter (HP) optimization prohibitively expensive. A promising solution is the use of scale-aware hyperparameters, which can enable direct transfer of optimal HPs from…

Machine Learning · Computer Science 2025-12-30 Nikhil Ghosh , Denny Wu , Alberto Bietti

Multi-robot transfer learning allows a robot to use data generated by a second, similar robot to improve its own behavior. The potential advantages are reducing the time of training and the unavoidable risks that exist during the training…

Robotics · Computer Science 2017-07-28 Mohamed K. Helwa , Angela P. Schoellig

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical…

Machine Learning · Computer Science 2024-11-12 Sepanta Zeighami , Cyrus Shahahbi

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

The generalization ability of machine learning models degrades significantly when the test distribution shifts away from the training distribution. We investigate the problem of training models that are robust to shifts caused by changes in…

Machine Learning · Computer Science 2023-09-19 Jiaheng Wei , Harikrishna Narasimhan , Ehsan Amid , Wen-Sheng Chu , Yang Liu , Abhishek Kumar

Machine learning tasks involving biomedical signals frequently grapple with issues such as limited data availability, imbalanced datasets, labeling complexities, and the interference of measurement noise. These challenges often hinder the…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Xiaomin Li , Mykhailo Sakevych , Gentry Atkinson , Vangelis Metsis

In this work, we address the question of the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems. We demonstrate that by using well-developed techniques based on the concept of…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Pedro J. Freire , Daniel Abode , Jaroslaw E. Prilepsky , Nelson Costa , Bernhard Spinnler , Antonio Napoli , Sergei K. Turitsyn

As an integral part of contemporary manufacturing, monitoring systems obtain valuable information during machining to oversee the condition of both the process and the machine. Recently, diverse algorithms have been employed to detect tool…

Machine Learning · Computer Science 2024-10-10 Zongshuo Li , Markus Meurer , Thomas Bergs