English
Related papers

Related papers: Don't Waste Data: Transfer Learning to Leverage Al…

200 papers

Previous research has demonstrated that specific states of the climate system can lead to enhanced subseasonal predictability (i.e., state-dependent predictability). However, biases in Earth system models can affect the representation of…

Atmospheric and Oceanic Physics · Physics 2024-09-18 Kirsten J. Mayer , Katherine Dagon , Maria J. Molina

The development of data-informed predictive models for dynamical systems is of widespread interest in many disciplines. We present a unifying framework for blending mechanistic and machine-learning approaches to identify dynamical systems…

Dynamical Systems · Mathematics 2022-08-18 Matthew E. Levine , Andrew M. Stuart

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang

We propose a learning problem involving adapting a pre-trained source model to the target domain for classifying all classes that appeared in the source data, using target data that covers only a partial label space. This problem is…

Machine Learning · Computer Science 2023-11-03 Cheng-Hao Tu , Hong-You Chen , Zheda Mai , Jike Zhong , Vardaan Pahuja , Tanya Berger-Wolf , Song Gao , Charles Stewart , Yu Su , Wei-Lun Chao

To mitigate the negative effect of low quality training data on the performance of neural machine translation models, most existing strategies focus on filtering out harmful data before training starts. In this paper, we explore strategies…

Computation and Language · Computer Science 2021-03-01 Xinyi Wang , Ankur Bapna , Melvin Johnson , Orhan Firat

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Valuable training data is often owned by independent organizations and located in multiple data centers. Most deep learning approaches require to centralize the multi-datacenter data for performance purpose. In practice, however, it is…

Machine Learning · Computer Science 2018-10-17 Kele Xu , Haibo Mi , Dawei Feng , Huaimin Wang , Chuan Chen , Zibin Zheng , Xu Lan

Training on web-scale data can take months. But most computation and time is wasted on redundant and noisy points that are already learnt or not learnable. To accelerate training, we introduce Reducible Holdout Loss Selection (RHO-LOSS), a…

With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years, in fact, as much as 90% of current data were created in the last couple of years,a trend that will…

Machine Learning · Computer Science 2015-03-19 O. Y. Al-Jarrah , P. D. Yoo , S Muhaidat , G. K. Karagiannidis , K. Taha

Extensive efforts to gather materials data have largely overlooked potential data redundancy. In this study, we present evidence of a significant degree of redundancy across multiple large datasets for various material properties, by…

Imitation learning for robotic tasks has relied primarily on policies trained only on successful demonstrations, although failures are unavoidable during human data collection. Many existing approaches for exploiting failure data require…

Robotics · Computer Science 2026-05-21 Kana Miyamoto , Kanata Suzuki , Tetsuya Ogata

Data analysis in high energy physics has to deal with data samples produced from different sources. One of the most widely used ways to unfold their contributions is the sPlot technique. It uses the results of a maximum likelihood fit to…

High Energy Physics - Experiment · Physics 2020-08-26 Maxim Borisyak , Nikita Kazeev

While scaling laws provide a reliable methodology for predicting train loss across compute scales for a single data distribution, less is known about how these predictions should change as we change the distribution. In this paper, we…

Machine Learning · Computer Science 2024-11-21 David Brandfonbrener , Nikhil Anand , Nikhil Vyas , Eran Malach , Sham Kakade

The efficient collection of samples is an important factor in outdoor information gathering applications on account of high sampling costs such as time, energy, and potential destruction to the environment. Utilization of available a-priori…

Robotics · Computer Science 2024-03-08 Nicholas Harrison , Nathan Wallace , Salah Sukkarieh

In this report, we combine the idea of Wide ResNets and transfer learning to optimize the architecture of deep neural networks. The first improvement of the architecture is the use of all layers as information source for the last layer.…

Machine Learning · Computer Science 2022-06-22 Wolfgang Fuhl

Typical deep learning approaches to modeling high-dimensional data often result in complex models that do not easily reveal a new understanding of the data. Research in the deep learning field is very actively pursuing new methods to…

Machine Learning · Computer Science 2022-05-16 Charles Anderson , Jason Stock , David Anderson

With the success of machine learning (ML) applied to climate reaching further every day, emulators have begun to show promise not only for weather but for multi-year time scales in the atmosphere. Similar work for the ocean remains nascent,…

Atmospheric and Oceanic Physics · Physics 2024-08-05 Surya Dheeshjith , Adam Subel , Shubham Gupta , Alistair Adcroft , Carlos Fernandez-Granda , Julius Busecke , Laure Zanna

The data used during training in any given application space is directly tied to the performance of the system once deployed. While there are many other factors that go into producing high performance models within machine learning, there…

Machine Learning · Computer Science 2024-06-17 William H. Clark , Alan J. Michaels

We propose a series of data-centric heuristics for improving the performance of machine learning systems when applied to problems in quantum information science. In particular, we consider how systematic engineering of training sets can…

Quantum Physics · Physics 2022-10-05 Sanjaya Lohani , Joseph M. Lukens , Ryan T. Glasser , Thomas A. Searles , Brian T. Kirby

Modern systems (e.g., deep neural networks, big data analytics, and compilers) are highly configurable, which means they expose different performance behavior under different configurations. The fundamental challenge is that one cannot…

Artificial Intelligence · Computer Science 2019-02-27 Mohammad Ali Javidian , Pooyan Jamshidi , Marco Valtorta