English
Related papers

Related papers: Probabilistic Pretraining for Neural Regression

200 papers

Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean…

Machine Learning · Computer Science 2025-10-24 Kaicheng Zhang , Sinian Zhang , Doudou Zhou , Yidong Zhou

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Interpretability is often pointed out as a key requirement for trustworthy machine learning. However, learning and releasing models that are inherently interpretable leaks information regarding the underlying training data. As such…

Artificial Intelligence · Computer Science 2024-04-04 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

Modern simulation-based inference techniques use neural networks to solve inverse problems efficiently. One notable strategy is neural posterior estimation (NPE), wherein a neural network parameterizes a distribution to approximate the…

Instrumentation and Methods for Astrophysics · Physics 2024-03-06 Alex Kolmus , Justin Janquart , Tomasz Baka , Twan van Laarhoven , Chris Van Den Broeck , Tom Heskes

Deep learning has enjoyed tremendous success in a variety of applications but its application to quantile regressions remains scarce. A major advantage of the deep learning approach is its flexibility to model complex data in a more…

Statistics Theory · Mathematics 2021-06-14 Qixian Zhong , Jane-Ling Wang

Class imbalance induces systematic bias in deep neural networks by imposing a skewed effective class prior. This work introduces the Neural Prior Estimator (NPE), a framework that learns feature-conditioned log-prior estimates from latent…

Machine Learning · Computer Science 2026-02-23 Masoud Yavari , Payman Moallem

Modular approaches that use a different composition of modules for each problem are a promising direction in continual learning (CL). However, searching through the large, discrete space of module compositions is challenging, especially…

Machine Learning · Computer Science 2024-05-03 Lazar Valkov , Akash Srivastava , Swarat Chaudhuri , Charles Sutton

Transfer learning where the behavior of extracting transferable knowledge from the source domain(s) and reusing this knowledge to target domain has become a research area of great interest in the field of artificial intelligence.…

Machine Learning · Computer Science 2021-09-29 Junyu Xuan , Jie Lu , Guangquan Zhang

In data stream mining, predictive models typically suffer drops in predictive performance due to concept drift. As enough data representing the new concept must be collected for the new concept to be well learnt, the predictive performance…

Machine Learning · Computer Science 2019-10-10 Honghui Du , Leandro L. Minku , Huiyu Zhou

Quantile regression is an effective technique to quantify uncertainty, fit challenging underlying distributions, and often provide full probabilistic predictions through joint learnings over multiple quantile levels. A common drawback of…

Machine Learning · Computer Science 2022-02-24 Youngsuk Park , Danielle Maddix , François-Xavier Aubet , Kelvin Kan , Jan Gasthaus , Yuyang Wang

The emerging classical-quantum transfer learning paradigm has brought a decent performance to quantum computational models in many tasks, such as computer vision, by enabling a combination of quantum models and classical pre-trained neural…

Quantum Physics · Physics 2023-02-28 Qiuchi Li , Benyou Wang , Yudong Zhu , Christina Lioma , Qun Liu

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has…

Machine Learning · Statistics 2023-12-22 Piotr M. Suder , Jason Xu , David B. Dunson

Transfer learning aims to improve performance on a target task by leveraging information from related source tasks. We propose a nonparametric regression transfer learning framework that explicitly models heterogeneity in the source-target…

Statistics Theory · Mathematics 2026-03-19 Hélène Halconruy , Benjamin Bobbia , Paul Lejamtel

The popularity of transfer learning stems from the fact that it can borrow information from useful auxiliary datasets. Existing statistical transfer learning methods usually adopt a global similarity measure between the source data and the…

Machine Learning · Computer Science 2025-12-09 Ruqian Zhang , Yijiao Zhang , Annie Qu , Zhongyi Zhu , Juan Shen

Supervised transfer learning has received considerable attention due to its potential to boost the predictive power of machine learning in scenarios where data are scarce. Generally, a given set of source models and a dataset from a target…

Machine Learning · Statistics 2024-01-23 Shunya Minami , Kenji Fukumizu , Yoshihiro Hayashi , Ryo Yoshida

Quantile regression is a powerful data analysis tool that accommodates heterogeneous covariate-response relationships. We find that by coupling the asymmetric Laplace working likelihood with appropriate shrinkage priors, we can deliver…

Methodology · Statistics 2021-11-02 Yuanzhi Li , Xuming He

Neural Processes (NPs) are a rapidly evolving class of models designed to directly model the posterior predictive distribution of stochastic processes. Originally developed as a scalable alternative to Gaussian Processes (GPs), which are…

Machine Learning · Computer Science 2026-04-20 Daniel Jenson , Jhonathan Navott , Mengyan Zhang , Makkunda Sharma , Elizaveta Semenova , Seth Flaxman

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik