English
Related papers

Related papers: Continual Density Ratio Estimation in an Online Se…

200 papers

Continuous-time reinforcement learning (CTRL) provides a natural framework for sequential decision-making in dynamic environments where interactions evolve continuously over time. While CTRL has shown growing empirical success, its ability…

Machine Learning · Computer Science 2025-12-04 Runze Zhao , Yue Yu , Ruhan Wang , Chunfeng Huang , Dongruo Zhou

Modes and ridges of the probability density function behind observed data are useful geometric features. Mode-seeking clustering assigns cluster labels by associating data samples with the nearest modes, and estimation of density ridges…

Machine Learning · Statistics 2018-04-03 Hiroaki Sasaki , Takafumi Kanamori , Aapo Hyvärinen , Gang Niu , Masashi Sugiyama

Density estimation is a central primitive in probabilistic modeling, yet continuous, discrete, and mixed-variable domains are often treated by separate objectives, limiting the ability to exploit a common statistical structure across data…

Artificial Intelligence · Computer Science 2026-05-12 Zhijun Zeng , Yixuan Jiang , Pipi Hu , Zuoqiang Shi

Continuous Relation Extraction (CRE) aims to incrementally learn relation knowledge from a non-stationary stream of data. Since the introduction of new relational tasks can overshadow previously learned information, catastrophic forgetting…

Computation and Language · Computer Science 2024-03-06 Mengyi Huang , Meng Xiao , Ludi Wang , Yi Du

Modeling distributions of covariates, or density estimation, is a core challenge in unsupervised learning. However, the majority of work only considers the joint distribution, which has limited utility in practical situations. A more…

Machine Learning · Computer Science 2021-10-28 Ryan R. Strauss , Junier B. Oliva

Cross-domain recommendation (CDR) methods are proposed to tackle the sparsity problem in click through rate (CTR) estimation. Existing CDR methods directly transfer knowledge from the source domains to the target domain and ignore the…

Machine Learning · Computer Science 2024-11-15 Ke Xu , Ziliang Wang , Wei Zheng , Yuhao Ma , Chenglin Wang , Nengxue Jiang , Cai Cao

Distribution system state estimation (DSSE) is paramount for effective state monitoring and control. However, stochastic outputs of renewables and asynchronous streaming of multi-rate measurements in practical systems largely degrade the…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Ying Zhang , Junbo Zhao , Di Shi , Sungjoo Chung

Density ratio estimation in high dimensions can be reframed as integrating a certain quantity, the time score, over probability paths which interpolate between the two densities. In practice, the time score has to be estimated based on…

Machine Learning · Computer Science 2025-06-13 Hanlin Yu , Arto Klami , Aapo Hyvärinen , Anna Korba , Omar Chehab

Conditional density estimation (CDE) is a fundamental task in machine learning that aims to model the full conditional law $\mathbb{P}(\mathbf{y} \mid \mathbf{x})$, beyond mere point prediction (e.g., mean, mode). A core challenge is…

Machine Learning · Computer Science 2026-03-27 Chenglong Song , Mazharul Islam , Lin Wang , Bing Chen , Bo Yang

In order to achieve Continual Learning (CL), the problem of catastrophic forgetting, one that has plagued neural networks since their inception, must be overcome. The evaluation of continual learning methods relies on splitting a known…

Machine Learning · Computer Science 2025-11-12 Raphaël Bayle , Martial Mermillod , Robert M. French

Task-free continual learning (CL) aims to learn a non-stationary data stream without explicit task definitions and not forget previous knowledge. The widely adopted memory replay approach could gradually become less effective for long data…

Machine Learning · Computer Science 2022-08-23 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Tiehang Duan , Mingchen Gao

The non-stationary nature of data streams strongly challenges traditional machine learning techniques. Although some solutions have been proposed to extend traditional machine learning techniques for handling data streams, these approaches…

Machine Learning · Computer Science 2021-06-23 Xuyang Yan , Abdollah Homaifar , Mrinmoy Sarkar , Abenezer Girma , Edward Tunstel

Density Ratio Estimation (DRE) is an important machine learning technique with many downstream applications. We consider the challenge of DRE with missing not at random (MNAR) data. In this setting, we show that using standard DRE methods…

Machine Learning · Statistics 2023-02-22 Josh Givens , Song Liu , Henry W J Reeve

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

Estimating uncertainty in deep learning models is critical for reliable decision-making in high-stakes applications such as medical imaging. Prior research has established that the difference between an input sample and its reconstructed…

Machine Learning · Computer Science 2026-01-28 Xinran Xu , Li Rong Wang , Xiuyi Fan

Calibrated uncertainty estimates in machine learning are crucial to many fields such as autonomous vehicles, medicine, and weather and climate forecasting. While there is extensive literature on uncertainty calibration for classification,…

Machine Learning · Computer Science 2021-03-16 Eric Zelikman , Christopher Healy , Sharon Zhou , Anand Avati

Hybrid AC/DC distribution systems are becoming a popular means to accommodate the increasing penetration of distributed energy resources and flexible loads. This paper proposes a distributed and robust state estimation (DRSE) method for…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Manyun Huang , Junbo Zhao , Zhinong Wei , Marco Pau , Guoqiang Sun

Online continual learning (CL) aims to learn new knowledge and consolidate previously learned knowledge from non-stationary data streams. Due to the time-varying training setting, the model learned from a changing distribution easily…

Machine Learning · Computer Science 2023-08-15 Quanziang Wang , Renzhen Wang , Yichen Wu , Xixi Jia , Deyu Meng

The distribution of streaming data often changes over time as conditions change, a phenomenon known as concept drift. Only a subset of previous experience, collected in similar conditions, is relevant to learning an accurate classifier for…

Machine Learning · Computer Science 2024-08-20 Ben Halstead , Yun Sing Koh , Patricia Riddle , Mykola Pechenizkiy , Albert Bifet

The increasing deployment of distribution-level phasor measurement units (PMUs) calls for dynamic distribution state estimation (DDSE) approaches that tap into high-rate measurements to maintain a comprehensive view of the…

Optimization and Control · Mathematics 2020-01-09 Jianhan Song , Emiliano Dall'Anese , Andrea Simonetto , Hao Zhu