English
Related papers

Related papers: Rethinking the Mathematical Framework and Optimali…

200 papers

Nonnegative matrix factorization (NMF) is a linear dimensionality reduction technique for nonnegative data, with applications such as hyperspectral unmixing and topic modeling. NMF is a difficult problem in general (NP-hard), and its…

Numerical Analysis · Mathematics 2025-11-11 Junjun Pan , Valentin Leplat , Michael Ng , Nicolas Gillis

Unsupervised feature selection has been always attracting research attention in the communities of machine learning and data mining for decades. In this paper, we propose an unsupervised feature selection method seeking a feature…

Machine Learning · Computer Science 2015-06-04 Sen Wang , Feiping Nie , Xiaojun Chang , Lina Yao , Xue Li , Quan Z. Sheng

We propose a new method to enforce priors on the solution of the nonnegative matrix factorization (NMF). The proposed algorithm can be used for denoising or single-channel source separation (SCSS) applications. The NMF solution is guided to…

Machine Learning · Computer Science 2013-03-01 Emad M. Grais , Hakan Erdogan

Nonnegative Matrix Factorization (NMF) is a widely-used data analysis technique, and has yielded impressive results in many real-world tasks. Generally, existing NMF methods represent each sample with several centroids, and find the optimal…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Mulin Chen , Xuelong Li

In this work, we introduce a stochastic maximum principle (SMP) approach for solving the reinforcement learning problem with the assumption that the unknowns in the environment can be parameterized based on physics knowledge. For the…

Optimization and Control · Mathematics 2023-06-14 Richard Archibald , Feng Bao , Jiongmin Yong

Linear minimum mean square error (LMMSE) estimation is often ill-conditioned, suggesting that unconstrained minimization of the mean square error is an inadequate approach to filter design. To address this, we first develop a unifying…

Signal Processing · Electrical Eng. & Systems 2022-03-23 Edwin K. P. Chong

We develop a general framework for state estimation in systems modeled with noise-polluted continuous time dynamics and discrete time noisy measurements. Our approach is based on maximum likelihood estimation and employs the calculus of…

Optimization and Control · Mathematics 2026-01-16 Griffin M. Kearney , Makan Fardad

This paper considers statistical estimation problems where the probability distribution of the observed random variable is invariant with respect to actions of a finite topological group. It is shown that any such distribution must satisfy…

Machine Learning · Statistics 2015-06-23 Yu-Hui Chen , Dennis Wei , Gregory Newstadt , Marc DeGraef , Jeffrey Simmons , Alfred Hero

Bayesian Matrix Factorization (BMF) is a powerful technique for recommender systems because it produces good results and is relatively robust against overfitting. Yet BMF is more computationally intensive and thus more challenging to…

We study the typical learning properties of the recently introduced Soft Margin Classifiers (SMCs), learning realizable and unrealizable tasks, with the tools of Statistical Mechanics. We derive analytically the behaviour of the learning…

Disordered Systems and Neural Networks · Physics 2009-11-07 Sebastian Risau-Gusman , Mirta B. Gordon

Ensuring safety for autonomous systems under uncertainty remains challenging, particularly when safety of the true state is required despite the true state not being fully known. Control barrier functions (CBFs) have become widely adopted…

Systems and Control · Electrical Eng. & Systems 2026-01-26 Ruoyu Lin , Magnus Egerstedt

In this paper, a set-membership filtering-based leader-follower synchronization protocol for discrete-time linear multi-agent systems is proposed wherein the aim is to make the agents synchronize with a leader. The agents, governed by…

Systems and Control · Electrical Eng. & Systems 2020-12-09 Diganta Bhattacharjee , Kamesh Subbarao

We consider the problem of approximating optimal in the Minimum Mean Squared Error (MMSE) sense nonlinear filters in a discrete time setting, exploiting properties of stochastically convergent state process approximations. More…

Statistics Theory · Mathematics 2016-11-15 Dionysios S. Kalogerias , Athina P. Petropulu

We provide a framework which admits a number of ``marginal'' sequential Monte Carlo (SMC) algorithms as particular cases -- including the marginal particle filter [Klaas et al., 2005, in: Proceedings of Uncertainty in Artificial…

Computation · Statistics 2023-03-08 Francesca R. Crucinio , Adam M. Johansen

Filtering for stochastic reaction networks (SRNs) is an important problem in systems/synthetic biology aiming to estimate the state of unobserved chemical species. A good solution to it can provide scientists valuable information about the…

Quantitative Methods · Quantitative Biology 2021-10-18 Zhou Fang , Ankit Gupta , Mustafa Khammash

We propose a generalised framework for the updating of a prior ensemble to a posterior ensemble, an essential yet challenging part in ensemble-based filtering methods. The proposed framework is based on a generalised and fully Bayesian view…

Methodology · Statistics 2021-03-29 Margrethe Kvale Loe , Håkon Tjelmeland

This paper addresses the problem of mixed-membership estimation in networks, where the goal is to efficiently estimate the latent mixed-membership structure from the observed network. Recognizing the widespread availability and valuable…

Statistics Theory · Mathematics 2025-02-11 Jianqing Fan , Jiawei Ge , Jikai Hou

In this work, we consider the problem of goodness-of-fit (GoF) testing for parametric models. This testing problem involves a composite null hypothesis, due to the unknown values of the model parameters. In some special cases, co-sufficient…

Methodology · Statistics 2025-12-23 Wanrong Zhu , Rina Foygel Barber

Consider $n$ random variables forming a Markov random field (MRF). The true model of the MRF is unknown, and it is assumed to belong to a binary set. The objective is to sequentially sample the random variables (one-at-a-time) such that the…

Methodology · Statistics 2020-08-04 Javad Heydari , Ali Tajer , H. Vincent Poor

Traditional state estimation methods rely on probabilistic assumptions that often collapse epistemic uncertainty into scalar beliefs, risking overconfidence in sparse or adversarial sensing environments. We introduce the Epistemic…

Information Theory · Computer Science 2025-08-29 Moriba Jah , Van Haslett