English
Related papers

Related papers: Robust Model Order Selection in Large Dimensional …

200 papers

The complementary item recommender system (CIRS) recommends the complementary items for a given query item. Existing CIRS models consider the item co-purchase signal as a proxy of the complementary relationship due to the lack of…

Information Retrieval · Computer Science 2022-02-14 Luyi Ma , Jianpeng Xu , Jason H. D. Cho , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Modern deep learning heavily relies on large labeled datasets, which often comse with high costs in terms of both manual labeling and computational resources. To mitigate these challenges, researchers have explored the use of informative…

Machine Learning · Statistics 2023-09-07 Yong Lin , Chen Liu , Chenlu Ye , Qing Lian , Yuan Yao , Tong Zhang

This paper addresses the estimation of uncertain distributed diffusion coefficients in elliptic systems based on noisy measurements of the model output. We formulate the parameter identification problem as an infinite dimensional…

Optimization and Control · Mathematics 2015-06-11 Jeff Borggaard , Hans-Werner van Wyk

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

We present a learning-based outlier-robust filter for a general setup where the measurement noise can be correlated. Since it is an enhanced version of EM-based outlier robust filter (EMORF), we call it as EMORF-II. As it is equipped with…

Machine Learning · Computer Science 2025-09-10 Arslan Majal , Aamir Hussain Chughtai , Muhammad Tahir

Covariance matrices play a major role in statistics, signal processing and machine learning applications. This paper focuses on the \textit{semiparametric} covariance/scatter matrix estimation problem in elliptical distributions. The class…

Signal Processing · Electrical Eng. & Systems 2020-10-28 Stefano Fortunati , Alexandre Renaux , Frédéric Pascal

Existing ordinal embedding methods usually follow a two-stage routine: outlier detection is first employed to pick out the inconsistent comparisons; then an embedding is learned from the clean data. However, learning in a multi-stage manner…

Machine Learning · Computer Science 2018-12-06 Ke Ma , Qianqian Xu , Xiaochun Cao

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

Machine Learning · Statistics 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon

Cosmic shear estimation is an essential scientific goal for large galaxy surveys. It refers to the coherent distortion of distant galaxy images due to weak gravitational lensing along the line of sight. It can be used as a tracer of the…

Machine Learning · Computer Science 2021-04-21 Claire Theobald , Bastien Arcelin , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro , Amedeo Napoli

We introduce a noise-aware extension to the parametric maximum-likelihood framework for component separation by modeling correlated $1/f^\alpha$ noise as a harmonic-space power law. This approach addresses a key limitation of existing…

Cosmology and Nongalactic Astrophysics · Physics 2025-11-07 Goureesankar Sathyanathan , Josquin Errard , Soumen Basak

Weak lensing experiments are a powerful probe of cosmology through their measurement of the mass distribution of the universe. A challenge for this technique is to control systematic errors that occur when measuring the shapes of distant…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-04 Alexandre Refregier , Tomasz Kacprzak , Adam Amara , Sarah Bridle , Barnaby Rowe

The efficient estimation of an approximate model order is very important for real applications with multi-dimensional data if the observed low-rank data is corrupted by additive noise. In this paper, we present a novel robust method for…

Methodology · Statistics 2022-12-21 Alexey A. Korobkov , Marina K. Diugurova , Jens Haueisen , Martin Haardt

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

We propose a new pivotal method for estimating high-dimensional matrices. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A\_0$ corrupted by noise. We propose a new method for estimating…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp , Stéphane Gaiffas

We consider in this paper the problem of estimating a parameter matrix from observations which are affected by two types of noise components: (i) a sparse noise sequence which, whenever nonzero can have arbitrarily large amplitude (ii) and…

Systems and Control · Computer Science 2017-11-07 Laurent Bako

Estimating the disturbance or clutter covariance is a centrally important problem in radar space time adaptive processing (STAP). The disturbance covariance matrix should be inferred from training sample observations in practice. Large…

Applications · Statistics 2016-02-22 Bosung Kang

Computational imaging has been revolutionized by compressed sensing algorithms, which offer guaranteed uniqueness, convergence, and stability properties. Model-based deep learning methods that combine imaging physics with learned…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Aniket Pramanik , M. Bridget Zimmerman , Mathews Jacob

This paper investigates the signal detection problem in colored noise with an unknown covariance matrix. In particular, we focus on detecting a non-random signal by capitalizing on the leading eigenvalue (a.k.a. Roy's largest root) of the…

Signal Processing · Electrical Eng. & Systems 2024-12-10 Prathapasinghe Dharmawansa , Saman Atapattu , Jamie Evans , Merouane Debbah

While both the data volume and heterogeneity of the digital music content is huge, it has become increasingly important and convenient to build a recommendation or search system to facilitate surfacing these content to the user or consumer…

Noise Contrastive Estimation (NCE) is a powerful parameter estimation method for log-linear models, which avoids calculation of the partition function or its derivatives at each training step, a computationally demanding step in many cases.…

Computation and Language · Computer Science 2018-09-07 Zhuang Ma , Michael Collins