English
Related papers

Related papers: Human-in-the-loop Active Covariance Learning for I…

200 papers

The non-parametric estimation of covariance lies at the heart of functional data analysis, whether for curve or surface-valued data. The case of a two-dimensional domain poses both statistical and computational challenges, which are…

Statistics Theory · Mathematics 2022-01-19 Tomas Masak , Soham Sarkar , Victor M. Panaretos

Low-rank approximation is a popular strategy to tackle the "big n problem" associated with large-scale Gaussian process regressions. Basis functions for developing low-rank structures are crucial and should be carefully specified.…

Methodology · Statistics 2024-09-04 Yan Song , Wenlin Dai , Marc G. Genton

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

The impact of machine learning models on healthcare will depend on the degree of trust that healthcare professionals place in the predictions made by these models. In this paper, we present a method to provide people with clinical expertise…

Machine Learning · Computer Science 2021-03-05 Aniruddh Raghu , John Guttag , Katherine Young , Eugene Pomerantsev , Adrian V. Dalca , Collin M. Stultz

Feature selection is a critical step in the analysis of high-dimensional data, where the number of features often vastly exceeds the number of samples. Effective feature selection not only improves model performance and interpretability but…

Machine Learning · Computer Science 2025-01-27 Raquel Espinosa , Gracia Sánchez , José Palma , Fernando Jiménez

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

We consider a sparse high-dimensional varying coefficients model with random effects, a flexible linear model allowing covariates and coefficients to have a functional dependence with time. For each individual, we observe discretely sampled…

Statistics Theory · Mathematics 2021-10-14 Michael Law , Ya'acov Ritov

High-dimensional data is common in multiple areas, such as health care and genomics, where the number of features can be tens of thousands. In such scenarios, the large number of features often leads to inefficient learning. Constraint…

Machine Learning · Statistics 2023-06-13 Kartheek Bondugula , Santiago Mazuelas , Aritz Pérez

Learning the relationships between various entities from time-series data is essential in many applications. Gaussian graphical models have been studied to infer these relationships. However, existing algorithms process data in a batch at a…

Machine Learning · Computer Science 2021-10-04 Tong Yao , Shreyas Sundaram

Mining frequent episodes aims at recovering sequential patterns from temporal data sequences, which can then be used to predict the occurrence of related events in advance. On the other hand, gradual patterns that capture co-variation of…

Machine Learning · Computer Science 2020-10-21 Jerry Lonlac , Arnaud Doniec , Marin Lujak , Stephane Lecoeuche

Knowledge present in a domain is well expressed as relationships between corresponding concepts. For example, in zoology, animal species form complex hierarchies; in genomics, the different (parts of) molecules are organized in groups and…

Machine Learning · Computer Science 2021-07-08 Lu Yin , Vlado Menkovski , Mykola Pechenizkiy

Estimating causal effects from observational data is not always possible due to confounding. Identifying a set of appropriate covariates (adjustment set) and adjusting for their influence can remove confounding bias; however, such a set is…

Methodology · Statistics 2020-11-19 Sofia Triantafillou , Gregory Cooper

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

Methodology · Statistics 2010-06-08 X. Jessie Jeng And Z. John Daye

We often desire our models to be interpretable as well as accurate. Prior work on optimizing models for interpretability has relied on easy-to-quantify proxies for interpretability, such as sparsity or the number of operations required. In…

Machine Learning · Statistics 2018-11-01 Isaac Lage , Andrew Slavin Ross , Been Kim , Samuel J. Gershman , Finale Doshi-Velez

The ability to make decisions based on data, with its inherent uncertainties and variability, is a complex and vital skill in the modern world. The need for such quantitative critical thinking occurs in many different contexts, and while it…

Physics Education · Physics 2015-08-21 N. G. Holmes , Carl E. Wieman , D. A. Bonn

This paper presents an automated approach for interpretable feature recommendation for solving signal data analytics problems. The method has been tested by performing experiments on datasets in the domain of prognostics where…

Machine Learning · Statistics 2017-11-07 Snehasis Banerjee , Tanushyam Chattopadhyay , Ayan Mukherjee

This paper considers the problem of estimating a change point in the covariance matrix in a sequence of high-dimensional vectors, where the dimension is substantially larger than the sample size. A two-stage approach is proposed to…

Methodology · Statistics 2018-07-31 H. Dette , G. M. Pan , Q. Yang

Machine learning techniques not only offer efficient tools for modelling dynamical systems from data, but can also be employed as frontline investigative instruments for the underlying physics. Nontrivial information about the original…

Data Analysis, Statistics and Probability · Physics 2021-02-24 Francesco Borra , Marco Baldovin

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

Recent work has demonstrated surprisingly good performance of pre-trained LLMs on regression tasks (for example, time-series prediction), with the ability to incorporate expert prior knowledge and the information contained in textual…

Machine Learning · Computer Science 2026-05-14 Felix Biggs , Samuel Willis