English
Related papers

Related papers: Parsimonious Feature Extraction Methods: Extending…

200 papers

Insurance risks data typically exhibit skewed behaviour. In this paper, we propose a Bayesian approach to capture the main features of these datasets. This work extends the methodology introduced in Villa and Walker (2014a) by considering…

Methodology · Statistics 2016-07-19 Fabrizio Leisen , Juan Miguel Marin , Cristiano Villa

Feature selection is a technique that extracts a meaningful subset from a set of features in training data. When the training data is large-scale, appropriate feature selection enables the removal of redundant features, which can improve…

Cryptography and Security · Computer Science 2025-05-20 Koki Wakiyama , Tomohiro I , Hiroshi Sakamoto

In this paper, a novel learning paradigm is presented to automatically identify groups of informative and correlated features from very high dimensions. Specifically, we explicitly incorporate correlation measures as constraints and then…

Machine Learning · Computer Science 2012-07-03 Yiteng Zhai , Mingkui Tan , Ivor Tsang , Yew Soon Ong

We develop a stochastic algorithm for independent component analysis that incorporates multi-trial supervision, which is available in many scientific contexts. The method blends a proximal gradient-type algorithm in the space of invertible…

Machine Learning · Computer Science 2025-08-29 Ronak Mehta , Mateus Piovezan Otto , Noah Stanis , Azadeh Yazdan-Shahmorad , Zaid Harchaoui

In recent work, robust mixture modelling approaches using skewed distributions have been explored to accommodate asymmetric data. We introduce parsimony by developing skew-t and skew-normal analogues of the popular GPCM family that employ…

Methodology · Statistics 2013-11-12 Irene Vrbik , Paul D. McNicholas

We propose a simple data model inspired from natural data such as text or images, and use it to study the importance of learning features in order to achieve good generalization. Our data model follows a long-tailed distribution in the…

Machine Learning · Computer Science 2023-01-02 Thomas Laurent , James H. von Brecht , Xavier Bresson

Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how these methods can be…

Machine Learning · Computer Science 2020-07-14 Simon Alexanderson , Gustav Eje Henter

This paper investigates a missing feature imputation problem for graph learning tasks. Several methods have previously addressed learning tasks on graphs with missing features. However, in cases of high rates of missing features, they were…

Machine Learning · Computer Science 2023-05-30 Daeho Um , Jiwoong Park , Seulki Park , Jin Young Choi

We introduce instancewise feature selection as a methodology for model interpretation. Our method is based on learning a function to extract a subset of features that are most informative for each given example. This feature selector is…

Machine Learning · Computer Science 2018-06-15 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan

Feature-based format is the main data representation format used by machine learning algorithms. When the features do not properly describe the initial data, performance starts to degrade. Some algorithms address this problem by internally…

Artificial Intelligence · Computer Science 2015-12-18 Marian-Andrei Rizoiu , Julien Velcin , Stéphane Lallich

The purpose of this study is to introduce a new approach to feature ranking for classification tasks, called in what follows greedy feature selection. In statistical learning, feature selection is usually realized by means of methods that…

Machine Learning · Statistics 2024-03-11 Fabiana Camattari , Sabrina Guastavino , Francesco Marchetti , Michele Piana , Emma Perracchione

Sparse high dimensional graphical model selection is a topic of much interest in modern day statistics. A popular approach is to apply l1-penalties to either (1) parametric likelihoods, or, (2) regularized regression/pseudo-likelihoods,…

Methodology · Statistics 2022-02-04 Kshitij Khare , Sang-Yun Oh , Bala Rajaratnam

In this work, we introduce panoramic panoptic segmentation as the most holistic scene understanding both in terms of field of view and image level understanding for standard camera based input. A complete surrounding understanding provides…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Alexander Jaus , Kailun Yang , Rainer Stiefelhagen

Standard inference about a scalar parameter estimated via GMM amounts to applying a t-test to a particular set of observations. If the number of observations is not very large, then moderately heavy tails can lead to poor behavior of the…

Econometrics · Economics 2020-07-15 Ulrich K. Mueller

We consider trawl processes, which are stationary and infinitely divisible stochastic processes and can describe a wide range of statistical properties, such as heavy tails and long memory. In this paper, we develop the first…

Methodology · Statistics 2023-08-31 Dan Leonte , Almut E. D. Veraart

The problem of non-iterative one-shot and non-destructive correction of unavoidable mistakes arises in all Artificial Intelligence applications in the real world. Its solution requires robust separation of samples with errors from samples…

Machine Learning · Computer Science 2017-09-05 A. N. Gorban , I. Y. Tyukin

Feature extraction is an efficient approach for alleviating the issue of dimensionality in high-dimensional data. As a popular self-supervised learning method, contrastive learning has recently garnered considerable attention. In this…

Machine Learning · Computer Science 2021-09-14 Hongjie Zhang

Feature selection is the process of sieving features, in which informative features are separated from the redundant and irrelevant ones. This process plays an important role in machine learning, data mining and bioinformatics. However,…

Cryptography and Security · Computer Science 2020-08-19 Javad Rahimipour Anaraki , Saeed Samet

This article develops a framework for testing general hypothesis in high-dimensional models where the number of variables may far exceed the number of observations. Existing literature has considered less than a handful of hypotheses, such…

Methodology · Statistics 2017-08-16 Yinchu Zhu , Jelena Bradic

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd