中文
相关论文

相关论文: Statistical Challenges with High Dimensionality: F…

200 篇论文

Large amount of multidimensional data represented by multiway arrays or tensors are prevalent in modern applications across various fields such as chemometrics, genomics, physics, psychology, and signal processing. The structural complexity…

统计理论 · 数学 2024-05-29 Arnab Auddy , Dong Xia , Ming Yuan

Feature selection is one of the most challenging issues in machine learning, especially while working with high dimensional data. In this paper, we address the problem of feature selection and propose a new approach called Evolving Fast and…

神经与进化计算 · 计算机科学 2020-05-12 Uzay Cetin , Yunus Emre Gundogmus

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

机器学习 · 统计学 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari

We present a nonparametric method for selecting informative features in high-dimensional clustering problems. We start with a screening step that uses a test for multimodality. Then we apply kernel density estimation and mode clustering to…

统计理论 · 数学 2014-06-10 Larry Wasserman , Martin Azizyan , Aarti Singh

In predictive modeling, overfitting poses a significant risk, particularly when the feature count surpasses the number of observations, a common scenario in high-dimensional data sets. To mitigate this risk, feature selection is employed to…

综合经济学 · 经济学 2024-11-04 Mahdi Goldani , Soraya Asadi Tirvan

Advances in architectural design, data availability, and compute have driven remarkable progress in semantic segmentation. Yet, these models often rely on relaxed Bayesian assumptions, omitting critical uncertainty information needed for…

计算机视觉与模式识别 · 计算机科学 2026-02-19 M. M. A. Valiuddin , R. J. G. van Sloun , C. G. A. Viviers , P. H. N. de With , F. van der Sommen

This paper presents a versatile technique for the purpose of feature selection and extraction - Class Dependent Features (CDFs). We use CDFs to improve the accuracy of classification and at the same time control computational expense by…

机器学习 · 计算机科学 2014-12-30 Kratarth Goel , Raunaq Vohra , Ainesh Bakshi

Design is a factor that plays an important role in consumer purchase decisions. As the need for understanding and predicting various preferences for each customer increases along with the importance of mass customization, predicting…

人机交互 · 计算机科学 2024-05-14 Dongju Shin , Sunghee Lee , Namwoo Kang

We study the problem of linear feature selection when features are highly correlated. Such settings pose two fundamental challenges. First, how should model similarity be defined? Simply counting features in common can be misleading: two…

统计方法学 · 统计学 2026-03-24 Xiaozhu Zhang , Jacob Bien , Armeen Taeb

We consider the problem of variable selection in high-dimensional sparse additive models. We focus on the case that the components belong to nonparametric classes of functions. The proposed method is motivated by geometric considerations in…

统计理论 · 数学 2015-02-03 Martin Wahl

Due to the development of internet technology and computer science, data is exploding at an exponential rate. Big data brings us new opportunities and challenges. On the one hand, we can analyze and mine big data to discover hidden…

数据库 · 计算机科学 2020-05-12 Zhicheng Liu , Aoqian Zhang

Variable selection in high dimensional space has challenged many contemporary statistical problems from many frontiers of scientific disciplines. Recent technology advance has made it possible to collect a huge amount of covariate…

机器学习 · 统计学 2010-05-20 Jianqing Fan , Yang Feng , Yichao Wu

The objective of the paper is to study accuracy of multi-class classification in high-dimensional setting, where the number of classes is also large ("large $L$, large $p$, small $n$" model). While this problem arises in many practical…

统计理论 · 数学 2019-07-18 Felix Abramovich , Marianna Pensky

The continuous increase in the availability of data of any kind, coupled with the development of networks of high-speed communications, the popularization of cloud computing and the growth of data centers and the emergence of…

人工智能 · 计算机科学 2016-09-20 Jose A. García Gutiérrez

Different sectors have sought to take advantage of opportunities to invest in big data analytics and Natural language processing, in order to improve their productivity and competitiveness. Current challenges facing the higher education…

计算机与社会 · 计算机科学 2018-01-19 Amal S. Alblawi

Differential privacy (DP) has become the de facto standard of privacy preservation due to its strong protection and sound mathematical foundation, which is widely adopted in different applications such as big data analysis, graph data…

密码学与安全 · 计算机科学 2021-12-06 Honglu Jiang , Yifeng Gao , S M Sarwar , Luis GarzaPerez , Mahmudul Robin

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

统计方法学 · 统计学 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

We study two-sample variable selection: identifying variables that discriminate between the distributions of two sets of data vectors. Such variables help scientists understand the mechanisms behind dataset discrepancies. Although…

Feature selection is one of the most prominent learning tasks, especially in high-dimensional datasets in which the goal is to understand the mechanisms that underly the learning dataset. However most of them typically deliver just a flat…

机器学习 · 计算机科学 2012-09-06 Jun Wang , Alexandros Kalousis

The advent of large data-set in cosmology has meant that in the past 10 or 20 years our knowledge and understanding of the Universe has changed not only quantitatively but also, and most importantly, qualitatively. Cosmologists rely on data…

宇宙学与河外天体物理 · 物理学 2014-11-20 Licia Verde