中文
相关论文

相关论文: Feature selection in high-dimensional dataset usin…

200 篇论文

Biological data including gene expression data are generally high-dimensional and require efficient, generalizable, and scalable machine-learning methods to discover their complex nonlinear patterns. The recent advances in machine learning…

机器学习 · 计算机科学 2020-12-21 Dinesh Singh , Héctor Climente-González , Mathis Petrovich , Eiryo Kawakami , Makoto Yamada

We apply recent advances in machine learning and computer vision to a central problem in materials informatics: The statistical representation of microstructural images. We use activations in a pre-trained convolutional neural network to…

计算物理 · 物理学 2018-12-04 Nicholas Lubbers , Turab Lookman , Kipton Barros

Currently, low-resolution image recognition is confronted with a significant challenge in the field of intelligent traffic perception. Compared to high-resolution images, low-resolution images suffer from small size, low quality, and lack…

计算机视觉与模式识别 · 计算机科学 2023-09-29 Zongcai Tan , Zhenhai Gao

In this work, we study and analyze different feature selection algorithms that can be used to classify cancer subtypes in case of highly varying high-dimensional data. We apply three different feature selection methods on five different…

机器学习 · 计算机科学 2021-10-01 Vaibhav Sinha , Siladitya Dash , Nazma Naskar , Sk Md Mosaddek Hossain

Randomized algorithms provide solutions to two ubiquitous problems: (1) the distributed calculation of a principal component analysis or singular value decomposition of a highly rectangular matrix, and (2) the distributed calculation of a…

分布式、并行与集群计算 · 计算机科学 2024-04-09 Huamin Li , Yuval Kluger , Mark Tygert

The problem of relevant and diverse subset selection has a wide range of applications, including recommender systems and retrieval-augmented generation (RAG). For example, in recommender systems, one is interested in selecting relevant…

机器学习 · 计算机科学 2026-03-10 Vu Nguyen , Andrey Kan

Many large-scale machine learning problems--clustering, non-parametric learning, kernel machines, etc.--require selecting a small yet representative subset from a large dataset. Such problems can often be reduced to maximizing a submodular…

机器学习 · 计算机科学 2016-06-28 Baharan Mirzasoleiman , Amin Karbasi , Rik Sarkar , Andreas Krause

Mining frequent itemsets from massive datasets is always being a most important problem of data mining. Apriori is the most popular and simplest algorithm for frequent itemset mining. To enhance the efficiency and scalability of Apriori, a…

分布式、并行与集群计算 · 计算机科学 2015-11-24 Sudhakar Singh , Rakhi Garg , P. K. Mishra

Nowadays many companies have available large amounts of raw, unstructured data. Among Big Data enabling technologies, a central place is held by the MapReduce framework and, in particular, by its open source implementation, Apache Hadoop.…

分布式、并行与集群计算 · 计算机科学 2017-01-18 Eugenio Gianniti , Danilo Ardagna , Michele Ciavotta , Mauro Passacantando

Multiple imputation (MI) has been widely applied to missing value problems in biomedical, social and econometric research, in order to avoid improper inference in the downstream data analysis. In the presence of high-dimensional data,…

统计方法学 · 统计学 2023-05-04 Zhiqi Bu , Zongyu Dai , Yiliang Zhang , Qi Long

Minimum redundancy among different elements of an embedding in a latent space is a fundamental requirement or major preference in representation learning to capture intrinsic informational structures. Current self-supervised learning…

机器学习 · 计算机科学 2022-07-19 Chuang Niu , Ge Wang

Feature selection is the process of sieving features, in which informative features are separated from the redundant and irrelevant ones. This process plays an important role in machine learning, data mining and bioinformatics. However,…

密码学与安全 · 计算机科学 2020-08-19 Javad Rahimipour Anaraki , Saeed Samet

As the recommendation service needs to address increasingly diverse distributions, such as multi-population, multi-scenario, multitarget, and multi-interest, more and more recent works have focused on multi-distribution modeling and…

机器学习 · 计算机科学 2024-08-05 Xingyu Lou , Yu Yang , Kuiyao Dong , Heyuan Huang , Wenyi Yu , Ping Wang , Xiu Li , Jun Wang

Modern datasets span billions of samples, making training on all available data infeasible. Selecting a high quality subset helps in reducing training costs and enhancing model quality. Submodularity, a discrete analogue of convexity, is…

机器学习 · 计算机科学 2025-04-04 Maximilian Böther , Abraham Sebastian , Pranjal Awasthi , Ana Klimovic , Srikumar Ramalingam

In these notes we discuss tools and concepts that emerge when studying high-dimensional random landscapes, i.e., random functions on high-dimensional spaces. As an illustrative example, we consider an inference problem in two forms:…

无序系统与神经网络 · 物理学 2025-08-12 Valentina Ros

The streaming max-min diversification problem concerns the selection of a limited and diverse sample of items out of a data stream of known finite length. The objective to be maximized is the minimum distance among any pair of selected…

数据结构与算法 · 计算机科学 2025-06-24 Argyris Kalogeratos , Yutai Nazir Zhao , Mathilde Fekom

In this paper we introduce Feature Gradients, a gradient-based search algorithm for feature selection. Our approach extends a recent result on the estimation of learnability in the sublinear data regime by showing that the calculation can…

机器学习 · 统计学 2019-08-29 Rishit Sheth , Nicolo Fusi

Feature selection for predictive analytics is the problem of identifying a minimal-size subset of features that is maximally predictive of an outcome of interest. To apply to molecular data, feature selection algorithms need to be scalable…

With the development of feature extraction technique, one sample always can be represented by multiple features which locate in high-dimensional space. Multiple features can re ect various perspectives of one same sample, so there must be…

计算机视觉与模式识别 · 计算机科学 2018-07-30 Huibing Wang , Lin Feng , Adong Kong , Bo Jin

A wide variety of problems in machine learning, including exemplar clustering, document summarization, and sensor placement, can be cast as constrained submodular maximization problems. A lot of recent effort has been devoted to developing…

数据结构与算法 · 计算机科学 2016-08-15 Rafael da Ponte Barbosa , Alina Ene , Huy L. Nguyen , Justin Ward