English
Related papers

Related papers: Faster feature selection with a Dropping Forward-B…

200 papers

Forward-backward methods are a very useful tool for the minimization of a functional given by the sum of a differentiable term and a nondifferentiable one and their investigation has experienced several efforts from many researchers in the…

Numerical Analysis · Mathematics 2015-06-10 Silvia Bonettini , Federica Porta , Valeria Ruggiero

This paper proposes inverse feature learning as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah , MohammadTaghi Hajiaghayi

Pedestrian detection is a problem of considerable practical interest. Adding to the list of successful applications of deep learning methods to vision, we report state-of-the-art and competitive results on all major pedestrian datasets with…

Computer Vision and Pattern Recognition · Computer Science 2013-04-03 Pierre Sermanet , Koray Kavukcuoglu , Soumith Chintala , Yann LeCun

Deep Learning is considered to be a quite young in the area of machine learning research, found its effectiveness in dealing complex yet high dimensional dataset that includes but limited to images, text and speech etc. with multiple levels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Mrutyunjaya Panda

Feature selection is generally used as one of the most important preprocessing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, by…

Machine Learning · Computer Science 2021-04-26 Yiwen Liao , Raphaël Latty , Bin Yang

Although dense local spatial-temporal features with bag-of-features representation achieve state-of-the-art performance for action recognition, the huge feature number and feature size prevent current methods from scaling up to real size…

Computer Vision and Pattern Recognition · Computer Science 2015-01-29 Youjie Zhou , Hongkai Yu , Song Wang

Automated Feature Engineering (AFE) refers to automatically generate and select optimal feature sets for downstream tasks, which has achieved great success in real-world applications. Current AFE methods mainly focus on improving the…

Machine Learning · Computer Science 2022-12-27 Kafeng Wang , Pengyang Wang , Chengzhong xu

Big-data applications often involve a vast number of observations and features, creating new challenges for variable selection and parameter estimation. This paper presents a novel technique called ``slow kill,'' which utilizes nonconvex…

Machine Learning · Statistics 2023-05-04 Yiyuan She , Jianhui Shen , Adrian Barbu

Feature selection is the problem of selecting a subset of features for a machine learning model that maximizes model quality subject to a budget constraint. For neural networks, prior methods, including those based on $\ell_1$…

Machine Learning · Computer Science 2024-06-19 Taisuke Yasuda , MohammadHossein Bateni , Lin Chen , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

The ever-growing size of training datasets enhances the generalization capability of modern machine learning models but also incurs exorbitant computational costs. Existing data pruning approaches aim to accelerate training by removing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dongyue Wu , Zilin Guo , Jialong Zuo , Nong Sang , Changxin Gao

Feature Learning aims to extract relevant information contained in data sets in an automated fashion. It is driving force behind the current deep learning trend, a set of methods that have had widespread empirical success. What is lacking…

Machine Learning · Statistics 2015-04-02 Brendan van Rooyen , Robert C. Williamson

Landscape-aware algorithm selection approaches have so far mostly been relying on landscape feature extraction as a preprocessing step, independent of the execution of optimization algorithms in the portfolio. This introduces a significant…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Anja Jankovic , Diederick Vermetten , Ana Kostovska , Jacob de Nobel , Tome Eftimov , Carola Doerr

Forward stagewise regression follows a very simple strategy for constructing a sequence of sparse regression estimates: it starts with all coefficients equal to zero, and iteratively updates the coefficient (by a small amount $\epsilon$) of…

Machine Learning · Statistics 2015-06-16 Ryan J. Tibshirani

Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Ryuichiro Hataya , Jan Zdenek , Kazuki Yoshizoe , Hideki Nakayama

Feature reduction is an important concept which is used for reducing dimensions to decrease the computation complexity and time of classification. Since now many approaches have been proposed for solving this problem, but almost all of them…

Artificial Intelligence · Computer Science 2012-06-08 Shervan Fekri Ershad , Sattar Hashemi

In order to speed-up classification models when facing a large number of categories, one usual approach consists in organizing the categories in a particular structure, this structure being then used as a way to speed-up the prediction…

Machine Learning · Computer Science 2015-11-26 Aurélia Léon , Ludovic Denoyer

Pattern recognition applications often suffer from skewed data distributions between classes, which may vary during operations w.r.t. the design data. Two-class classification systems designed using skewed data tend to recognize the…

Machine Learning · Computer Science 2019-12-02 Roghayeh Soleymani , Eric Granger , Giorgio Fumera

As the ubiquity of deep learning in various machine learning applications has amplified, a proliferation of neural network models has been trained and shared on public model repositories. In the context of a targeted machine learning…

Machine Learning · Computer Science 2024-04-02 Jianwei Cui , Wenhang Shi , Honglin Tao , Wei Lu , Xiaoyong Du

Feature selection is important in data representation and intelligent diagnosis. Elastic net is one of the most widely used feature selectors. However, the features selected are dependant on the training data, and their weights dedicated…

Machine Learning · Computer Science 2021-01-01 Shaode Yu , Haobo Chen , Hang Yu , Zhicheng Zhang , Xiaokun Liang , Wenjian Qin , Yaoqin Xie , Ping Shi

Continual learning aims to enable models to adapt to new datasets without losing performance on previously learned data, often assuming that prior data is no longer available. However, in many practical scenarios, both old and new data are…

Machine Learning · Computer Science 2025-03-03 Eli Verwimp , Guy Hacohen , Tinne Tuytelaars