English
Related papers

Related papers: A ROAD to Classification in High Dimensional Space

200 papers

We propose a modification of linear discriminant analysis, referred to as compressive regularized discriminant analysis (CRDA), for analysis of high-dimensional datasets. CRDA is specially designed for feature elimination purpose and can be…

Methodology · Statistics 2018-04-12 Muhammad Naveed Tabassum , Esa Ollila

Radars and cameras are mature, cost-effective, and robust sensors and have been widely used in the perception stack of mass-produced autonomous driving systems. Due to their complementary properties, outputs from radar detection (radar…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Xu Dong , Binnan Zhuang , Yunxiang Mao , Langechuan Liu

We propose a compressive classification framework for settings where the data dimensionality is significantly higher than the sample size. The proposed method, referred to as compressive regularized discriminant analysis (CRDA) is based on…

Machine Learning · Statistics 2020-11-13 Muhammad Naveed Tabassum , Esa Ollila

Linear discriminant analysis improves class separability but struggles with non-linearly separable data. To overcome this, we introduce Deep Discriminant Analysis (DDA), which directly optimizes the Fisher criterion utilizing deep networks.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

Modern algorithms for binary classification rely on an intermediate regression problem for computational tractability. In this paper, we establish a geometric distinction between classification and regression that allows risk in these two…

Machine Learning · Statistics 2022-05-19 Suhas Vijaykumar , Claire Lazar Reich

High-dimensional sparse modeling with censored survival data is of great practical importance, as exemplified by modern applications in high-throughput genomic data analysis and credit risk analysis. In this article, we propose a class of…

Methodology · Statistics 2014-03-19 Wei Lin , Jinchi Lv

Regression via classification (RvC) is a common method used for regression problems in deep learning, where the target variable belongs to a set of continuous values. By discretizing the target into a set of non-overlapping classes, it has…

Machine Learning · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

Stochastic Closed-Loop Active Fault Diagnosis (CLAFD) aims to select the input sequentially in order to improve the discrimination of different models by minimizing the predicted error probability. As computation of these error…

Systems and Control · Electrical Eng. & Systems 2024-01-12 Jacques Noom , Oleg Soloviev , Carlas Smith , Michel Verhaegen

We study derivative-free methods for policy optimization over the class of linear policies. We focus on characterizing the convergence rate of these methods when applied to linear-quadratic systems, and study various settings of driving…

Machine Learning · Computer Science 2020-05-19 Dhruv Malik , Ashwin Pananjady , Kush Bhatia , Koulik Khamaru , Peter L. Bartlett , Martin J. Wainwright

In industrial imaging, accurately detecting and distinguishing surface defects from noise is critical and challenging, particularly in complex environments with noisy data. This paper presents a hybrid framework that integrates both…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Alejandro Garnung Menéndez

Towards a safe and comfortable driving, road scene segmentation is a rudimentary problem in camera-based advance driver assistance systems (ADAS). Despite of the great achievement of Convolutional Neural Networks (CNN) for semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Farnoush Zohourian , Jan Siegemund , Mirko Meuter , Josef Pauli

Many computer vision problems are formulated as the optimization of a cost function. This approach faces two main challenges: (i) designing a cost function with a local optimum at an acceptable solution, and (ii) developing an efficient…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Jayakorn Vongkulbhisal , Fernando De la Torre , João P. Costeira

Nowadays, deep learning methods, especially the convolutional neural networks (CNNs), have shown impressive performance on extracting abstract and high-level features from the hyperspectral image. However, general training process of CNNs…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Zhiqiang Gong , Ping Zhong , Weidong Hu

Covariance and Hessian matrices have been analyzed separately in the literature for classification problems. However, integrating these matrices has the potential to enhance their combined power in improving classification performance. We…

Machine Learning · Computer Science 2024-10-10 Agus Hartoyo , Jan Argasiński , Aleksandra Trenk , Kinga Przybylska , Anna Błasiak , Alessandro Crimi

Linear discriminant analysis (LDA) is a widely used technique for data classification. The method offers adequate performance in many classification problems, but it becomes inefficient when the data covariance matrix is ill-conditioned.…

Machine Learning · Statistics 2024-02-08 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid M. Al-Saggaf

We introduce a new rule-based optimization method for classification with constraints. The proposed method leverages column generation for linear programming, and hence, is scalable to large datasets. The resulting pricing subproblem is…

Machine Learning · Computer Science 2025-02-07 Tabea E. Röber , Adia C. Lumadjeng , M. Hakan Akyüz , Ş. İlker Birbil

We investigate high-dimensional nonconvex penalized regression, where the number of covariates may grow at an exponential rate. Although recent asymptotic theory established that there exists a local minimum possessing the oracle property…

Statistics Theory · Mathematics 2013-11-21 Lan Wang , Yongdai Kim , Runze Li

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu

High dimensional covariance estimation and graphical models is a contemporary topic in statistics and machine learning having widespread applications. An important line of research in this regard is to shrink the extreme spectrum of the…

Methodology · Statistics 2016-06-28 Sang-Yun Oh , Bala Rajaratnam , Joong-Ho Won

In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this…

Statistics Theory · Mathematics 2025-08-05 Xin Bing , Marten Wegkamp