English
Related papers

Related papers: High-Dimensional Tensor Discriminant Analysis with…

200 papers

The increasing use of multiple sensors, which produce a large amount of multi-dimensional data, requires efficient representation and classification methods. In this paper, we present a new method for multi-dimensional data classification…

Machine Learning · Computer Science 2020-12-01 Bernardo B. Gatto , Eulanda M. dos Santos , Alessandro L. Koerich , Kazuhiro Fukui , Waldir S. S. Junior

This work studies the theoretical rules of feature selection in linear discriminant analysis (LDA), and a new feature selection method is proposed for sparse linear discriminant analysis. An $l_1$ minimization method is used to select the…

Methodology · Statistics 2013-04-23 Cheng Wang , Longbing Cao , Baiqi Miao

Blockwise missing data occurs frequently when we integrate multisource or multimodality data where different sources or modalities contain complementary information. In this paper, we consider a high-dimensional linear regression model with…

Methodology · Statistics 2023-06-30 Fei Xue , Rong Ma , Hongzhe Li

For many machine learning tasks, the input data lie on a low-dimensional manifold embedded in a high dimensional space and, because of this high-dimensional structure, most algorithms are inefficient. The typical solution is to reduce the…

Machine Learning · Computer Science 2019-03-05 Anna C. Gilbert , Rishi Sonthalia

Linear Discriminant Analysis (LDA) is a widely-used supervised dimensionality reduction method in computer vision and pattern recognition. In null space based LDA (NLDA), a well-known LDA extension, between-class distance is maximized in…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Shuai Zheng , Feiping Nie , Chris Ding , Heng Huang

In this paper, based on the combination of tensor neural network and a posteriori error estimator, a novel type of machine learning method is proposed to solve high-dimensional boundary value problems with homogeneous and non-homogeneous…

Numerical Analysis · Mathematics 2024-05-07 Yifan Wang , Zhongshuo Lin , Yangfei Liao , Haochen Liu , Hehu Xie

In modern data science, dynamic tensor data is prevailing in numerous applications. An important task is to characterize the relationship between such dynamic tensor and external covariates. However, the tensor data is often only partially…

Machine Learning · Statistics 2021-05-17 Jie Zhou , Will Wei Sun , Jingfei Zhang , Lexin Li

Tensor completion is a problem of filling the missing or unobserved entries of partially observed tensors. Due to the multidimensional character of tensors in describing complex datasets, tensor completion algorithms and their applications…

Machine Learning · Statistics 2018-05-04 Qingquan Song , Hancheng Ge , James Caverlee , Xia Hu

High-dimensional datasets are frequently subject to contamination by outliers and heavy-tailed noise, which can severely bias standard regularized estimators like the Lasso. While Maximum Mean Discrepancy (MMD) has recently been introduced…

Methodology · Statistics 2026-02-25 Xiaoning Kang , Lulu Kang

Traditional methods for solving linear systems have quickly become impractical due to an increase in the size of available data. Utilizing massive amounts of data is further complicated when the data is incomplete or has missing entries. In…

Numerical Analysis · Mathematics 2019-01-09 Anna Ma , Deanna Needell

The Large Margin Distribution Machine (LMDM) is a recent advancement in classifier design that optimizes not just the minimum margin (as in SVM) but the entire margin distribution, thereby improving generalization. However, existing LMDM…

Machine Learning · Computer Science 2025-09-19 Yang Xu , Junpeng Li , Changchun Hua , Yana Yang

Handling missing data in time series classification remains a significant challenge in various domains. Traditional methods often rely on imputation, which may introduce bias or fail to capture the underlying temporal dynamics. In this…

Machine Learning · Computer Science 2026-04-03 YongKyung Oh , Dong-Young Lim , Sungil Kim , Alex Bui

The focus of this paper is to extend Fisher's linear discriminant analysis (LDA) to both densely re-corded functional data and sparsely observed longitudinal data for general $c$-category classification problems. We propose an efficient…

Methodology · Statistics 2017-09-07 Lu-Hung Chen , Ci-Ren Jiang

This paper proposes a new method for estimating high-dimensional binary choice models. We consider a semiparametric model that places no distributional assumptions on the error term, allows for heteroskedastic errors, and permits endogenous…

Econometrics · Economics 2025-07-15 Fu Ouyang , Thomas Tao Yang

We revisit Deep Linear Discriminant Analysis (Deep LDA) from a likelihood-based perspective. While classical LDA is a simple Gaussian model with linear decision boundaries, attaching an LDA head to a neural encoder raises the question of…

Machine Learning · Statistics 2026-02-23 Maxat Tezekbayev , Arman Bolatov , Zhenisbek Assylbekov

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of…

Methodology · Statistics 2021-10-29 Jiaxin Hu , Chanwoo Lee , Miaoyan Wang

This paper proposes a probabilistic neural network developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the compression of…

Machine Learning · Computer Science 2019-11-15 Hideaki Hayashi , Taro Shibanoki , Keisuke Shima , Yuichi Kurita , Toshio Tsuji

Linear Discriminant Analysis (LDA) is a fundamental method for classification. Its simple linear structure facilitates interpretation, and it is naturally suited to multi-class settings. LDA is also closely connected to several classical…

Methodology · Statistics 2026-04-09 Xin Bing , Bingqing Li , Marten Wegkamp

In this paper, we aim at the completion problem of high order tensor data with missing entries. The existing tensor factorization and completion methods suffer from the curse of dimensionality when the order of tensor N>>3. To overcome this…

Numerical Analysis · Computer Science 2017-09-15 Longhao Yuan , Qibin Zhao , Jianting Cao

This paper conducts a rigorous analysis for provable estimation of multidimensional arrays, in particular third-order tensors, from a random subset of its corrupted entries. Our study rests heavily on a recently proposed tensor algebraic…

Machine Learning · Computer Science 2017-08-03 Jonathan Q. Jiang , Michael K. Ng