English
Related papers

Related papers: Information-theoretic Feature Selection via Tensor…

200 papers

We establish non-asymptotic efficiency guarantees for tensor decomposition-based inference in count data models. Under a Poisson framework, we consider two related goals: (i) parametric inference, the estimation of the full distributional…

Statistics Theory · Mathematics 2025-11-10 Oscar López , Arvind Prasadan , Carlos Llosa-Vite , Richard B. Lehoucq , Daniel M. Dunlavy

Discovering components that are shared in multiple datasets, next to dataset-specific features, has great potential for studying the relationships between different subjects or tasks in functional Magnetic Resonance Imaging (fMRI) data.…

Efficient probability density estimation is a core challenge in statistical machine learning. Tensor-based probabilistic graph methods address interpretability and stability concerns encountered in neural network approaches. However, a…

Machine Learning · Computer Science 2023-12-14 Ruituo Wu , Jiani Liu , Ce Zhu , Anh-Huy Phan , Ivan V. Oseledets , Yipeng Liu

Coupled Matrix Tensor Factorization (CMTF) facilitates the integration and analysis of multiple data sources and helps discover meaningful information. Nonnegative CMTF (N-CMTF) has been employed in many applications for identifying latent…

Machine Learning · Computer Science 2020-03-10 Thirunavukarasu Balasubramaniam , Richi Nayak , Chau Yuen

We consider a semiparametric mixture of two univariate density functions where one of them is known while the weight and the other function are unknown. Such mixtures have a history of application to the problem of detecting differentially…

Statistics Theory · Mathematics 2017-08-01 Zhou Shen , Michael Levine , Zuofeng Shang

This paper presents a new Bayesian model and associated algorithm for depth and intensity profiling using full waveforms from time-correlated single-photon counting (TCSPC) measurements in the limit of very low photon counts (i.e.,…

Instrumentation and Detectors · Physics 2016-10-14 Yoann Altmann , Ximing Ren , Aongus McCarthy , Gerald S. Buller , Steve McLaughlin

The performance of penalized likelihood approaches depends profoundly on the selection of the tuning parameter; however, there is no commonly agreed-upon criterion for choosing the tuning parameter. Moreover, penalized likelihood estimation…

Methodology · Statistics 2018-05-09 Yang Liu , Peng Wang

In the paper we address the problem of finding the most probable state of discrete Markov random field (MRF) with associative pairwise terms. Although of practical importance, this problem is known to be NP-hard in general. We propose a new…

Computer Vision and Pattern Recognition · Computer Science 2015-03-19 Anton Osokin , Dmitry Vetrov , Vladimir Kolmogorov

Tensor train (TT) decomposition, a powerful tool for analyzing multidimensional data, exhibits superior performance in many machine learning tasks. However, existing methods for TT decomposition either suffer from noise overfitting, or…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Le Xu , Lei Cheng , Ngai Wong , Yik-Chung Wu

The recently proposed tensor robust principal component analysis (TRPCA) methods based on tensor singular value decomposition (t-SVD) have achieved numerous successes in many fields. However, most of these methods are only applicable to…

Machine Learning · Computer Science 2023-11-13 Jianan Liu , Chunguang Li

Multi-objective feature selection is one of the most significant issues in the field of pattern recognition. It is challenging because it maximizes the classification performance and, at the same time, minimizes the number of selected…

Artificial Intelligence · Computer Science 2022-11-11 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

Machine Learning · Computer Science 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

In this paper, we propose an algorithm that allows joint refinement of camera pose and scene geometry represented by decomposed low-rank tensor, using only 2D images as supervision. First, we conduct a pilot study based on a 1D signal and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Bo-Yu Cheng , Wei-Chen Chiu , Yu-Lun Liu

Data and knowledge representation are fundamental concepts in machine learning. The quality of the representation impacts the performance of the learning model directly. Feature learning transforms or enhances raw data to structures that…

Artificial Intelligence · Computer Science 2021-04-26 Filipe Alves Neto Verri , Renato Tinós , Liang Zhao

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

The main feature of large-scale multi-objective optimization problems (LSMOP) is to optimize multiple conflicting objectives while considering thousands of decision variables at the same time. An efficient LSMOP algorithm should have the…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Haokai Hong , Kai Ye , Min Jiang , Donglin Cao , Kay Chen Tan

In recent years, large language models (LLMs) have driven advances in natural language processing. Still, their growing scale has increased the computational burden, necessitating a balance between efficiency and performance. Low-rank…

Computation and Language · Computer Science 2025-02-25 Yixin Ji , Yang Xiang , Juntao Li , Qingrong Xia , Zi Ye , Xinyu Duan , Zhefeng Wang , Kehai Chen , Min Zhang

This paper introduces a general framework of Semi-parametric TEnsor Factor Analysis (STEFA) that focuses on the methodology and theory of low-rank tensor decomposition with auxiliary covariates. Semi-parametric TEnsor Factor Analysis models…

Methodology · Statistics 2024-04-03 Elynn Y. Chen , Dong Xia , Chencheng Cai , Jianqing Fan

This paper presents an unsupervised learning approach for simultaneous sample and feature selection, which is in contrast to existing works which mainly tackle these two problems separately. In fact the two tasks are often interleaved with…

Machine Learning · Computer Science 2018-09-11 Changsheng Li , Xiangfeng Wang , Weishan Dong , Junchi Yan , Qingshan Liu , Hongyuan Zha

Feature selection is a combinatorial optimization problem that is NP-hard. Conventional approaches often employ heuristic or greedy strategies, which are prone to premature convergence and may fail to capture subtle yet informative…

Machine Learning · Computer Science 2025-10-22 Yusi Fan , Tian Wang , Zhiying Yan , Chang Liu , Qiong Zhou , Qi Lu , Zhehao Guo , Ziqi Deng , Wenyu Zhu , Ruochi Zhang , Fengfeng Zhou