English
Related papers

Related papers: A Spatial-Sign based Direct Approach for High Dime…

200 papers

We propose an algorithm to reconstruct explicit polygonal meshes from discretely sampled Signed Distance Function (SDF) data, which is especially effective at recovering sharp features. Building on the traditional Dual Contouring of Hermite…

Graphics · Computer Science 2026-04-02 Xiana Carrera , Ningna Wang , Christopher Batty , Oded Stein , Silvia Sellán

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional…

Machine Learning · Statistics 2017-05-10 Yuting Ma , Tian Zheng

In this paper, we consider convex quadratic optimization problems with indicator variables when the matrix $Q$ defining the quadratic term in the objective is sparse. We use a graphical representation of the support of $Q$, and show that if…

Optimization and Control · Mathematics 2021-10-26 Peijing Liu , Salar Fattahi , Andrés Gómez , Simge Küçükyavuz

Motivated by the widely used geometric median-of-means estimator in machine learning, this paper studies statistical inference for ultrahigh dimensionality location parameter based on the sample spatial median under a general multivariate…

Methodology · Statistics 2023-01-10 Guanghui Cheng , Liuhua Peng , Changliang Zou

In this paper, the sparse sensor placement problem for least-squares estimation is considered, and the previous novel approach of the sparse sensor selection algorithm is extended. The maximization of the determinant of the matrix which…

Signal Processing · Electrical Eng. & Systems 2021-05-18 Yuji Saito , Taku Nonomura , Keigo Yamada , Kumi Nakai , Takayuki Nagata , Keisuke Asai , Yasuo Sasaki , Daisuke Tsubakino

We consider solving nonlinear optimization problems with a stochastic objective and deterministic equality constraints, assuming that only zero-order information is available for both the objective and constraints, and that the objective is…

Optimization and Control · Mathematics 2025-10-28 Sen Na

High-dimensional tensor-valued predictors arise in modern applications, increasingly as learned representations from neural networks. Existing tensor classification methods rely on sparsity or Tucker structures and often lack theoretical…

Machine Learning · Computer Science 2025-12-16 Elynn Chen , Yuefeng Han , Jiayu Li

Recent domain adaptation methods have demonstrated impressive improvement on unsupervised domain adaptation problems. However, in the semi-supervised domain adaptation (SSDA) setting where the target domain has a few labeled instances…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bingyu Liu , Yuhong Guo , Jieping Ye , Weihong Deng

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

Symbolic data analysis (SDA) aggregates large individual-level datasets into a small number of distributional summaries, such as random rectangles or random histograms. The inference is carried out using these summaries in place of the…

Methodology · Statistics 2026-04-02 Yu Yang , Matias Quiroz , Boris Beranger , Robert Kohn , Scott A. Sisson

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

Machine Learning · Computer Science 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

Deep-feature-based perceptual similarity models have demonstrated strong alignment with human visual perception in Image Quality Assessment (IQA). However, most existing approaches operate at a single spatial scale, implicitly assuming that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Danling Kang , Xue-Hua Chen , Bin Liu , Keke Zhang , Weiling Chen , Tiesong Zhao

We present a novel method for solving Canonical Correlation Analysis (CCA) in a sparse convex framework using a least squares approach. The presented method focuses on the scenario when one is interested in (or limited to) a primal…

Machine Learning · Statistics 2009-08-20 David R. Hardoon , John Shawe-Taylor

In high-dimensional settings, Canonical Correlation Analysis (CCA) often fails, and existing sparse methods force an untenable choice between computational speed and statistical rigor. This work introduces a fast and provably consistent…

Methodology · Statistics 2025-07-16 Zixuan Wu , Elena Tuzhilina , Claire Donnat

In this work, we propose a stochastic gradient descent (SGD) framework to design data-driven policy gradient descent algorithms for the linear quadratic regulator problem. Two alternative schemes are considered to estimate the policy…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Bowen Song , Simon Weissmann , Mathias Staudigl , Andrea Iannelli

Partition functions arise in a variety of settings, including conditional random fields, logistic regression, and latent gaussian models. In this paper, we consider semistochastic quadratic bound (SQB) methods for maximum likelihood…

Machine Learning · Statistics 2014-02-19 Aleksandr Y. Aravkin , Anna Choromanska , Tony Jebara , Dimitri Kanevsky

The purpose of sufficient dimension reduction (SDR) is to find the low-dimensional subspace of input features that is sufficient for predicting output values. In this paper, we propose a novel distribution-free SDR method called sufficient…

Machine Learning · Statistics 2011-03-28 Makoto Yamada , Gang Niu , Jun Takagi , Masashi Sugiyama

Applications such as face recognition that deal with high-dimensional data need a mapping technique that introduces representation of low-dimensional features with enhanced discriminatory power and a proper classifier, able to classify…

Computer Vision and Pattern Recognition · Computer Science 2008-12-16 Seyyed Majid Valiollahzadeh , Abolghasem Sayadiyan , Mohammad Nazari

High-dimensional changepoint inference, adaptable to diverse alternative scenarios, has attracted significant attention in recent years. In this paper, we propose an adaptive and robust approach to changepoint testing. Specifically, by…

Methodology · Statistics 2025-04-29 Jixuan Liu , Long Feng , Liuhua Peng , Zhaojun Wang