English
Related papers

Related papers: Adaptive Iterative Hessian Sketch via A-Optimal Su…

200 papers

Estimating frequencies of elements appearing in a data stream is a key task in large-scale data analysis. Popular sketching approaches to this problem (e.g., CountMin and CountSketch) come with worst-case guarantees that probabilistically…

Data Structures and Algorithms · Computer Science 2023-12-13 Anders Aamand , Justin Y. Chen , Huy Lê Nguyen , Sandeep Silwal , Ali Vakilian

We give a sketching-based iterative algorithm that computes a $1+\varepsilon$ approximate solution for the ridge regression problem $\min_x \|Ax-b\|_2^2 +\lambda\|x\|_2^2$ where $A \in R^{n \times d}$ with $d \ge n$. Our algorithm, for a…

Data Structures and Algorithms · Computer Science 2022-06-20 Praneeth Kacham , David P. Woodruff

We present iScale, a survey tool for the retrospective elicitation of longitudinal user experience data. iScale employs sketching in imposing a process in the reconstruction of one's experiences with the aim to minimize retrospection bias.…

Human-Computer Interaction · Computer Science 2010-02-22 Evangelos Karapanos , Jean-Bernard Martens , Marc Hassenzahl

Hyperspectral image (HSI) classification presents significant challenges due to the high dimensionality, spectral redundancy, and limited labeled data typically available in real-world applications. To address these issues and optimize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Vita V. Vlasova , Vladimir G. Kuzmin , Maria S. Varetsa , Natalia A. Ibragimova , Oleg Y. Rogov , Elena V. Lyapuntsova

Hierarchical matrices approximate a given matrix by a decomposition into low-rank submatrices that can be handled efficiently in factorized form. $\mathcal{H}^2$-matrices refine this representation following the ideas of fast multipole…

Numerical Analysis · Mathematics 2024-04-24 Steffen Börm

Facial sketch synthesis (FSS) aims to generate a vivid sketch portrait from a given facial photo. Existing FSS methods merely rely on 2D representations of facial semantic or appearance. However, professional human artists usually use…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Fei Gao , Yifan Zhu , Chang Jiang , Nannan Wang

Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed with natural images. Work in this area mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Li Liu , Fumin Shen , Yuming Shen , Xianglong Liu , Ling Shao

We propose a novel two-stage subsampling algorithm based on optimal design principles. In the first stage, we use a density-based clustering algorithm to identify an approximating design space for the predictors from an initial subsample.…

Methodology · Statistics 2024-03-20 Subhadra Dasgupta , Holger Dette

Over the course of the past decade, a variety of randomized algorithms have been proposed for computing approximate least-squares (LS) solutions in large-scale settings. A longstanding practical issue is that, for any given input, the user…

Machine Learning · Statistics 2018-09-07 Miles E. Lopes , Shusen Wang , Michael W. Mahoney

Over the past decade, stochastic algorithms have emerged as scalable and efficient tools for solving large-scale ill-posed inverse problems by randomly selecting subsets of equations at each iteration. However, due to the ill-posedness and…

Numerical Analysis · Mathematics 2025-09-09 Harshit Bajpai , Gaurav Mittal , Ankik Kumar Giri

In this paper, the efficient hinging hyperplanes (EHH) neural network is proposed based on the model of hinging hyperplanes (HH). The EHH neural network is a distributed representation, the training of which involves solving several convex…

Systems and Control · Computer Science 2019-11-28 Jun Xu , Qinghua Tao , Zhen Li , Xiangming Xi , Johan A. K. Suykens , Shuning Wang

In this work we develop a Hessian-based sampling method for the construction of goal-oriented reduced order models with high-dimensional parameter inputs. Model reduction is known very challenging for high-dimensional parametric problems…

Numerical Analysis · Mathematics 2018-09-28 Peng Chen , Omar Ghattas

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

We consider statistical and algorithmic aspects of solving large-scale least-squares (LS) problems using randomized sketching algorithms. Prior results show that, from an \emph{algorithmic perspective}, when using sketching matrices…

Machine Learning · Statistics 2015-05-26 Garvesh Raskutti , Michael Mahoney

In this paper, we propose a stochastic geometric iterative method to approximate the high-resolution 3D models by finite Loop subdivision surfaces. Given an input mesh as the fitting target, the initial control mesh is generated using the…

Graphics · Computer Science 2021-07-30 Chenkai Xu , Yaqi He , Hui Hu , Hongwei Lin

Tensor network methods provide a scalable solution to represent high-dimensional data. However, their efficacy is often limited by static, expert-defined structures that fail to adapt to evolving data correlations. We address this…

Computational Engineering, Finance, and Science · Computer Science 2026-03-31 Zheng Guo , Aditya Deshpande , Xinyu Wang , Brian C. Kiedrowski , Alex A. Gorodetsky

Unconstrained optimization problems become more common in scientific computing and engineering applications with the rapid development of artificial intelligence, and numerical methods for solving them more quickly and efficiently have been…

Optimization and Control · Mathematics 2025-04-17 Lin Li , Pengcheng Xie , Li Zhang

In sequential recommender system applications, it is important to develop models that can capture users' evolving interest over time to successfully recommend future items that they are likely to interact with. For users with long…

Information Retrieval · Computer Science 2021-12-15 Aritra Ghosh , Saayan Mitra , Andrew Lan

Current recommender systems employ large-sized embedding tables with uniform dimensions for all features, leading to overfitting, high computational cost, and suboptimal generalizing performance. Many techniques aim to solve this issue by…

Information Retrieval · Computer Science 2023-09-18 Yakun Yu , Shi-ang Qi , Jiuding Yang , Liyao Jiang , Di Niu

Constrained least squares problems arise in many applications. Their memory and computation costs are expensive in practice involving high-dimensional input data. We employ the so-called "sketching" strategy to project the least squares…

Optimization and Control · Mathematics 2021-09-07 Ke Chen , Ruhui Jin