English
Related papers

Related papers: Mixed precision sketching for least-squares proble…

200 papers

In this paper, we are concerned with efficiently solving the sequences of regularized linear least squares problems associated with employing Tikhonov-type regularization with regularization operators designed to enforce edge recovery. An…

Numerical Analysis · Mathematics 2023-06-29 Matthias Bolten , Scott P. MacLachlan , Misha E. Kilmer

We propose SketchINR, to advance the representation of vector sketches with implicit neural models. A variable length vector sketch is compressed into a latent space of fixed dimension that implicitly encodes the underlying shape as a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hmrishav Bandyopadhyay , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Tao Xiang , Timothy Hospedales , Yi-Zhe Song

This paper presents a couple of preconditioning techniques that can be used to enhance the performance of iterative regularization methods applied to image deblurring problems with a variety of point spread functions (PSFs) and boundary…

Numerical Analysis · Mathematics 2022-12-13 Marco Donatelli , Paola Ferrari , Silvia Gazzola

Efficient task scheduling is paramount in parallel programming on multi-core architectures, where tasks are fundamental computational units. QR factorization is a critical sub-routine in Sequential Least Squares Quadratic Programming…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-12 Soumyajit Chatterjee , Rahul Utkoor , Uppu Eshwar , Sathya Peri , V. Krishna Nandivada

In second-order optimization, a potential bottleneck can be computing the Hessian matrix of the optimized function at every iteration. Randomized sketching has emerged as a powerful technique for constructing estimates of the Hessian which…

Optimization and Control · Mathematics 2021-07-16 Michał Dereziński , Jonathan Lacotte , Mert Pilanci , Michael W. Mahoney

Two important optimization problems in the analysis of geometric data sets are clustering and sketching. Here, clustering refers to the problem of partitioning some input metric measure space (mm-space) into k clusters, minimizing some…

Computational Geometry · Computer Science 2018-10-19 Facundo Mémoli , Anastasios Sidiropoulos , Kritika Singhal

Multi-view mesh reconstruction remains a core challenge in computer graphics and vision, especially for recovering high-frequency geometry from sparse observations. Recent methods such as 3D Gaussian Splatting (3DGS) and Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Nandhana Sunil , Abhirami R Iyer , Avirup Mandal

Ill-conditioning of the system matrix is a well-known complication in immersed finite element methods and trimmed isogeometric analysis. Elements with small intersections with the physical domain yield problematic eigenvalues in the system…

Numerical Analysis · Mathematics 2019-12-17 F. de Prenter , C. V. Verhoosel , E. H. van Brummelen , J. A. Evans , C. Messe , J. Benzaken , K. Maute

Mixed-integer rounding (MIR) cutting planes (cuts) are effective at improving the strength of a linear relaxation for mixed-integer linear programming (MIP) problems. The cuts in this family are derived by aggregating constraints then…

Optimization and Control · Mathematics 2024-12-16 Oscar Guaje , Arnaud Deza , Aleksandr M. Kazachkov , Elias B. Khalil

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

Mixed Binary Quadratic Programs (MBQPs) are a class of NP-hard problems that arise in a wide range of applications, including finance, machine learning, and chemical and energy systems. Large-scale MBQPs are challenging to solve with exact…

Optimization and Control · Mathematics 2025-07-22 Weimin Huang , Natalie M. Isenberg , Jan Drgona , Draguna L Vrabie , Bistra Dilkina

A new hybrid algorithm for LDU-factorization for large sparse matrix combining iterative solver, which can keep the same accuracy as the classical factorization, is proposed. The last Schur complement will be generated by iterative solver…

Numerical Analysis · Mathematics 2022-08-04 Atsushi Suzuki

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

Emerging deep learning workloads urgently need fast general matrix multiplication (GEMM). To meet such demand, one of the critical features of machine-learning-specific accelerators such as NVIDIA Tensor Cores, AMD Matrix Cores, and Google…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-13 Bo Fang , Xinyi Li , Harvey Dam , Cheng Tan , Siva Kumar Sastry Hari , Timothy Tsai , Ignacio Laguna , Dingwen Tao , Ganesh Gopalakrishnan , Prashant Nair , Kevin Barker , Ang Li

We study computational aspects of a key problem in robust statistics -- the penalized least trimmed squares (LTS) regression problem, a robust estimator that mitigates the influence of outliers in data by capping residuals with large…

Optimization and Control · Mathematics 2026-04-15 Xiang Meng , Andrés Gómez , Rahul Mazumder

In this paper, we concentrate on the backward error and condition number of the indefinite least squares problem. For the normwise backward error of the indefinite least square problem, we adopt the linearization method to derive the tight…

Numerical Analysis · Mathematics 2016-12-21 Huai-An Diao , Tong-Yu Zhou

We consider distributed optimization methods for problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We leverage randomized sketches for reducing the problem dimensions as well as…

Optimization and Control · Mathematics 2022-03-21 Burak Bartan , Mert Pilanci

We study the Maximum Independent Set of Rectangles (MISR) problem, where we are given a set of axis-parallel rectangles in the plane and the goal is to select a subset of non-overlapping rectangles of maximum cardinality. In a recent…

Computational Geometry · Computer Science 2021-09-28 Waldo Gálvez , Arindam Khan , Mathieu Mari , Tobias Mömke , Madhusudhan Reddy , Andreas Wiese

Finite-precision arithmetic computations face an inherent tradeoff between accuracy and efficiency. The points in this tradeoff space are determined, among other factors, by different data types but also evaluation orders. To put it simply,…

Programming Languages · Computer Science 2017-07-10 Eva Darulova , Einar Horn , Saksham Sharma

Recent work has explored transforming data sets into smaller, approximate summaries in order to scale Bayesian inference. We examine a related problem in which the parameters of a Bayesian model are very large and expensive to store in…

Machine Learning · Computer Science 2018-10-03 Joseph Tassarotti , Jean-Baptiste Tristan , Michael Wick