English
Related papers

Related papers: Effective sketching methods for value function app…

200 papers

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating visual content. An…

Human-Computer Interaction · Computer Science 2021-11-22 Forrest Huang , Eldon Schoop , David Ha , Jeffrey Nichols , John Canny

Fast approximations to matrix multiplication have the potential to dramatically reduce the cost of neural network inference. Recent work on approximate matrix multiplication proposed to replace costly multiplications with table-lookups by…

Machine Learning · Computer Science 2022-07-14 Calvin McCarter , Nicholas Dronen

Active subspaces are an emerging set of tools for identifying and exploiting the most important directions in the space of a computer simulation's input parameters; these directions depend on the simulation's quantity of interest, which we…

Numerical Analysis · Mathematics 2015-10-13 Paul G. Constantine , Armin Eftekhari , Michael B. Wakin

Estimating a policy that maps states to actions is a central problem in reinforcement learning. Traditionally, policies are inferred from the so called value functions (VFs), but exact VF computation suffers from the curse of…

Machine Learning · Computer Science 2024-05-29 Sergio Rozada , Antonio G. Marques

Least squares regression is a ubiquitous tool for building emulators (a.k.a. surrogate models) of problems across science and engineering for purposes such as design space exploration and uncertainty quantification. When the regression data…

Numerical Analysis · Mathematics 2024-07-08 Nuojin Cheng , Osman Asif Malik , Yiming Xu , Stephen Becker , Alireza Doostan , Akil Narayan

Low rank approximation of matrices has been well studied in literature. Singular value decomposition, QR decomposition with column pivoting, rank revealing QR factorization (RRQR), Interpolative decomposition etc are classical deterministic…

Numerical Analysis · Mathematics 2016-06-22 N. Kishore Kumar , Jan Shneider

In this paper, we propose {\it \underline{R}ecursive} {\it \underline{I}mportance} {\it \underline{S}ketching} algorithm for {\it \underline{R}ank} constrained least squares {\it \underline{O}ptimization} (RISRO). The key step of RISRO is…

Optimization and Control · Mathematics 2022-12-06 Yuetian Luo , Wen Huang , Xudong Li , Anru R. Zhang

Second-order optimization methods are among the most widely used optimization approaches for convex optimization problems, and have recently been used to optimize non-convex optimization problems such as deep learning models. The widely…

Optimization and Control · Mathematics 2022-02-01 Dinesh Singh , Hardik Tankaria , Makoto Yamada

Face modeling has been paid much attention in the field of visual computing. There exist many scenarios, including cartoon characters, avatars for social media, 3D face caricatures as well as face-related art and design, where low-cost…

Graphics · Computer Science 2017-06-08 Xiaoguang Han , Chang Gao , Yizhou Yu

Matrix sensing is a problem in signal processing and machine learning that involves recovering a low-rank matrix from a set of linear measurements. The goal is to reconstruct the original matrix as accurately as possible, given only a set…

Information Theory · Computer Science 2023-03-14 Yichuan Deng , Zhihang Li , Zhao Song

This work presents an approach to the inverse design of scattering systems by modifying the transmission matrix using reinforcement learning. We utilize Proximal Policy Optimization to navigate the highly non-convex landscape of the object…

Optics · Physics 2025-06-17 Yuhao Kang

Policy gradient methods are an appealing approach in reinforcement learning because they directly optimize the cumulative reward and can straightforwardly be used with nonlinear function approximators such as neural networks. The two main…

Machine Learning · Computer Science 2018-10-23 John Schulman , Philipp Moritz , Sergey Levine , Michael Jordan , Pieter Abbeel

Leveraging the kernel trick in both the input and output spaces, surrogate kernel methods are a flexible and theoretically grounded solution to structured output prediction. If they provide state-of-the-art performance on complex data sets…

Machine Learning · Statistics 2024-05-07 Tamim El Ahmad , Luc Brogat-Motte , Pierre Laforgue , Florence d'Alché-Buc

We consider distributed optimization methods for problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We leverage randomized sketches for reducing the problem dimensions as well as…

Optimization and Control · Mathematics 2022-03-21 Burak Bartan , Mert Pilanci

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

Numerical Analysis · Mathematics 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

Preventing catastrophic forgetting while continually learning new tasks is an essential problem in lifelong learning. Structural regularization (SR) refers to a family of algorithms that mitigate catastrophic forgetting by penalizing the…

Machine Learning · Computer Science 2021-04-20 Haoran Li , Aditya Krishnan , Jingfeng Wu , Soheil Kolouri , Praveen K. Pilly , Vladimir Braverman

A fundamental cognitive process is the ability to map value and identity onto objects as we learn about them. Exactly how such mental constructs emerge and what kind of space best embeds this mapping remains incompletely understood. Here we…

Neurons and Cognition · Quantitative Biology 2019-05-31 Evelyn Tang , Marcelo G. Mattar , Chad Giusti , Sharon L. Thompson-Schill , Danielle S. Bassett

A common approach for compressing large-scale data is through matrix sketching. In this work, we consider the problem of recovering low-rank matrices from two noisy linear sketches using the double sketching scheme discussed in Fazel et al.…

Numerical Analysis · Mathematics 2023-07-17 Anna Ma , Dominik Stöger , Yizhe Zhu

Given a symmetric matrix $A$, we show from the simple sketch $GAG^T$, where $G$ is a Gaussian matrix with $k = O(1/\epsilon^2)$ rows, that there is a procedure for approximating all eigenvalues of $A$ simultaneously to within $\epsilon…

Data Structures and Algorithms · Computer Science 2023-04-20 William Swartworth , David P. Woodruff

Principal component regression (PCR) is a useful method for regularizing linear regression. Although conceptually simple, straightforward implementations of PCR have high computational costs and so are inappropriate when learning with large…

Numerical Analysis · Mathematics 2019-03-08 Liron Mor-Yosef , Haim Avron