English
Related papers

Related papers: Multivariate Density Estimation via Variance-Reduc…

200 papers

In this paper, we revisit the classic CountSketch method, which is a sparse, random projection that transforms a (high-dimensional) Euclidean vector $v$ to a vector of dimension $(2t-1) s$, where $t, s > 0$ are integer parameters. It is…

Data Structures and Algorithms · Computer Science 2021-02-04 Kasper Green Larsen , Rasmus Pagh , Jakub Tětek

Volume Rendering is an important technique for visualizing three-dimensional scalar data grids and is commonly employed for scientific and medical image data. Direct Volume Rendering (DVR) is a well established and efficient rendering…

Graphics · Computer Science 2021-06-11 Jakob Weiss , Nassir Navab

Density-ratio estimation via classification is a cornerstone of unsupervised learning. It has provided the foundation for state-of-the-art methods in representation learning and generative modelling, with the number of use-cases continuing…

Machine Learning · Statistics 2020-11-25 Benjamin Rhodes , Kai Xu , Michael U. Gutmann

Machine learning methods provide a general framework for automatically finding and representing the essential characteristics of simulation data. This task is particularly crucial in enhanced sampling simulations. There we seek a few…

Chemical Physics · Physics 2021-07-07 Jakub Rydzewski , Omar Valsson

For a tall $n\times d$ matrix $A$ and a random $m\times n$ sketching matrix $S$, the sketched estimate of the inverse covariance matrix $(A^\top A)^{-1}$ is typically biased: $E[(\tilde A^\top\tilde A)^{-1}]\ne(A^\top A)^{-1}$, where…

Data Structures and Algorithms · Computer Science 2021-07-13 Michał Dereziński , Zhenyu Liao , Edgar Dobriban , Michael W. Mahoney

We propose a hierarchical tensor-network approach for approximating high-dimensional probability density via empirical distribution. This leverages randomized singular value decomposition (SVD) techniques and involves solving linear…

Numerical Analysis · Mathematics 2026-01-13 Yifan Peng , Yian Chen , E. Miles Stoudenmire , Yuehaw Khoo

Sketch-and-solve (SAS) is a very successful method to efficiently estimate the solution of heavily overdetermined large linear least squares problems. It uses random sketching to reduce the size of the problem, hence reducing the…

Numerical Analysis · Mathematics 2026-05-26 Irina-Beatrice Haas , Michael B. Giles , Yuji Nakatsukasa

Multivariate Gaussian (MVG) distributions are central to modeling correlated continuous variables in probabilistic forecasting. Neural forecasting models typically parameterize the mean vector and covariance matrix of the distribution using…

Machine Learning · Statistics 2025-02-03 Vincent Zhihao Zheng , Lijun Sun

We propose VRSketch2Gaussian, a first VR sketch-guided, multi-modal, native 3D object generation framework that incorporates a 3D Gaussian Splatting representation. As part of our work, we introduce VRSS, the first large-scale paired…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Songen Gu , Haoxuan Song , Binjie Liu , Qian Yu , Sanyi Zhang , Haiyong Jiang , Jin Huang , Feng Tian

Extracting interpretable equations from observational datasets to describe complex natural phenomena is one of the core goals of artificial intelligence. This field is known as symbolic regression (SR). In recent years, Transformer-based…

Machine Learning · Computer Science 2026-01-26 Da Li , Junping Yin , Jin Xu , Xinxin Li , Juan Zhang

Varying coefficient models are popular for estimating nonlinear regression functions in functional data models. Their Bayesian variants have received limited attention in large data applications, primarily due to prohibitively slow…

Machine Learning · Statistics 2025-06-03 Rajarshi Guhaniyogi , Laura Baracaldo , Sudipto Banerjee

We study the practical task of fine-grained 3D-VR-sketch-based 3D shape retrieval. This task is of particular interest as 2D sketches were shown to be effective queries for 2D images. However, due to the domain gap, it remains hard to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Ling Luo , Yulia Gryaditskaya , Tao Xiang , Yi-Zhe Song

Adaptive importance sampling for stochastic optimization is a promising approach that offers improved convergence through variance reduction. In this work, we propose a new framework for variance reduction that enables the use of mixtures…

Machine Learning · Computer Science 2019-04-01 Zalán Borsos , Sebastian Curi , Kfir Y. Levy , Andreas Krause

This paper develops the sketching (i.e., randomized dimension reduction) theory for real algebraic varieties and images of polynomial maps, including, e.g., the set of low rank tensors and tensor networks. Through the lens of norming sets,…

Numerical Analysis · Mathematics 2025-06-06 Yifan Zhang , Joe Kileel

Neural rendering of implicit surfaces performs well in 3D vision applications. However, it requires dense input views as supervision. When only sparse input images are available, output quality drops significantly due to the shape-radiance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Haoyu Wu , Alexandros Graikos , Dimitris Samaras

This work extends our previous study from S. Shrestha et al. (2024) by introducing a new abstract framework for Variational Multiscale (VMS) methods at the discrete level. We introduce the concept of what we define as the optimal projector…

Numerical Analysis · Mathematics 2025-03-04 Suyash Shrestha , Marc Gerritsma , Gonzalo Rubio , Steven Hulshoff , Esteban Ferrer

Sketch-and-project is a framework which unifies many known iterative methods for solving linear systems and their variants, as well as further extensions to non-linear optimization problems. It includes popular methods such as randomized…

Optimization and Control · Mathematics 2023-09-20 Michał Dereziński , Elizaveta Rebrova

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

In the era of large foundation models, the quality of embeddings has become a central determinant of downstream task performance and overall system capability. Yet widely used dense embeddings are often extremely high-dimensional, incurring…

Machine Learning · Computer Science 2026-03-03 Lixuan Guo , Yifei Wang , Tiansheng Wen , Yifan Wang , Aosong Feng , Bo Chen , Stefanie Jegelka , Chenyu You

Multimodal fusion of remote sensing images serves as a core technology for overcoming the limitations of single-source data and improving the accuracy of surface information extraction, which exhibits significant application value in fields…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Siyu Zhang , Lianlei Shan , Runhe Qiu