English
Related papers

Related papers: Automated Tiling of Unstructured Mesh Computations…

200 papers

Sparse inner product (SIP) has the attractive property of overhead being dominated by the intersection of inputs between parties, independent of the actual input size. It has intriguing prospects, especially for boosting machine learning on…

Cryptography and Security · Computer Science 2022-10-18 Guowen Xu , Shengmin Xu , Jianting Ning , Tianwei Zhang , Xinyi Huang , Hongwei Li , Rongxing Lu

Even distribution of irregular workload to processing units is crucial for efficient parallelization in many applications. In this work, we are concerned with a spatial partitioning called rectilinear partitioning (also known as generalized…

Data Structures and Algorithms · Computer Science 2020-09-17 Abdurrahman Yaşar , Muhammed Fatih Balin , Xiaojing An , Kaan Sancak , Ümit V. Çatalyürek

Structured prediction requires searching over a combinatorial number of structures. To tackle it, we introduce SparseMAP: a new method for sparse structured inference, and its natural loss function. SparseMAP automatically selects only a…

Machine Learning · Statistics 2018-06-21 Vlad Niculae , André F. T. Martins , Mathieu Blondel , Claire Cardie

Simultaneous localization and mapping (SLAM) plays a vital role in mapping unknown spaces and aiding autonomous navigation. Virtually all state-of-the-art solutions today for 2D SLAM are designed for dense and accurate sensors such as laser…

Robotics · Computer Science 2023-12-06 Hanzhi Zhou , Zichao Hu , Sihang Liu , Samira Khan

Many modern data-intensive computational problems either require, or benefit from distance or similarity data that adhere to a metric. The algorithms run faster or have better performance guarantees. Unfortunately, in real applications, the…

Machine Learning · Statistics 2017-10-31 Anna C. Gilbert , Lalit Jain

This paper introduces a framework for distributed parallel image signal extrapolation. Since high-quality image signal processing often comes along with a high computational complexity, a parallel execution is desirable. The proposed…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Jürgen Seiler , André Kaup

This article presents a new method to compute matrices from numerical simulations based on the ideas of sparse sampling and compressed sensing. The method is useful for problems where the determination of the entries of a matrix constitutes…

Chemical Physics · Physics 2014-10-21 Jacob N. Sanders , Xavier Andrade , Alán Aspuru-Guzik

Sparse Tensor Cores offer exceptional performance gains for AI workloads by exploiting structured 2:4 sparsity. However, their potential remains untapped for core scientific workloads such as stencil computations, which exhibit irregular…

Computational Engineering, Finance, and Science · Computer Science 2025-07-01 Qi Li , Kun Li , Haozhi Han , Liang Yuan , Junshi Chen , Yunquan Zhang , Yifeng Chen , Hong An , Ting Cao , Mao Yang

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

Accelerators for sparse matrix multiplication are important components in emerging systems. In this paper, we study the main challenges of accelerating Sparse Matrix Multiplication (SpMM). For the situations that data is not stored in the…

Hardware Architecture · Computer Science 2019-06-04 Pareesa Ameneh Golnari , Sharad Malik

Sparse compiler is a promising solution for sparse tensor algebra optimization. In compiler implementation, reduction in sparse-dense hybrid algebra plays a key role in performance. Though GPU provides various reduction semantics that can…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Genghan Zhang , Yuetong Zhao , Yanting Tao , Zhongming Yu , Guohao Dai , Sitao Huang , Yuan Wen , Pavlos Petoumenos , Yu Wang

Structured sparsity is an efficient way to prune the complexity of modern Machine Learning (ML) applications and to simplify the handling of sparse data in hardware. In such cases, the acceleration of structured-sparse ML models is handled…

Hardware Architecture · Computer Science 2024-02-19 Christodoulos Peltekis , Dionysios Filippas , Giorgos Dimitrakopoulos

Multimodal classification is a core task in human-centric machine learning. We observe that information is highly complementary across modalities, thus unimodal information can be drastically sparsified prior to multimodal fusion without…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Yi Ding , Alex Rich , Mason Wang , Noah Stier , Matthew Turk , Pradeep Sen , Tobias Höllerer

Automated code generation and performance enhancements for sparse tensor algebra have become essential in many real-world applications, such as quantum computing, physical simulations, computational chemistry, and machine learning. General…

Programming Languages · Computer Science 2024-08-20 Adhitha Dias , Logan Anderson , Kirshanthan Sundararajah , Artem Pelenitsyn , Milind Kulkarni

Sparse coding is a basic task in many fields including signal processing, neuroscience and machine learning where the goal is to learn a basis that enables a sparse representation of a given set of data, if one exists. Its standard…

Machine Learning · Computer Science 2015-03-04 Sanjeev Arora , Rong Ge , Tengyu Ma , Ankur Moitra

Topological data analysis (TDA) has emerged as one of the most promising techniques to reconstruct the unknown shapes of high-dimensional spaces from observed data samples. TDA, thus, yields key shape descriptors in the form of persistent…

Machine Learning · Statistics 2017-11-15 Wei Guo , Krithika Manohar , Steven L. Brunton , Ashis G. Banerjee

Sparse data structures are commonly used in neural networks to reduce the memory footprint. These data structures are compact but cause irregularities such as random memory accesses, which prevent efficient use of the memory hierarchy. GPUs…

Programming Languages · Computer Science 2025-06-19 Hossein Albakri , Kazem Cheshmi

Sparse tensor algebra computations have become important in many real-world applications like machine learning, scientific simulations, and data mining. Hence, automated code generation and performance optimizations for tensor algebra…

Programming Languages · Computer Science 2022-05-25 Adhitha Dias , Kirshanthan Sundararajah , Charitha Saumya , Milind Kulkarni

We propose a new approach for metric learning by framing it as learning a sparse combination of locally discriminative metrics that are inexpensive to generate from the training data. This flexible framework allows us to naturally derive…

Machine Learning · Computer Science 2019-01-25 Yuan Shi , Aurélien Bellet , Fei Sha

Sparse matrix computation is crucial in various modern applications, including large-scale graph analytics, deep learning, and recommender systems. The performance of sparse kernels varies greatly depending on the structure of the input…

Hardware Architecture · Computer Science 2024-07-31 Francesco Sgherzi , Marco Siracusa , Ivan Fernandez , Adrià Armejach , Miquel Moretó