English
Related papers

Related papers: Typesafe Abstractions for Tensor Operations

200 papers

This paper introduces a new mathematical framework for analysis and optimization of tensor expressions within an enclosing loop. Tensors are multi-dimensional arrays of values. They are common in high performance computing (HPC) and machine…

Programming Languages · Computer Science 2025-02-10 Javed Absar , Samarth Narang , Muthu Baskaran

Memory safety is an essential correctness property of software systems. For programs operating on linked heap-allocated data structures, the problem of proving memory safety boils down to analyzing the possible shapes of data structures,…

Programming Languages · Computer Science 2024-08-20 Sebastian Wolff , Ekanshdeep Gupta , Zafer Esen , Hossein Hojjat , Philipp Rümmer , Thomas Wies

This paper proposes a transition system abstraction framework for neural network dynamical system models to enhance the model interpretability, with applications to complex dynamical systems such as human behavior learning and verification.…

Systems and Control · Electrical Eng. & Systems 2024-02-20 Yejiang Yang , Zihao Mo , Hoang-Dung Tran , Weiming Xiang

Deep learning models with convolutional and recurrent networks are now ubiquitous and analyze massive amounts of audio, image, video, text and graph data, with applications in automatic translation, speech-to-text, scene understanding,…

Tensor processing infrastructures such as deep learning frameworks and specialized hardware accelerators have revolutionized how computationally intensive code from domains such as deep learning and image processing is executed and…

Programming Languages · Computer Science 2024-12-17 Jie Qiu , Colin Cai , Sahil Bhatia , Niranjan Hasabnis , Sanjit A. Seshia , Alvin Cheung

Tensors, or multidimensional arrays, are data structures that can naturally represent visual data of multiple dimensions. Inherently able to efficiently capture structured, latent semantic spaces and high-order interactions, tensors have a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Yannis Panagakis , Jean Kossaifi , Grigorios G. Chrysos , James Oldfield , Mihalis A. Nicolaou , Anima Anandkumar , Stefanos Zafeiriou

Tensors are higher-order extensions of matrices. While matrix methods form the cornerstone of machine learning and data analysis, tensor methods have been gaining increasing traction. However, software support for tensor operations is not…

Machine Learning · Computer Science 2018-05-10 Jean Kossaifi , Yannis Panagakis , Anima Anandkumar , Maja Pantic

We consider the problem of automatically decomposing operations over tensors or arrays so that they can be executed in parallel on multiple devices. We address two, closely-linked questions. First, what programming abstraction should…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-04 Daniel Bourgeois , Zhimin Ding , Dimitrije Jankov , Jiehui Li , Mahmoud Sleem , Yuxin Tang , Jiawen Yao , Xinyu Yao , Chris Jermaine

In the realm of sound object-oriented program analyses for information-flow control, very few approaches adopt flow-sensitive abstractions of the heap that enable a precise modeling of implicit flows. To tackle this challenge, we advance a…

Programming Languages · Computer Science 2022-11-08 Nicolas Berthier , Narges Khakpour

Verification of software systems is a very hard problem due to the large size of program state-space. The traditional techniques (like model checking) do not scale; since they include the whole state-space by inlining the library function…

Logic in Computer Science · Computer Science 2010-05-03 Pritam Roy

We provide a unified framework to study hierarchies of relaxations for Constraint Satisfaction Problems and their Promise variant. The idea is to split the description of a hierarchy into an algebraic part, depending on a minion capturing…

Computational Complexity · Computer Science 2026-02-24 Lorenzo Ciardo , Stanislav Živný

We construct a soft thresholding operation for rank reduction of hierarchical tensors and subsequently consider its use in iterative thresholding methods, in particular for the solution of discretized high-dimensional elliptic problems. The…

Numerical Analysis · Mathematics 2015-02-02 Markus Bachmayr , Reinhold Schneider

Trusted Execution Environments (TEEs) protect sensitive code and data from the operating system, hypervisor, or other untrusted software. Different solutions exist, each proposing different features. Abstraction layers aim to unify the…

Cryptography and Security · Computer Science 2025-12-29 Quentin Michaud , Sara Ramezanian , Dhouha Ayed , Olivier Levillain , Joaquin Garcia-Alfaro

Tensor network methods are a conceptually elegant framework for encoding complicated datasets, where high-order tensors are approximated as networks of low-order tensors. In practice, however, the numeric implementation of tensor network…

Quantum Physics · Physics 2019-11-07 Glen Evenbly

Multitask learning (MTL) can utilize the relatedness between multiple tasks for performance improvement. The advent of multimodal data allows tasks to be referenced by multiple indices. High-order tensors are capable of providing efficient…

Machine Learning · Computer Science 2023-08-23 Jiani Liu , Qinghua Tao , Ce Zhu , Yipeng Liu , Johan A. K. Suykens

In the world of linear algebra computation, a well-established standard exists called BLAS(Basic Linear Algebra Subprograms). This standard has been crucial for the development of software using linear algebra operations. Its benefits…

Mathematical Software · Computer Science 2024-10-10 Niklas Hörnblad

In scientific fields such as quantum computing, physics, chemistry, and machine learning, high dimensional data are typically represented using sparse tensors. Tensor contraction is a popular operation on tensors to exploit meaning or alter…

Data Structures and Algorithms · Computer Science 2024-10-15 Andrew Ensinger , Gabriel Kulp , Victor Agostinelli , Dennis Lyakhov , Lizhong Chen

Neural abstractions have been recently introduced as formal approximations of complex, nonlinear dynamical models. They comprise a neural ODE and a certified upper bound on the error between the abstract neural network and the concrete…

Logic in Computer Science · Computer Science 2023-10-03 Alec Edwards , Mirco Giacobbe , Alessandro Abate

Large visual-language models (LVLMs) integrate aligned large language models (LLMs) with visual modules to process multimodal inputs. However, the safety mechanisms developed for text-based LLMs do not naturally extend to visual modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shen Li , Liuyi Yao , Wujia Niu , Lan Zhang , Yaliang Li

Within the field of numerical multilinear algebra, block tensors are increasingly important. Accordingly, it is appropriate to develop an infrastructure that supports reasoning about block tensor computation. In this paper we establish…

Numerical Analysis · Mathematics 2011-10-04 Stefan Ragnarsson , Charles F. Van Loan