English
Related papers

Related papers: Tabula: Efficiently Computing Nonlinear Activation…

200 papers

GNN inference is a non-trivial task, especially in industrial scenarios with giant graphs, given three main challenges, i.e., scalability tailored for full-graph inference on huge graphs, inconsistency caused by stochastic acceleration…

Machine Learning · Computer Science 2023-07-04 Dalong Zhang , Xianzheng Song , Zhiyang Hu , Yang Li , Miao Tao , Binbin Hu , Lin Wang , Zhiqiang Zhang , Jun Zhou

The attention mechanism is an important reason for the success of transformers. It relies on computing pairwise relations between tokens. To reduce the high computational cost of standard quadratic attention, linear attention has been…

Artificial Intelligence · Computer Science 2026-02-13 Hanno Ackermann , Hong Cai , Mohsen Ghafoorian , Amirhossein Habibian

Existing studies tend tofocus onmodel modifications and integration with higher accuracy, which improve performance but also carry huge computational costs, resulting in longer detection times. Inmedical imaging, the use of time is…

Image and Video Processing · Electrical Eng. & Systems 2023-02-22 Weihu Song , Heng Yu

Despite recent advancements in tabular language model research, real-world applications are still challenging. In industry, there is an abundance of tables found in spreadsheets, but acquisition of substantial amounts of labels is…

Computation and Language · Computer Science 2022-11-09 Martin Ringsquandl , Aneta Koleva

A limited number of qubits, high error rates, and limited qubit connectivity are major challenges for effective near-term quantum computations. Quantum circuit partitioning divides a quantum computation into a set of computations that…

Quantum Physics · Physics 2023-08-21 Sebastian Brandhofer , Ilia Polian , Kevin Krsulich

We provide practical simulation methods for scalar field theories on a quantum computer that yield improved asymptotics as well as concrete gate estimates for the simulation and physical qubit estimates using the surface code. We achieve…

Semi-supervised learning (SSL) enables prediction with limited labels, but high-stakes tabular applications (medical, credit, recidivism) require statistical fairness guarantees. We identify a structural conflict in tabular fair SSL through…

Machine Learning · Computer Science 2026-05-19 Hangchun Liang , Changchun Li

Computationally efficient matrix multiplication is a fundamental requirement in various fields, including and particularly in data analytics. To do so, the computation task of a large-scale matrix multiplication is typically outsourced to…

Information Theory · Computer Science 2018-11-01 Jaber Kakar , Seyedhamed Ebadifar , Aydin Sezgin

Graph Neural Network (GNN) on streaming graphs has gained increasing popularity. However, its practical deployment remains challenging, as the inference process relies on Runtime Embedding Computation (RTEC) to capture recent graph changes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Qiange Wang , Haoran Lv , Yanfeng Zhang , Weng-Fai Wong , Bingsheng He

With the increasing deployment of generative machine learning models in privacy-sensitive domains such as healthcare and personalized services, ensuring secure inference has become a critical challenge. Secure multi-party computation (MPC)…

Machine Learning · Computer Science 2025-08-05 Tianpei Lu , Bingsheng Zhang , Lekun Peng , Bowen Zheng , Lichun Li , Kui Ren

Active Learning (AL) is a powerful tool for learning with less labeled data, in particular, for specialized domains, like legal documents, where unlabeled data is abundant, but the annotation requires domain expertise and is thus expensive.…

Computation and Language · Computer Science 2022-11-16 Sepideh Mamooler , Rémi Lebret , Stéphane Massonnet , Karl Aberer

Multitask learning is a widely used paradigm for training models on diverse tasks, with applications ranging from graph neural networks to language model fine-tuning. Since tasks may interfere with each other, a key notion for modeling…

Machine Learning · Computer Science 2024-11-22 Dongyue Li , Aneesh Sharma , Hongyang R. Zhang

Non-linear operations such as GELU, Layer normalization, and Softmax are essential yet costly building blocks of Transformer models. Several prior works simplified these operations with look-up tables or integer computations, but such…

Machine Learning · Computer Science 2021-12-07 Joonsang Yu , Junki Park , Seongmin Park , Minsoo Kim , Sihwa Lee , Dong Hyun Lee , Jungwook Choi

Privacy and security have rapidly emerged as priorities in system design. One powerful solution for providing both is privacy-preserving computation, where functions are computed directly on encrypted data and control can be provided over…

Hardware Architecture · Computer Science 2023-04-26 Jianqiao Mo , Jayanth Gopinath , Brandon Reagen

Quantum computers are currently noisy, particularly without error correction and fault tolerance. Methods like error suppression and mitigation are widely used to improve performance. Circuit cutting, which partitions a circuit into smaller…

Quantum Physics · Physics 2025-07-03 Debasmita Bhoumik , Ritajit Majumdar , Amit Saha , Susmita Sur-Kolay

Neural networks are commonly used in safety-critical real-world applications. Unfortunately, the predicted output is often highly sensitive to small, and possibly imperceptible, changes to the input data. Proving that either no such…

Machine Learning · Computer Science 2021-02-03 Christopher Brix , Thomas Noll

Scalability of Graph Neural Networks (GNNs) remains a significant challenge. To tackle this, methods like coarsening, condensation, and computation trees are used to train on a smaller graph, resulting in faster computation. Nonetheless,…

Machine Learning · Computer Science 2026-04-13 Shubhajit Roy , Hrriday Ruparel , Kishan Ved , Anirban Dasgupta

Quantum Internetworking is a recent field that promises numerous interesting applications, many of which require the distribution of entanglement between arbitrary pairs of users. This work deals with the problem of scheduling in an…

Quantum Physics · Physics 2024-05-29 Paolo Fittipaldi , Anastasios Giovanidis , Frédéric Grosshans

Hybrid quantum--classical workflows often execute large ensembles of circuits that differ syntactically but implement identical operations, leading to substantial redundant computation. To address this, we introduce the Quantum Circuit…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Mar Tejedor , Javier Conejero , Rosa M. Badia

Understanding how data moves, transforms, and persists, known as data flow, is fundamental to reasoning in procedural tasks. Despite their fluency in natural and programming languages, large language models (LLMs), although increasingly…

Artificial Intelligence · Computer Science 2025-06-02 Vishal Pallagani , Nitin Gupta , John Aydin , Biplav Srivastava