English
Related papers

Related papers: Attention Based Machine Learning Methods for Data …

200 papers

Anomaly detection in industrial systems is crucial for preventing equipment failures, ensuring risk identification, and maintaining overall system efficiency. Traditional monitoring methods often rely on fixed thresholds and empirical…

Machine Learning · Computer Science 2024-04-26 Sarala Naidu , Ning Xiong

Many machine learning models use the manipulation of dimensions as a driving force to enable models to identify and learn important features in data. In the case of sequential data this manipulation usually happens on the token dimension…

Machine Learning · Computer Science 2023-10-24 Daniel Biermann , Fabrizio Palumbo , Morten Goodwin , Ole-Christoffer Granmo

With the development of the 3D data acquisition facilities, the increasing scale of acquired 3D point clouds poses a challenge to the existing data compression techniques. Although promising performance has been achieved in static point…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Guangchi Fang , Qingyong Hu , Yiling Xu , Yulan Guo

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-09 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , James Ahrens , Dingwen Tao

Increasing data volumes from scientific simulations and instruments (supercomputers, accelerators, telescopes) often exceed network, storage, and analysis capabilities. The scientific community's response to this challenge is scientific…

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

Today's scientific simulations require significant data volume reduction because of the enormous amounts of data produced and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one of the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-07 Daoce Wang , Jesus Pulido , Pascal Grosset , Sian Jin , Jiannan Tian , Kai Zhao , James Ahrens , Dingwen Tao

New directions in computing and algorithms has lead to some new applications that have tolerance to imprecision. Although, These applications are creating large volumes of data which exceeds the capability of today's computing systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-16 Navid Mirnouri

Deep neural networks have achieved strong performance in image classification tasks due to their ability to learn complex patterns from high-dimensional data. However, their large computational and memory requirements often limit deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sai Shi

Wavefunction-based quantum methods are some of the most accurate tools for predicting and analyzing the electronic structure of molecules, in particular for accounting for dynamical electron correlation. However, most methods of including…

Chemical Physics · Physics 2026-03-02 Ishna Satyarth , Eric C. Larson , Devin A. Matthews

This paper studies the computational offloading of CNN inference in device-edge co-inference systems. Inspired by the emerging paradigm semantic communication, we propose a novel autoencoder-based CNN architecture (AECNN), for effective…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Nan Li , Alexandros Iosifidis , Qi Zhang

Real-time data collection and analysis in large experimental facilities present a great challenge across multiple domains, including high energy physics, nuclear physics, and cosmology. To address this, machine learning (ML)-based methods…

Machine Learning · Computer Science 2021-11-11 Yi Huang , Yihui Ren , Shinjae Yoo , Jin Huang

Extensive efforts have been made to boost the performance in the domain of language models by introducing various attention-based transformers. However, the inclusion of linear layers with large dimensions contributes to significant…

Machine Learning · Computer Science 2024-11-19 Priyansh Bhatnagar , Linfeng Wen , Mingu Kang

This study proposes a text classification algorithm based on large language models, aiming to address the limitations of traditional methods in capturing long-range dependencies, understanding contextual semantics, and handling class…

Computation and Language · Computer Science 2025-12-11 Ning Lyu , Yuxi Wang , Feng Chen , Qingyuan Zhang

The generation of voluminous scientific data poses significant challenges for efficient storage, transfer, and analysis. Recently, error-bounded lossy compression methods emerged due to their ability to achieve high compression ratios while…

Machine Learning · Computer Science 2025-05-13 Guozhong Li , Muhannad Alhumaidi , Spiros Skiadopoulos , Ibrahim Hoteit , Panos Kalnis

Compressing massive LiDAR point clouds in real-time is critical to autonomous machines such as drones and self-driving cars. While most of the recent prior work has focused on compressing individual point cloud frames, this paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-18 Yu Feng , Shaoshan Liu , Yuhao Zhu

Artificial Neural Networks (ANNs) require significant amounts of data and computational resources to achieve high effectiveness in performing the tasks for which they are trained. To reduce resource demands, various techniques, such as…

Neural and Evolutionary Computing · Computer Science 2024-12-04 A. Stolarek , W. Jaworek

LiDARs are widely used in autonomous robots due to their ability to provide accurate environment structural information. However, the large size of point clouds poses challenges in terms of data storage and transmission. In this paper, we…

Robotics · Computer Science 2025-02-11 Yuhao Cao , Yu Wang , Haoyao Chen

Distributed model training suffers from communication bottlenecks due to frequent model updates transmitted across compute nodes. To alleviate these bottlenecks, practitioners use gradient compression techniques like sparsification,…

Machine Learning · Computer Science 2020-11-02 Saurabh Agarwal , Hongyi Wang , Kangwook Lee , Shivaram Venkataraman , Dimitris Papailiopoulos

Recent advancements in point cloud compression have primarily emphasized geometry compression while comparatively fewer efforts have been dedicated to attribute compression. This study introduces an end-to-end learned dynamic lossy…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Dat Thanh Nguyen , Daniel Zieger , Marc Stamminger , Andre Kaup