English
Related papers

Related papers: Fremer: Lightweight and Effective Frequency Transf…

200 papers

Computation offloading at lower time and lower energy consumption is crucial for resource limited mobile devices. This paper proposes an offloading decision-making model using federated learning. Based on the task type and the user input,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Anwesha Mukherjee , Rajkumar Buyya

Transformer-based language models utilize the attention mechanism for substantial performance improvements in almost all natural language processing (NLP) tasks. Similar attention structures are also extensively studied in several other…

Computation and Language · Computer Science 2023-05-17 Nurullah Sevim , Ege Ozan Özyedek , Furkan Şahinuç , Aykut Koç

In recent work on time-series prediction, Transformers and even large language models have garnered significant attention due to their strong capabilities in sequence modeling. However, in practical deployments, time-series prediction often…

Machine Learning · Computer Science 2026-02-17 Wenxuan Xie , Fanpu Cao

With the widespread adoption of millimeter-wave (mmWave) massive multi-input-multi-output (MIMO) in vehicular networks, accurate beam prediction and alignment have become critical for high-speed data transmission and reliable access. While…

Information Theory · Computer Science 2026-03-27 Chenyiming Wen , Binpu Shi , Min Li , Ming-Min Zhao , Min-Jian Zhao , Jiangzhou Wang

The availability of precise and accurate simulation is a limiting factor for interpreting and forecasting data in many fields of science and engineering. Often, one or more distinct simulation software applications are developed, each with…

High Energy Physics - Experiment · Physics 2025-02-19 Moritz Wolf , Lars O. Stietz , Patrick L. S. Connor , Peter Schleper , Samuel Bein

Cross-frequency transfer learning (CFTL) has emerged as a popular framework for curating large-scale time series datasets to pre-train foundation forecasting models (FFMs). Although CFTL has shown promise, current benchmarking practices…

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substantial computational and latency demands. While most existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yifan Sun , Gholamreza Haffari , Minxian Xu , Rajkumar Buyya , Adel N. Toosi

Reliability, security and stability of cloud services without sacrificing too much resources have become a desired feature in the area of workload management in clouds. The paper proposes and evaluates a lightweight framework for scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-09 Muhammed Abdulazeez , Pawel Garncarek , Dariusz R. Kowalski , Prudence W. H. Wong

Datacenters are witnessing a rapid surge in the adoption of serverless functions for microservices-based applications. A vast majority of these microservices typically span less than a second, have strict SLO requirements, and are chained…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-01 Jashwant Raj Gunasekaran , Prashanth Thinakaran , Nachiappan Chidambaram , Mahmut T. Kandemir , Chita R. Das

Airport performance prediction with a reasonable look-ahead time is a challenging task and has been attempted by various prior research. Traffic, demand, weather, and traffic management actions are all critical inputs to any prediction…

Machine Learning · Computer Science 2021-11-09 Liya Wang , Alex Tien , Jason Chou

Transformers have excelled in many tasks including vision. However, efficient deployment of transformer models in low-latency or high-throughput applications is hindered by the computation in the attention mechanism which involves expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 John Yang , Le An , Su Inn Park

Spectral analysis provides one of the most effective paradigms for information-preserving dimensionality reduction, as simple descriptions of naturally occurring signals are often obtained via few terms of periodic basis functions. In this…

Machine Learning · Computer Science 2022-11-29 Michael Poli , Stefano Massaroli , Federico Berto , Jinykoo Park , Tri Dao , Christopher Ré , Stefano Ermon

Foundation models have recently attracted significant attention for their impressive generalizability across diverse downstream tasks. However, these models are demonstrated to exhibit great limitations in representing high-frequency…

Image and Video Processing · Electrical Eng. & Systems 2025-04-18 Yuetan Chu , Yilan Zhang , Zhongyi Han , Changchun Yang , Longxi Zhou , Gongning Luo , Chao Huang , Xin Gao

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series…

Machine Learning · Computer Science 2022-06-17 Tian Zhou , Ziqing Ma , Qingsong Wen , Xue Wang , Liang Sun , Rong Jin

A low-latency and energy-efficient tensor algebra accelerator design must optimize how data movement and operations are scheduled (i.e., mapped) in the accelerator architecture. A key mapping optimization is fusion, meaning holding data…

Hardware Architecture · Computer Science 2026-05-05 Tanner Andrulis , Michael Gilbert , Vivienne Sze , Joel S. Emer

Many fault diagnosis methods of rotating machines are based on discriminative features extracted from signals collected from the key components such as bearings. However, under complex operating conditions, periodic impulsive…

Signal Processing · Electrical Eng. & Systems 2025-12-12 Yuhan Yuan , Xiaomo Jiang , Haibin Yang , Haixin Zhao , Shengbo Wang , Xueyu Cheng , Jigang Meng , Shuhua Yang

Meter-level load forecasting is crucial for efficient energy management and power system planning for Smart Grids (SGs), in tasks associated with regulation, dispatching, scheduling, and unit commitment of power grids. Although a variety of…

This paper introduces WeatherFormer, a transformer encoder-based model designed to learn robust weather features from minimal observations. It addresses the challenge of modeling complex weather dynamics from small datasets, a bottleneck…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Adib Hasan , Mardavij Roozbehani , Munther Dahleh

The impressive performance of transformer models has sparked the deployment of intelligent applications on resource-constrained edge devices. However, ensuring high-quality service for real-time edge systems is a significant challenge due…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-29 Guanyu Xu , Zhiwei Hao , Li Shen , Yong Luo , Fuhui Sun , Xiaoyan Wang , Han Hu , Yonggang Wen

The workload prediction and resource allocation significantly play an inevitable role in production of an efficient cloud environment. The proactive estimation of future workload followed by decision of resource allocation have become a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-30 Deepika Saxena , Ashutosh Kumar Singh