English
Related papers

Related papers: AttenMfg: An Attention Network Based Optimization …

200 papers

Large language models deployed in sensitive applications increasingly require the ability to unlearn specific knowledge, such as user requests, copyrighted materials, or outdated information, without retraining from scratch to ensure…

Machine Learning · Computer Science 2026-05-05 Sadia Asif , Mohammad Mohammadi Amiri

Metascheduling in time-triggered architectures has been crucial in adapting to dynamic and unpredictable environments, ensuring the reliability and efficiency of task execution. However, traditional approaches face significant challenges…

Artificial Intelligence · Computer Science 2025-09-26 Samer Alshaer , Ala Khalifeh , Roman Obermaisser

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Attention-based architectures have become ubiquitous in time series forecasting tasks, including spatio-temporal (STF) and long-term time series forecasting (LTSF). Yet, our understanding of the reasons for their effectiveness remains…

Machine Learning · Computer Science 2025-05-13 Suhan Guo , Jiahong Deng , Yi Wei , Hui Dou , Furao Shen , Jian Zhao

The emerging technology of the Autonomous Truck Mounted Attenuator (ATMA), a leader-follower style vehicle system, utilizes connected and automated vehicle capabilities to enhance safety during transportation infrastructure maintenance in…

Systems and Control · Electrical Eng. & Systems 2023-08-09 Qing Tang , Xianbiao Hu

"This work has been submitted to the lEEE for possible publication. Copyright may be transferred without noticeafter which this version may no longer be accessible." Time series modeling serves as the cornerstone of real-world applications,…

Machine Learning · Computer Science 2025-04-04 Sijie Xiong , Shuqing Liu , Cheng Tang , Fumiya Okubo , Haoling Xiong , Atsushi Shimada

Service supply chain management is to prepare spare parts for failed products under warranty. Their goal is to reach agreed service level at the minimum cost. We convert this business problem into a preference based multi-objective…

Artificial Intelligence · Computer Science 2019-06-20 Wenli Ouyang

Multi-Head Attention (MHA) is a critical computational kernel in transformer-based AI models. Emerging scalable tile-based accelerator architectures integrate increasing numbers of tightly-packed processing elements (PEs) with tensor units.…

Hardware Architecture · Computer Science 2025-05-27 Chi Zhang , Luca Colagrande , Renzo Andri , Thomas Benz , Gamze Islamoglu , Alessandro Nadalini , Francesco Conti , Yawei Li , Luca Benini

This paper proposes an intent-aware multi-agent planning framework as well as a learning algorithm. Under this framework, an agent plans in the goal space to maximize the expected utility. The planning process takes the belief of other…

Artificial Intelligence · Computer Science 2018-03-07 Siyuan Qi , Song-Chun Zhu

Effective operations and maintenance (O&M) in modern production systems hinges on careful orchestration of economic and degradation dependencies across a multitude of assets. While the economic dependencies are well studied, degradation…

Optimization and Control · Mathematics 2023-11-21 Deniz Altinpulluk , Farnaz Fallahi , Murat Yildirim , Javad Feizollahi

To address the challenges of untimely detection and online monitoring lag in injection molding quality anomalies, this study proposes a mixed feature attention-artificial neural network (MFA-ANN) model for high-precision online prediction…

Machine Learning · Computer Science 2025-06-25 Maoyuan Li , Sihong Li , Guancheng Shen , Yun Zhang , Huamin Zhou

Models of choice are a fundamental input to many now-canonical optimization problems in the field of Operations Management, including assortment, inventory, and price optimization. Naturally, accurate estimation of these models from data is…

Artificial Intelligence · Computer Science 2024-02-09 Joohwan Ko , Andrew A. Li

Large Language Models (LLMs) encounter significant performance bottlenecks in long-sequence tasks due to the computational complexity and memory overhead inherent in the self-attention mechanism. To address these challenges, we introduce…

Artificial Intelligence · Computer Science 2026-02-17 Ziming Wang , Xiang Wang , Kailong Peng , Lang Qin , Juan Gabriel Kostelec , Christos Sourmpis , Axel Laborieux , Qinghai Guo

The choice of attention mechanism in Transformer models involves a critical trade-off between modeling quality and inference efficiency. Multi-Head Attention (MHA) offers the best quality but suffers from large Key-Value (KV) cache memory…

Artificial Intelligence · Computer Science 2025-12-25 Esmail Gumaan

Multi-head Latent Attention (MLA) is an innovative architecture proposed by DeepSeek, designed to ensure efficient and economical inference by significantly compressing the Key-Value (KV) cache into a latent vector. Compared to MLA,…

Computation and Language · Computer Science 2025-10-06 Tao Ji , Bin Guo , Yuanbin Wu , Qipeng Guo , Lixing Shen , Zhan Chen , Xipeng Qiu , Qi Zhang , Tao Gui

In cloud manufacturing, unmanned aerial vehicles (UAVs) can support both product collection and mobile edge computing (MEC). This joint operation forms a hybrid scheduling problem, where physical logistics decisions are coupled with…

Artificial Intelligence · Computer Science 2026-05-14 Hanwen Zhang , Dusit Niyato , Wei Zhang , Xin Lou , Malcolm Yoke Hean Low

Driven by the increasing demand for low-latency and real-time processing, machine learning applications are steadily migrating toward edge computing platforms, where Field-Programmable Gate Arrays (FPGAs) are widely adopted for their energy…

Hardware Architecture · Computer Science 2026-02-13 Jiahong Bi , Lars Schütze , Jeronimo Castrillon

This paper presents a novel data-driven approach to mitigating employee attrition using machine learning and data engineering techniques. The proposed framework integrates data from various human resources systems and leverages advanced…

Machine Learning · Computer Science 2025-02-26 Naveen Edapurath Vijayan

We introduce the Momentum Transformer, an attention-based deep-learning architecture, which outperforms benchmark time-series momentum and mean-reversion trading strategies. Unlike state-of-the-art Long Short-Term Memory (LSTM)…

Machine Learning · Computer Science 2022-11-24 Kieran Wood , Sven Giegerich , Stephen Roberts , Stefan Zohren

Medical event prediction (MEP) is a fundamental task in the medical domain, which needs to predict medical events, including medications, diagnosis codes, laboratory tests, procedures, outcomes, and so on, according to historical medical…

Machine Learning · Computer Science 2022-05-02 Sicen Liu , Xiaolong Wang , Yang Xiang , Hui Xu , Hui Wang , Buzhou Tang