English
Related papers

Related papers: Novel Physics-Aware Attention-Based Machine Learni…

200 papers

The capability of the self-attention mechanism to model the long-range dependencies has catapulted its deployment in vision models. Unlike convolution operators, self-attention offers infinite receptive field and enables compute-efficient…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Rajat Saini , Nandan Kumar Jha , Bedanta Das , Sparsh Mittal , C. Krishna Mohan

As global climate change intensifies, accurate weather forecasting has become increasingly important, affecting agriculture, energy management, environmental protection, and daily life. This study introduces a hybrid model combining…

Machine Learning · Computer Science 2024-10-22 Yuhao Gong , Yuchen Zhang , Fei Wang , Chi-Han Lee

Battery safety is paramount for electric vehicles. Early fault diagnosis remains a challenge due to the subtle nature of anomalies and the interference of dynamic operating noise. Existing data-driven methods often suffer from "physical…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Jiong Yang

In orthogonal frequency division multiplexing (OFDM), accurate channel estimation is crucial. Classical signal processing-based approaches, such as linear minimum mean-squared error (LMMSE) estimation, often require second-order statistics…

Signal Processing · Electrical Eng. & Systems 2026-01-28 TaeJun Ha , Chaehyun Jung , Hyeonuk Kim , Jeongwoo Park , Jeonghun Park

Long Short-Term Memory (LSTM) is a prominent recurrent neural network for extracting dependencies from sequential data such as time-series and multi-view data, having achieved impressive results for different visual recognition tasks. A…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Alireza Sepas-Moghaddam , Ali Etemad , Fernando Pereira , Paulo Lobato Correia

Knowledge graph embedding methods learn embeddings of entities and relations in a low dimensional space which can be used for various downstream machine learning tasks such as link prediction and entity matching. Various graph convolutional…

Machine Learning · Computer Science 2021-02-16 Nasrullah Sheikh , Xiao Qin , Berthold Reinwald , Christoph Miksovic , Thomas Gschwind , Paolo Scotton

Machine learning methods are emerging as a universal paradigm for constructing correlative structure-property relationships in materials science based on multimodal characterization. However, this necessitates development of methods for…

Humans can quickly associate stimuli to solve problems in novel contexts. Our novel neural network model learns state representations of facts that can be composed to perform such associative inference. To this end, we augment the LSTM…

Machine Learning · Computer Science 2021-02-24 Imanol Schlag , Tsendsuren Munkhdalai , Jürgen Schmidhuber

This work proposes a novel and efficient quadstream BiLSTM-Attention network, abbreviated as QSLA network, for robust automatic modulation classification (AMC) of wireless signals. The proposed model exploits multiple representations of the…

Machine Learning · Computer Science 2024-08-15 Rohit Udaiwal , Nayan Baishya , Yash Gupta , B. R. Manoj

We consider the problem of predicting edges in a graph from node attributes in an e-commerce setting. Specifically, given nodes labelled with search query text, we want to predict links to related queries that share products. Experiments…

Machine Learning · Computer Science 2020-06-15 Matthew Dippel , Adam Kiezun , Tanay Mehta , Ravi Sundaram , Srikanth Thirumalai , Akshar Varma

Detecting inaccurate smart meters and targeting them for replacement can save significant resources. For this purpose, a novel deep-learning method was developed based on long short-term memory (LSTM) and a modified convolutional neural…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Ming Liu , Dongpeng Liu , Guangyu Sun , Yi Zhao , Duolin Wang , Fangxing Liu , Xiang Fang , Qing He , Dong Xu

In this paper, we propose a coupled spatial-temporal attention (CSTA) model for skeleton-based action recognition, which aims to figure out the most discriminative joints and frames in spatial and temporal domains simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Jiayun Wang

Accurate beam prediction is essential for maintaining reliable links and high spectral efficiency in dynamic low-altitude wireless networks. However, existing approaches often fail to capture the deep correlations across heterogeneous…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Xiaotong Zhao , Yuanhao Cui , Weijie Yuan , Ziye Jia , Heng Liu , Chengwen Xing

In multi-task learning (MTL) for visual scene understanding, it is crucial to transfer useful information between multiple tasks with minimal interferences. In this paper, we propose a novel architecture that effectively transfers…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Sunkyung Kim , Hyesong Choi , Dongbo Min

Non-intrusive Load Monitoring (NILM) is an established technique for effective and cost-efficient electricity consumption management. The method is used to estimate appliance-level power consumption from aggregated power measurements. This…

Systems and Control · Electrical Eng. & Systems 2023-11-16 Amanie Azzam , Saba Sanami , Amir G. Aghdam

Recognition accuracy and response time are both critically essential ahead of building practical electroencephalography (EEG) based brain-computer interface (BCI). Recent approaches, however, have either compromised in the classification…

Signal Processing · Electrical Eng. & Systems 2021-12-03 Yimin Hou , Shuyue Jia , Xiangmin Lun , Shu Zhang , Tao Chen , Fang Wang , Jinglei Lv

Accurate power load forecasting is essential for the efficient operation and planning of electrical grids, particularly given the increased variability and complexity introduced by renewable energy sources. This paper introduces GAT-LSTM, a…

Machine Learning · Computer Science 2025-02-13 Ugochukwu Orji , Çiçek Güven , Dan Stowell

Coupled learning is a contrastive scheme for tuning the properties of individual elements within a network in order to achieve desired functionality of the system. It takes advantage of physics both to learn using local rules and to…

Soft Condensed Matter · Physics 2024-07-09 Lauren E. Altman , Menachem Stern , Andrea J. Liu , Douglas J. Durian

This paper considers a downlink cell-free multiple-input multiple-output (MIMO) network in which multiple multi-antenna access points (APs) serve multiple users via coherent joint transmission. In order to reduce the energy consumption by…

Information Theory · Computer Science 2025-02-04 Liangzhi Wang , Chen Chen , Jie Zhang , Carlo Fischione

With the rapid development of science and technology, the problem of energy load monitoring and decomposition of electrical equipment has been receiving widespread attention from academia and industry. For the purpose of improving the…

Signal Processing · Electrical Eng. & Systems 2021-09-14 Xinxin Zhou , Jingru Feng , Yang Li