English
Related papers

Related papers: Hybrid Gradient Boosting Trees and Neural Networks…

200 papers

Long-range sequence modeling is a crucial aspect of natural language processing and time series analysis. However, traditional models like Recurrent Neural Networks (RNNs) and Transformers suffer from computational and memory…

Artificial Intelligence · Computer Science 2025-01-15 Mohamed A. Taha

Time series forecasting plays a crucial role in diverse fields, necessitating the development of robust models that can effectively handle complex temporal patterns. In this article, we present a novel feature selection method embedded in…

Machine Learning · Computer Science 2024-01-01 Raquel Espinosa , Fernando Jiménez , José Palma

The Long Short-Term Memory (LSTM) recurrent neural network is capable of processing complex sequential information since it utilizes special gating schemes for learning representations from long input sequences. It has the potential to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Naifan Zhuang , Guo-Jun Qi , The Duc Kieu , Kien A. Hua

Recently, the long short-term memory neural network (LSTM) has attracted wide interest due to its success in many tasks. LSTM architecture consists of a memory cell and three gates, which looks similar to the neuronal networks in the brain.…

Computation and Language · Computer Science 2016-04-25 Peng Qian , Xipeng Qiu , Xuanjing Huang

This study suggests a new strategy for improving congestion control by deploying Long Short-Term Memory (LSTM) networks. LSTMs are recurrent neural networks (RNN), that excel at capturing temporal relationships and patterns in data.…

Signal Processing · Electrical Eng. & Systems 2023-09-20 Atta Ur Rahman , Bibi Saqia , Wali Ullah Khan , Khaled Rabie , Mahmood Alam , Khairullah Khan

Since the advent of deep learning, it has been used to solve various problems using many different architectures. The application of such deep architectures to auditory data is also not uncommon. However, these architectures do not always…

Machine Learning · Computer Science 2014-12-25 Kratarth Goel , Raunaq Vohra

The project aims to research on combining deep learning specifically Long-Short Memory (LSTM) and basic statistics in multiple multistep time series prediction. LSTM can dive into all the pages and learn the general trends of variation in a…

Machine Learning · Statistics 2017-10-13 Chuanyun Zang

We introduce for the first time the utilization of Long short-term memory (LSTM) neural network architectures for the compensation of fiber nonlinearities in digital coherent systems. We conduct numerical simulations considering either…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Stavros Deligiannidis , Adonis Bogris , Charis Mesaritakis , Yannis Kopsinis

Terrain classification is a critical component of any autonomous mobile robot system operating in unknown real-world environments. Over the years, several proprioceptive terrain classification techniques have been introduced to increase…

Robotics · Computer Science 2018-04-04 Abhinav Valada , Wolfram Burgard

With the evolution of power systems as it is becoming more intelligent and interactive system while increasing in flexibility with a larger penetration of renewable energy sources, demand prediction on a short-term resolution will…

Machine Learning · Computer Science 2022-12-20 Saad Emshagin , Wayes Koroni Halim , Rasha Kashef

Residual Networks (ResNets) have become state-of-the-art models in deep learning and several theoretical studies have been devoted to understanding why ResNet works so well. One attractive viewpoint on ResNet is that it is optimizing the…

Machine Learning · Statistics 2018-07-10 Atsushi Nitanda , Taiji Suzuki

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

Recurrent neural networks (RNNs) have many advantages over more traditional system identification techniques. They may be applied to linear and nonlinear systems, and they require fewer modeling assumptions. However, these neural network…

Systems and Control · Electrical Eng. & Systems 2022-04-08 Kaicheng Niu , Mi Zhou , Chaouki T. Abdallah , Mohammad Hayajneh

Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However,…

Machine Learning · Computer Science 2022-01-25 ZhenZhe Ying , Zhuoer Xu , Zhifeng Li , Weiqiang Wang , Changhua Meng

In this work, we first analyze the memory behavior in three recurrent neural networks (RNN) cells; namely, the simple RNN (SRN), the long short-term memory (LSTM) and the gated recurrent unit (GRU), where the memory is defined as a function…

Machine Learning · Computer Science 2019-11-19 Yuanhang Su , C. -C. Jay Kuo

Regional rainfall-runoff modeling is an old but still mostly out-standing problem in Hydrological Sciences. The problem currently is that traditional hydrological models degrade significantly in performance when calibrated for multiple…

Machine Learning · Computer Science 2019-11-12 Frederik Kratzert , Daniel Klotz , Guy Shalev , Günter Klambauer , Sepp Hochreiter , Grey Nearing

In this paper, a novel 3D deep learning network is proposed for brain MR image segmentation with randomized connection, which can decrease the dependency between layers and increase the network capacity. The convolutional LSTM and 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Siqi Bao , Pei Wang , Tony C. W. Mok , Albert C. S. Chung

This paper presents a novel hybrid model that integrates long-short-term memory (LSTM) networks and Graph Neural Networks (GNNs) to significantly enhance the accuracy of stock market predictions. The LSTM component adeptly captures temporal…

Statistical Finance · Quantitative Finance 2025-02-25 Meet Satishbhai Sonani , Atta Badii , Armin Moin

We present XMem, a video object segmentation architecture for long videos with unified feature memory stores inspired by the Atkinson-Shiffrin memory model. Prior work on video object segmentation typically only uses one type of feature…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Ho Kei Cheng , Alexander G. Schwing

Structured, or tabular, data is the most common format in data science. While deep learning models have proven formidable in learning from unstructured data such as images or speech, they are less accurate than simpler approaches when…