English
Related papers

Related papers: Long Sequence Decoder Network for Mobile Sensing

200 papers

Speech denoising (SD) is an important task of many, if not all, modern signal processing chains used in devices and for everyday-life applications. While there are many published and powerful deep neural network (DNN)-based methods for SD,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Konstantinos Drossos , Mikko Heikkinen , Paschalis Tsiaflakis

Accurate modeling of spatiotemporal dynamics is crucial to understanding complex phenomena across science and engineering. However, this task faces a fundamental challenge when the governing equations are unknown and observational data are…

Computational Physics · Physics 2025-12-15 Rui Zhang , Han Wan , Yang Liu , Hao Sun

Visual data such as images and videos are typically modeled as discretizations of inherently continuous, multidimensional signals. Existing continuous-signal models attempt to exploit this fact by modeling the underlying signals of visual…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Eric Nguyen , Karan Goel , Albert Gu , Gordon W. Downs , Preey Shah , Tri Dao , Stephen A. Baccus , Christopher Ré

A proper parametrization of state transition matrices of linear state-space models (SSMs) followed by standard nonlinearities enables them to efficiently learn representations from sequential data, establishing the state-of-the-art on a…

Machine Learning · Computer Science 2022-09-28 Ramin Hasani , Mathias Lechner , Tsun-Hsuan Wang , Makram Chahine , Alexander Amini , Daniela Rus

Although the sequence-to-sequence (encoder-decoder) model is considered the state-of-the-art in deep learning sequence models, there is little research into using this model for recovering missing sensor data. The key challenge is that the…

Machine Learning · Computer Science 2020-02-26 Joel Janek Dabrowski , Ashfaqur Rahman

Automatic speech recognition (ASR) systems developed in recent years have shown promising results with self-attention models (e.g., Transformer and Conformer), which are replacing conventional recurrent neural networks. Meanwhile, a…

Sound · Computer Science 2022-11-01 Koichi Miyazaki , Masato Murata , Tomoki Koriyama

This paper presents a comparison of several Convolutional Neural Network (CNN) models for extracting target signals in highly noisy measurement conditions. Four CNN architectures were investigated. The first comprises six consecutive…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Andrea Faúndez Quezada , Salvatore La Cavera , Sidahmed A Abayzeed

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

Machine Learning · Computer Science 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De

The importance of state estimation in fluid mechanics is well-established; it is required for accomplishing several tasks including design/optimization, active control, and future state prediction. A common tactic in this regards is to rely…

Fluid Dynamics · Physics 2022-03-14 Yash Kumar , Pranav Bahl , Souvik Chakraborty

State space models (SSM) have recently been shown to be very effective as a deep learning layer as a promising alternative to sequence models such as RNNs, CNNs, or Transformers. The first version to show this potential was the S4 model,…

Machine Learning · Computer Science 2022-08-08 Albert Gu , Ankit Gupta , Karan Goel , Christopher Ré

Predicting energy consumption in smart buildings is challenging due to dependencies in sensor data and the variability of environmental conditions. We introduce S4ConvD, a novel convolutional variant of Deep State Space Models (Deep-SSMs),…

Machine Learning · Computer Science 2025-03-03 Melanie Schaller , Bodo Rosenhahn

We propose a learning-based method to reconstruct the local terrain for locomotion with a mobile robot traversing urban environments. Using a stream of depth measurements from the onboard cameras and the robot's trajectory, the algorithm…

Robotics · Computer Science 2022-06-17 David Hoeller , Nikita Rudin , Christopher Choy , Animashree Anandkumar , Marco Hutter

Unsupervised structure learning in high-dimensional time series data has attracted a lot of research interests. For example, segmenting and labelling high dimensional time series can be helpful in behavior understanding and medical…

Machine Learning · Computer Science 2017-05-25 Hao Liu , Haoli Bai , Lirong He , Zenglin Xu

This paper presents a novel identification approach of Koopman models of nonlinear systems with inputs under rather general noise conditions. The method uses deep state-space encoders based on the concept of state reconstructability and an…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Lucian Cristian Iacob , Máté Szécsi , Gerben Izaak Beintema , Maarten Schoukens , Roland Tóth

Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations (NDEs) are popular families of deep learning models for time-series data, each with unique strengths and tradeoffs in modeling power and…

Machine Learning · Computer Science 2021-10-28 Albert Gu , Isys Johnson , Karan Goel , Khaled Saab , Tri Dao , Atri Rudra , Christopher Ré

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Modeling real-world spatio-temporal data is exceptionally difficult due to inherent high dimensionality, measurement noise, partial observations, and often expensive data collection procedures. In this paper, we present Sparse…

Machine Learning · Computer Science 2025-04-02 Mars Liyao Gao , Jan P. Williams , J. Nathan Kutz

Multivariate biosignals are prevalent in many medical domains, such as electroencephalography, polysomnography, and electrocardiography. Modeling spatiotemporal dependencies in multivariate biosignals is challenging due to (1) long-range…

Machine Learning · Computer Science 2023-05-02 Siyi Tang , Jared A. Dunnmon , Liangqiong Qu , Khaled K. Saab , Tina Baykaner , Christopher Lee-Messer , Daniel L. Rubin

This paper explores the problem of training a recurrent neural network from noisy data. While neural network based dynamic predictors perform well with noise-free training data, prediction with noisy inputs during training phase poses a…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Debdipta Goswami

This paper introduces a novel proprioceptive state estimator for legged robots that combines model-based filters and deep neural networks. Recent studies have shown that neural networks such as multi-layer perceptron or recurrent neural…

Robotics · Computer Science 2024-10-28 Donghoon Youm , Hyunsik Oh , Suyoung Choi , Hyeongjun Kim , Jemin Hwangbo