English
Related papers

Related papers: L2RU: a Structured State Space Model with prescrib…

200 papers

Recent studies on Learning to Optimize (L2O) suggest a promising path to automating and accelerating the optimization procedure for complicated tasks. Existing L2O models parameterize optimization rules by neural networks, and learn those…

Machine Learning · Computer Science 2022-05-10 Wenqing Zheng , Tianlong Chen , Ting-Kuei Hu , Zhangyang Wang

In this paper, we propose fixed-order set-valued (in the form of l2-norm hyperballs) observers for some classes of nonlinear bounded-error dynamical systems with unknown input signals that simultaneously find bounded hyperballs of states…

Systems and Control · Electrical Eng. & Systems 2022-05-24 Mohammad Khajenejad , Sze Zheng Yong

Despite the promising performance of state space models (SSMs) in long sequence modeling, limitations still exist. Advanced SSMs like S5 and S6 (Mamba) in addressing non-uniform sampling, their recursive structures impede efficient SSM…

Machine Learning · Computer Science 2024-06-11 Biqing Qi , Junqi Gao , Kaiyan Zhang , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou

The Long Range Arena (LRA) benchmark was designed to evaluate the performance of Transformer improvements and alternatives in long-range dependency modeling tasks. The Transformer and its main variants performed poorly on this benchmark,…

Computation and Language · Computer Science 2025-01-28 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

Recurrent neural networks (RNNs) have been drawing much attention with great success in many applications like speech recognition and neural machine translation. Long short-term memory (LSTM) is one of the most popular RNN units in deep…

Computation and Language · Computer Science 2018-12-10 Heeyoul Choi

The paper suggests a generalization of the Sign-Perturbed Sums (SPS) finite sample system identification method for the identification of closed-loop observable stochastic linear systems in state-space form. The solution builds on the…

Systems and Control · Electrical Eng. & Systems 2024-06-11 Szabolcs Szentpéteri , Balázs Csanád Csáji

Unlocking spatial reasoning in Multimodal Large Language Models (MLLMs) is crucial for enabling intelligent interaction with 3D environments. While prior efforts often rely on explicit 3D inputs or specialized model architectures, we ask:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Fangrui Zhu , Hanhui Wang , Yiming Xie , Jing Gu , Tianye Ding , Jianwei Yang , Huaizu Jiang

A fundamental challenge in embodied AI is verifying if agents build internal models of spatial structure or merely learn to mimic task-specific expert trajectories. This is critical as foundational approaches rooted in action-centric tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinzhou Tang , Sidi Liu , Waikit Xiu , Weixing Chen , Keze Wang

Structured latent attribute models (SLAMs) are a special family of discrete latent variable models widely used in social and biological sciences. This paper considers the problem of learning significant attribute patterns from a SLAM with…

Methodology · Statistics 2019-06-07 Yuqi Gu , Gongjun Xu

Neuromorphic models take inspiration from the human brain by adopting bio-plausible neuron models to build alternatives to traditional Machine Learning (ML) and Deep Learning (DL) solutions. The scarce availability of dedicated hardware…

Neural and Evolutionary Computing · Computer Science 2024-07-25 Vittorio Fra , Benedetto Leto , Andrea Pignata , Enrico Macii , Gianvito Urgese

In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this…

Optimization and Control · Mathematics 2013-03-19 Mihaly Petreczky , Rafael Wisniewski , John Leth

We consider the modeling, stability analysis and controller design problems for discrete-time LTI systems with state feedback, when the actuation signal is subject to switching propagation delays, due to e.g. the routing in a multi-hop…

Optimization and Control · Mathematics 2014-01-09 R. M. Jungers , A. D'Innocenzo , M. D. Di Benedetto

This paper addresses the robust ${\cal H}_2$ synthesis problem for linear fractional transformation (LFT) systems subject to structured uncertainty (parameter) and white-noise disturbances. By introducing an intermediate matrix variable, we…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Fen Wu

Emerging applications such as AR are driving demands for machine intelligence capable of processing continuous and/or long-context inputs on local devices. However, currently dominant models based on Transformer architecture suffers from…

Hardware Architecture · Computer Science 2026-03-24 Saptarshi Mitra , Rachid Karami , Haocheng Xu , Sitao Huang , Hyoukjun Kwon

This paper investigates the problem of designing control policies that satisfy high-level specifications described by signal temporal logic (STL) in unknown, stochastic environments. While many existing works concentrate on optimizing the…

Systems and Control · Electrical Eng. & Systems 2024-12-16 Siqi Wang , Shaoyuan Li , Li Yin , Xiang Yin

We consider the problem of estimating the state and unknown input for a large class of nonlinear systems subject to unknown exogenous inputs. The exogenous inputs themselves are modeled as being generated by a nonlinear system subject to…

Systems and Control · Computer Science 2019-02-25 Martin Corless , Ankush Chakrabarty

The light gated recurrent units (Li-GRU) is well-known for achieving impressive results in automatic speech recognition (ASR) tasks while being lighter and faster to train than a standard gated recurrent units (GRU). However, the unbounded…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Adel Moumen , Titouan Parcollet

The need to recognise long-term dependencies in sequential data such as video streams has made Long Short-Term Memory (LSTM) networks a prominent Artificial Intelligence model for many emerging applications. However, the high computational…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Alexandros Kouris , Stylianos I. Venieris , Michail Rizakis , Christos-Savvas Bouganis

We present a framework for learning of modeling uncertainties in Linear Time Invariant (LTI) systems. We propose a methodology to extend the dynamics of an LTI (without uncertainty) with an uncertainty model, based on measured data, to…

Systems and Control · Electrical Eng. & Systems 2023-11-01 Farhad Ghanipoor , Carlos Murguia , Peyman Mohajerin Esfahani , Nathan van de Wouw

This paper addresses the end-to-end sample complexity bound for learning in closed loop the state estimator-based robust H2 controller for an unknown (possibly unstable) Linear Time Invariant (LTI) system, when given a fixed state-feedback…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Yifei Zhang , Sourav Kumar Ukil , Andrei Sperila , Serban Sabau