English
Related papers

Related papers: Dual Filter: A Transformer-like Inference Architec…

200 papers

This paper proposes a novel neural network architecture, that we call an auto-precoder, and a deep-learning based approach that jointly senses the millimeter wave (mmWave) channel and designs the hybrid precoding matrices with only a few…

Information Theory · Computer Science 2019-05-31 Xiaofeng Li , Ahmed Alkhateeb

Currently, this paper is under review in IEEE. Transformers have intrigued the vision research community with their state-of-the-art performance in natural language processing. With their superior performance, transformers have found their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Preetam Ghosh , Swalpa Kumar Roy , Bikram Koirala , Behnood Rasti , Paul Scheunders

Based on the tensor-based large margin distribution and the nonparallel support tensor machine, we establish a novel classifier for binary classification problem in this paper, termed the Large Margin Distribution based NonParallel Support…

Optimization and Control · Mathematics 2025-07-18 Zhuolin Du , Yisheng Song

The Baum-Welsh algorithm together with its derivatives and variations has been the main technique for learning Hidden Markov Models (HMM) from observational data. We present an HMM learning algorithm based on the non-negative matrix…

Machine Learning · Computer Science 2011-01-11 George Cybenko , Valentino Crespi

We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the…

Statistics Theory · Mathematics 2017-05-19 Luc Lehéricy

In this article, we discuss two algorithms tailored to discrete-time deterministic finite-horizon nonlinear optimal control problems or so-called deterministic trajectory optimization problems. Both algorithms can be derived from an…

Optimization and Control · Mathematics 2024-12-10 Mohammad Mahmoudi Filabadi , Tom Lefebvre , Guillaume Crevecoeur

This paper is about a parallel algorithm for tube-based model predictive control. The proposed control algorithm solves robust model predictive control problems suboptimally, while exploiting their structure. This is achieved by…

Optimization and Control · Mathematics 2019-10-09 Kai Wang , Yuning Jiang , Juraj Oravec , Mario E. Villanueva , Boris Houska

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

Computation and Language · Computer Science 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi

The anti-interference capability of wireless links is a physical layer problem for edge computing. Although convolutional codes have inherent error correction potential due to the redundancy introduced in the data, the performance of the…

Information Theory · Computer Science 2022-11-15 Haoyu Li , Xuan Wang , Tong Liu , Dingyi Fang , Baoying Liu

We examine a constrained Markov decision process under uncertain transition probabilities, with the uncertainty modeled as deviations from observed transition probabilities. We construct the uncertainty set associated with the deviations…

Optimization and Control · Mathematics 2025-04-15 V Varagapriya

We consider active maximum a posteriori (MAP) inference problem for Hidden Markov Models (HMM), where, given an initial MAP estimate of the hidden sequence, we select to label certain states in the sequence to improve the estimation…

Machine Learning · Statistics 2015-09-02 Armen E. Allahverdyan , Aram Galstyan

A real-time communication system with two encoders communicating with a single receiver over separate noisy channels is considered. The two encoders make distinct partial observations of a Markov source. Each encoder must encode its…

Information Theory · Computer Science 2009-10-27 Ashutosh Nayyar , Demosthenis Teneketzis

We present a path planning framework that takes into account the human's safety perception in the presence of a flying robot. The framework addresses two objectives: (i) estimation of the uncertain parameters of the proposed safety…

Pairwise Markov Models (PMMs) extend the wellknown Hidden Markov Models (HMMs). Being significantly more general, PMMs enable several types of processing, like Bayesian filtering or smoothing, similar to those used in HMMs. In this paper,…

Dynamical Systems · Mathematics 2024-02-13 Marc Escudier , Ikram Abdelkefi , Clément Fernandes , Wojciech Pieczynski

We propose a data-driven Model Predictive Control (MPC) framework that employs a transformer encoder to generate multi-step predictions. To handle the nonconvex attention mechanism, we derive difference of convex (DC) representations of the…

Optimization and Control · Mathematics 2026-05-15 Xingxiao Chen , Mark Cannon

In this article, we present a structured Kalman filter associated with the transformation matrix for observable Kalman canonical decomposition from conventional Kalman filter (CKF) in order to generate a more accurate time scale. The…

Systems and Control · Electrical Eng. & Systems 2023-12-08 Yuyue Yan , Takahiro Kawaguchi , Yuichiro Yano , Yuko Hanado , Takayuki Ishizaki

The Hidden Markov Model (HMM) is one of the most widely used statistical models for sequential data analysis. One of the key reasons for this versatility is the ability of HMM to deal with missing data. However, standard HMM learning…

Machine Learning · Statistics 2023-07-04 Binyamin Perets , Mark Kozdoba , Shie Mannor

We consider the problem of simultaneous control and parameter estimation when the model is available only as a differentiable physics simulator. We propose a receding-horizon control framework in which a model predictive control (MPC)…

Optimization and Control · Mathematics 2026-04-07 Alan Williams , Alp Sunol