English
Related papers

Related papers: Blockwise Sequential Model Learning for Partially …

200 papers

Sequential recommendation models the dynamics of a user's previous behaviors in order to forecast the next item, and has drawn a lot of attention. Transformer-based approaches, which embed items as vectors and use dot-product self-attention…

Information Retrieval · Computer Science 2022-03-08 Ziwei Fan , Zhiwei Liu , Alice Wang , Zahra Nazari , Lei Zheng , Hao Peng , Philip S. Yu

In the present work we propose a Deep Feed Forward network architecture which can be trained according to a sequential learning paradigm, where tasks of increasing difficulty are learned sequentially, yet avoiding catastrophic forgetting.…

Neural and Evolutionary Computing · Computer Science 2017-11-29 Guglielmo Montone , J. Kevin O'Regan , Alexander V. Terekhov

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Markov models, in a…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

Neural network modules conditioned by known priors can be effectively trained and combined to represent systems with nonlinear dynamics. This work explores a novel formulation for data-efficient learning of deep control-oriented nonlinear…

Dynamical Systems · Mathematics 2021-01-07 Elliott Skomski , Soumya Vasisht , Colby Wight , Aaron Tuor , Jan Drgona , Draguna Vrabie

We present a data-efficient framework for solving visuomotor sequential decision-making problems which exploits the combination of reinforcement learning (RL) and latent variable generative models. Our framework trains deep visuomotor…

Robotics · Computer Science 2020-11-09 Ali Ghadirzadeh , Petra Poklukar , Ville Kyrki , Danica Kragic , Mårten Björkman

We consider the problem of steering a system with unknown, stochastic dynamics to satisfy a rich, temporally layered task given as a signal temporal logic formula. We represent the system as a Markov decision process in which the states are…

Systems and Control · Computer Science 2015-10-23 Austin Jones , Derya Aksaray , Zhaodan Kong , Mac Schwager , Calin Belta

Features in machine learning problems are often time-varying and may be related to outputs in an algebraic or dynamical manner. The dynamic nature of these machine learning problems renders current higher order accelerated gradient descent…

Optimization and Control · Mathematics 2019-05-29 Joseph E. Gaudio , Travis E. Gibson , Anuradha M. Annaswamy , Michael A. Bolender

While modern best practices advocate for scalable architectures that support long-range interactions, object-centric models are yet to fully embrace these architectures. In particular, existing object-centric models for handling sequential…

Machine Learning · Computer Science 2024-02-28 Gautam Singh , Yue Wang , Jiawei Yang , Boris Ivanovic , Sungjin Ahn , Marco Pavone , Tong Che

There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example, using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly…

Logic in Computer Science · Computer Science 2025-05-20 Rajarshi Roy , Yash Pote , David Parker , Marta Kwiatkowska

Designing video prediction models that account for the inherent uncertainty of the future is challenging. Most works in the literature are based on stochastic image-autoregressive recurrent networks, which raises several performance and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Jean-Yves Franceschi , Edouard Delasalles , Mickaël Chen , Sylvain Lamprier , Patrick Gallinari

We propose a reinforcement learning based approach to tackle the cost-sensitive learning problem where each input feature has a specific cost. The acquisition process is handled through a stochastic policy which allows features to be…

Machine Learning · Computer Science 2016-07-14 Gabriella Contardo , Ludovic Denoyer , Thierry Artières

Machine teaching addresses the problem of finding the best training data that can guide a learning algorithm to a target model with minimal effort. In conventional settings, a teacher provides data that are consistent with the true data…

Machine Learning · Computer Science 2019-11-04 Tomi Peltola , Mustafa Mert Çelikok , Pedram Daee , Samuel Kaski

In this paper, we introduce variational semantic memory into meta-learning to acquire long-term knowledge for few-shot learning. The variational semantic memory accrues and stores semantic information for the probabilistic inference of…

Machine Learning · Computer Science 2021-07-16 Xiantong Zhen , Yingjun Du , Huan Xiong , Qiang Qiu , Cees G. M. Snoek , Ling Shao

In this paper we address the problem of modeling relational data, which appear in many applications such as social network analysis, recommender systems and bioinformatics. Previous studies either consider latent feature based models but…

Data Structures and Algorithms · Computer Science 2012-04-13 Sheng Gao , Ludovic Denoyer , Patrick Gallinari

Partially observed control problems are a challenging aspect of reinforcement learning. We extend two related, model-free algorithms for continuous control -- deterministic policy gradient and stochastic value gradient -- to solve partially…

Machine Learning · Computer Science 2015-12-15 Nicolas Heess , Jonathan J Hunt , Timothy P Lillicrap , David Silver

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Recent works in Learning-Based Model Predictive Control of dynamical systems show impressive sample complexity performances using criteria from Information Theory to accelerate the learning procedure. However, the sequential exploration…

Machine Learning · Computer Science 2026-02-25 Rémy Hosseinkhan-Boucher , Onofrio Semeraro , Lionel Mathelin

Since sequential information plays an important role in modeling user behaviors, various sequential recommendation methods have been proposed. Methods based on Markov assumption are widely-used, but independently combine several most recent…

Information Retrieval · Computer Science 2016-09-20 Qiang Liu , Shu Wu , Diyi Wang , Zhaokang Li , Liang Wang

We study the optimal design of stealthy attacks against partially observed linear control systems. We first propose a novel likelihood-based detection mechanism derived from the innovation process, based on which we quantify stealthiness…

Optimization and Control · Mathematics 2026-05-12 Haosheng Zhou , Ruimeng Hu

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…