English
Related papers

Related papers: ASAC: Active Sensing using Actor-Critic models

200 papers

Automatic recognition of human activities from time-series sensor data (referred to as HAR) is a growing area of research in ubiquitous computing. Most recent research in the field adopts supervised deep learning paradigms to automate…

Machine Learning · Computer Science 2018-11-21 Alireza Abedin Varamin , Ehsan Abbasnejad , Qinfeng Shi , Damith Ranasinghe , Hamid Rezatofighi

Extracting the rules of real-world multi-agent behaviors is a current challenge in various scientific and engineering fields. Biological agents independently have limited observation and mechanical constraints; however, most of the…

Machine Learning · Computer Science 2023-12-04 Keisuke Fujii , Naoya Takeishi , Yoshinobu Kawahara , Kazuya Takeda

User response prediction, which aims to predict the probability that a user will provide a predefined positive response in a given context such as clicking on an ad or purchasing an item, is crucial to many industrial applications such as…

Machine Learning · Computer Science 2021-08-24 Zekai Chen , Fangtian Zhong , Zhumin Chen , Xiao Zhang , Robert Pless , Xiuzhen Cheng

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

Machine Learning · Computer Science 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Active inference is a mathematical framework for understanding how agents (biological or artificial) interact with their environments, enabling continual adaptation and decision-making. It combines Bayesian inference and free energy…

Artificial Intelligence · Computer Science 2024-10-02 Rithvik Prakki

Current state-of-the-art methods for skeleton-based action recognition are supervised and rely on labels. The reliance is limiting the performance due to the challenges involved in annotation and mislabeled data. Unsupervised methods have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Jingyuan Li , Eli Shlizerman

Sensor-based human activity segmentation and recognition are two important and challenging problems in many real-world applications and they have drawn increasing attention from the deep learning community in recent years. Most of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Furong Duan , Tao Zhu , Jinqiang Wang , Liming Chen , Huansheng Ning , Yaping Wan

Active learning methods are rapidly becoming the integral component of automated experiment workflows in imaging, materials synthesis, and computation. The distinctive aspect of many experimental scenarios is the presence of multiple…

Machine Learning · Computer Science 2022-03-22 Maxim Ziatdinov , Yongtao Liu , Sergei V. Kalinin

Deep learning vision models are typically tailored for specific modalities and often rely on domain-specific assumptions, such as the grid structures used by nearly all existing vision models. In this work, we propose a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Mahmoud Khalil , Ahmad Khalil , Alioune Ngom

Human behavior is a continuous stochastic spatio-temporal process which is governed by semantic actions and affordances as well as latent factors. Therefore, video-based human activity modeling is concerned with a number of tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Judith Bütepage , Hedvig Kjellström , Danica Kragic

We develop a new active learning algorithm for the streaming setting satisfying three important properties: 1) It provably works for any classifier representation and classification problem including those with severe noise. 2) It is…

Machine Learning · Computer Science 2016-01-08 Tzu-Kuo Huang , Alekh Agarwal , Daniel J. Hsu , John Langford , Robert E. Schapire

Under noisy conditions, automatic speech recognition (ASR) can greatly benefit from the addition of visual signals coming from a video of the speaker's face. However, when multiple candidate speakers are visible this traditionally requires…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-12 Otavio Braga , Olivier Siohan

Active learning aims to select samples to be annotated that yield the largest performance improvement for the learning algorithm. Many methods approach this problem by measuring the informativeness of samples and do this based on the…

Machine Learning · Computer Science 2021-08-02 Javad Zolfaghari Bengar , Bogdan Raducanu , Joost van de Weijer

With the increasing deployment of machine learning models in many socially sensitive tasks, there is a growing demand for reliable and trustworthy predictions. One way to accomplish these requirements is to allow a model to abstain from…

Machine Learning · Computer Science 2024-09-19 Andrea Pugnana , Lorenzo Perini , Jesse Davis , Salvatore Ruggieri

Intelligent agents can learn to represent the action spaces of other agents simply by observing them act. Such representations help agents quickly learn to predict the effects of their own actions on the environment and to plan complex…

Machine Learning · Computer Science 2019-02-13 Oleh Rybkin , Karl Pertsch , Konstantinos G. Derpanis , Kostas Daniilidis , Andrew Jaegle

Discriminative learning machines often need a large set of labeled samples for training. Active learning (AL) settings assume that the learner has the freedom to ask an oracle to label its desired samples. Traditional AL algorithms…

Machine Learning · Statistics 2018-05-24 Arash Mehrjou , Mehran Khodabandeh , Greg Mori

Given the complexities inherent in visual scenes, such as object occlusion, a comprehensive understanding often requires observation from multiple viewpoints. Existing multi-viewpoint object-centric learning methods typically employ random…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Yinxuan Huang , Chengmin Gao , Bin Li , Xiangyang Xue

Sequential dynamics are a key feature of many modern recommender systems, which seek to capture the `context' of users' activities on the basis of actions they have performed recently. To capture such patterns, two approaches have…

Information Retrieval · Computer Science 2018-08-30 Wang-Cheng Kang , Julian McAuley

Efficient exploration for an agent is challenging in reinforcement learning (RL). In this paper, a novel actor-critic framework namely virtual action actor-critic (VAAC), is proposed to address the challenge of efficient exploration in RL.…

Machine Learning · Computer Science 2023-11-07 Bumgeun Park , Taeyoung Kim , Quoc-Vinh Lai-Dang , Dongsoo Har

The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience that can produce human-like behavior through reward-based learning. In this study, we test the ability for the AIF to…

Neurons and Cognition · Quantitative Biology 2022-11-21 Zhizhuo Yang , Gabriel J. Diaz , Brett R. Fajen , Reynold Bailey , Alexander Ororbia