English
Related papers

Related papers: Predicting the intended action using internal simu…

200 papers

This paper presents a teleoperation system that includes robot perception and intent prediction from hand gestures. The perception module identifies the objects present in the robot workspace and the intent prediction module which object…

Robotics · Computer Science 2021-07-06 Yoojin Oh , Marc Toussaint , Jim Mainprice

This paper presents SO-Net, a permutation invariant architecture for deep learning with orderless point clouds. The SO-Net models the spatial distribution of point cloud by building a Self-Organizing Map (SOM). Based on the SOM, SO-Net…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jiaxin Li , Ben M. Chen , Gim Hee Lee

Robotics has long been a field riddled with complex systems architectures whose modules and connections, whether traditional or learning-based, require significant human expertise and prior knowledge. Inspired by large pre-trained language…

Robotics · Computer Science 2022-09-27 Rogerio Bonatti , Sai Vemprala , Shuang Ma , Felipe Frujeri , Shuhang Chen , Ashish Kapoor

In this paper we present a brain-inspired cognitive architecture that incorporates sensory processing, classification, contextual prediction, and emotional tagging. The cognitive architecture is implemented as three modular web-servers,…

Neurons and Cognition · Quantitative Biology 2020-05-19 Leendert A Remmelzwaal , Amit K Mishra , George F R Ellis

Intelligent agents offer a new and exciting way of understanding the world of work. Agent-Based Simulation (ABS), one way of using intelligent agents, carries great potential for progressing our understanding of management practices and how…

Artificial Intelligence · Computer Science 2010-07-05 Peer-Olaf Siebers , Uwe Aickelin , Helen Celia , Chris Clegg

Understanding how humans evaluate robot behavior during human-robot interactions is crucial for developing socially aware robots that behave according to human expectations. While the traditional approach to capturing these evaluations is…

Robotics · Computer Science 2025-12-19 Qiping Zhang , Nathan Tsoi , Mofeed Nagib , Hao-Tien Lewis Chiang , Marynel Vázquez

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to mathematically formalize these abilities using a neural network…

Machine Learning · Computer Science 2018-11-01 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

The term "affordance" denotes the behavioral meaning of objects. We propose a cognitive architecture for the detection of affordances in the visual modality. This model is based on the internal simulation of movement sequences. For each…

Artificial Intelligence · Computer Science 2016-11-02 Wolfram Schenck , Hendrik Hasenbein , Ralf Möller

How can agents learn internal models that veridically represent interactions with the real world is a largely open question. As machine learning is moving towards representations containing not just observational but also interventional…

Machine Learning · Computer Science 2024-07-03 Hamza Keurti , Hsiao-Ru Pan , Michel Besserve , Benjamin F. Grewe , Bernhard Schölkopf

Perceiving the surrounding environment in terms of objects is useful for any general purpose intelligent agent. In this paper, we investigate a fundamental mechanism making object perception possible, namely the identification of…

Artificial Intelligence · Computer Science 2018-10-12 Nicolas Le Hir , Olivier Sigaud , Alban Laflaquière

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur

Pedestrian intention recognition is very important to develop robust and safe autonomous driving (AD) and advanced driver assistance systems (ADAS) functionalities for urban driving. In this work, we develop an end-to-end pedestrian…

Predicting other people's action is key to successful social interactions, enabling us to adjust our own behavior to the consequence of the others' future actions. Studies on action recognition have focused on the importance of individual…

Providing artificial agents with the same computational models of biological systems is a way to understand how intelligent behaviours may emerge. We present an active inference body perception and action model working for the first time in…

Robotics · Computer Science 2021-02-08 Guillermo Oliver , Pablo Lanillos , Gordon Cheng

The study of human-robot interaction is fundamental to the design and use of robotics in real-world applications. Robots will need to predict and adapt to the actions of human collaborators in order to achieve good performance and improve…

Human Action Recognition is an important task of Human Robot Interaction as cooperation between robots and humans requires that artificial agents recognise complex cues from the environment. A promising approach is using trained classifiers…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Frederico Belmonte Klein , Angelo Cangelosi

This paper presents a study of automatic design of neural network architectures for skeleton-based action recognition. Specifically, we encode a skeleton-based action instance into a tensor and carefully define a set of operations to build…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Haoyuan Zhang , Yonghong Hou , Pichao Wang , Zihui Guo , Wanqing Li

Current deep learning architectures show remarkable performance when trained in large-scale, controlled datasets. However, the predictive ability of these architectures significantly decreases when learning new classes incrementally. This…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Kosmas Pinitas , Spyridon Chavlis , Panayiota Poirazi

In this paper, we propose SwarmNet -- a neural network architecture that can learn to predict and imitate the behavior of an observed swarm of agents in a centralized manner. Tested on artificially generated swarm motion data, the network…

Neural and Evolutionary Computing · Computer Science 2020-11-04 Siyu Zhou , Mariano Phielipp , Jorge A. Sefair , Sara I. Walker , Heni Ben Amor

A Perceptron is a fundamental building block of a neural network. The flexibility and scalability of perceptron make it ubiquitous in building intelligent systems. Studies have shown the efficacy of a single neuron in making intelligent…

Quantum Physics · Physics 2025-03-25 Ashutosh Hathidara , Lalit Pandey