English
Related papers

Related papers: Evaluating Factor-Wise Auxiliary Dynamics Supervis…

200 papers

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

Machine Learning · Computer Science 2019-09-05 Jacob Rafati , David C. Noelle

This paper proposes a weakly-supervised learning framework for dynamics estimation from human motion. Although there are many solutions to capture pure human motion readily available, their data is not sufficient to analyze quality and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Petrissa Zell , Bodo Rosenhahn , Bastian Wandt

This paper uses Factored Latent Analysis (FLA) to learn a factorized, segmental representation for observations of tracked objects over time. Factored Latent Analysis is latent class analysis in which the observation space is subdivided and…

Machine Learning · Computer Science 2012-07-19 Chris Stauffer

This paper documents a case study in agent-driven autonomous reinforcement learning research for quadruped locomotion. The setting was not a fully self-starting research system. A human provided high-level directives through an agentic…

Robotics · Computer Science 2026-03-31 Nimesh Khandelwal , Shakti S. Gupta

Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computational costs are often prohibitive. Subspace simulation…

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao

Rewards play an essential role in reinforcement learning. In contrast to rule-based game environments with well-defined reward functions, complex real-world robotic applications, such as contact-rich manipulation, lack explicit and…

Machine Learning · Computer Science 2022-05-30 Yuning Wu , Jieliang Luo , Hui Li

We propose a simple drop-in noise-tolerant replacement for the standard finite difference procedure used ubiquitously in blackbox optimization. In our approach, parameter perturbation directions are defined by a family of structured…

Robotics · Computer Science 2018-05-22 Krzysztof Choromanski , Atil Iscen , Vikas Sindhwani , Jie Tan , Erwin Coumans

Humanoid table tennis (TT) demands rapid perception, proactive whole-body motion, and agile footwork under strict timing--capabilities that remain difficult for end-to-end control policies. We propose a reinforcement learning (RL) framework…

Post-training has greatly improved reasoning in frontier vision-language models, yet its gains for perception remain comparatively limited, creating a bottleneck for end-to-end visual reasoning. To investigate this gap, we introduce a…

Computation and Language · Computer Science 2026-05-29 Xueqing Wu , Yu-Chi Lin , Kai-Wei Chang , Nanyun Peng

This work proposed an efficient learning-based framework to learn feedback control policies from human teleoperated demonstrations, which achieved obstacle negotiation, staircase traversal, slipping control and parcel delivery for a tracked…

Robotics · Computer Science 2021-08-11 Jiacheng Gu , Zhibin Li

World model-based policy evaluation is a practical proxy for testing real-world robot control by rolling out candidate actions in action-conditioned video diffusion models. As these models increasingly adopt latent diffusion modeling (LDM),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Nilaksh , Saurav Jha , Artem Zholus , Sarath Chandar

Humanoids operating in real-world workspaces must frequently execute task-driven, short-range movements to SE(2) target poses. To be practical, these transitions must be fast, robust, and energy efficient. While learning-based locomotion…

Robotics · Computer Science 2026-04-23 Pranay Dugar , Mohitvishnu S. Gadde , Jonah Siekmann , Yesh Godse , Aayam Shrestha , Alan Fern

Neuromorphic accelerators offer promising platforms for machine learning (ML) inference by leveraging event-driven, spatially-expanded architectures that naturally exploit unstructured sparsity through co-located memory and compute.…

Humanoid robots offer significant versatility for performing a wide range of tasks, yet their basic ability to walk and run, especially at high velocities, remains a challenge. This letter presents a novel method that combines deep…

Robotics · Computer Science 2024-10-22 Xinming Zhang , Xianghui Wang , Lerong Zhang , Guodong Guo , Xiaoyu Shen , Wei Zhang

Representation disentanglement is an important goal of representation learning that benefits various downstream tasks. To achieve this goal, many unsupervised learning representation disentanglement approaches have been developed. However,…

Machine Learning · Computer Science 2022-09-23 Jiageng Zhu , Hanchen Xie , Wael Abd-Almageed

Long-tailed semi-supervised learning (LTSSL) presents a formidable challenge where models must overcome the scarcity of tail samples while mitigating the noise from unreliable pseudo-labels. Most prior LTSSL methods are designed to train…

Machine Learning · Computer Science 2026-04-09 Zhiyuan Huang , Jiahao Chen , Bing Su

Reinforcement learning for embodied agents is a challenging problem. The accumulated reward to be optimized is often a very rugged function, and gradient methods are impaired by many local optimizers. We demonstrate, in an experimental…

Artificial Intelligence · Computer Science 2016-06-01 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

Reinforcement learning requires manual specification of a reward function to learn a task. While in principle this reward function only needs to specify the task goal, in practice reinforcement learning can be very time-consuming or even…

Machine Learning · Computer Science 2020-02-17 Kristian Hartikainen , Xinyang Geng , Tuomas Haarnoja , Sergey Levine

As a substantial amount of multivariate time series data is being produced by the complex systems in Smart Manufacturing, improved anomaly detection frameworks are needed to reduce the operational risks and the monitoring burden placed on…

Machine Learning · Computer Science 2022-01-25 Tareq Tayeh , Sulaiman Aburakhia , Ryan Myers , Abdallah Shami