English
Related papers

Related papers: Language-guided Skill Learning with Temporal Varia…

200 papers

We present a method for learning options from segmented demonstration trajectories. The trajectories are first segmented into skills using nonparametric Bayesian clustering and a reward function for each segment is then learned using…

Machine Learning · Computer Science 2020-01-22 Matthew Cockcroft , Shahil Mawjee , Steven James , Pravesh Ranchod

Whether Reinforcement Learning with Verifiable Rewards (RLVR) endows Large Language Models (LLMs) with new capabilities or merely elicits latent traces remains a central debate. In this work, we align with the former view, proposing a…

Computation and Language · Computer Science 2026-02-10 Zhilin Wang , Yafu Li , Shunkai Zhang , Zhi Wang , Haoran Zhang , Xiaoye Qu , Yu Cheng

Reward-free, unsupervised discovery of skills is an attractive alternative to the bottleneck of hand-designing rewards in environments where task supervision is scarce or expensive. However, current skill pre-training methods, like many RL…

Machine Learning · Computer Science 2022-03-22 Nur Muhammad Shafiullah , Lerrel Pinto

This paper studies the emergence of interpretable categorical features within large language models (LLMs), analyzing their behavior across training checkpoints (time), transformer layers (space), and varying model sizes (scale). Using…

Computation and Language · Computer Science 2025-05-27 Shashata Sawmya , Micah Adler , Nir Shavit

This paper presents a novel approach to enhance autonomous robotic manipulation using the Large Language Model (LLM) for logical inference, converting high-level language commands into sequences of executable motion functions. The proposed…

Robotics · Computer Science 2023-08-30 Haokun Liu , Yaonan Zhu , Kenji Kato , Izumi Kondo , Tadayoshi Aoyama , Yasuhisa Hasegawa

The ability to effectively reuse prior knowledge is a key requirement when building general and flexible Reinforcement Learning (RL) agents. Skill reuse is one of the most common approaches, but current methods have considerable…

Consistent high-quality nursing care is essential for patient safety, yet current nursing education depends on subjective, time-intensive instructor feedback in training future nurses, which limits scalability and efficiency in their…

Artificial Intelligence · Computer Science 2025-09-23 Shen Chang , Dennis Liu , Renran Tian , Kristen L. Swartzell , Stacie L. Klingler , Amy M. Nagle , Nan Kong

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

AI-powered recruitment tools are increasingly adopted in personnel selection, yet they struggle to capture the requisition (req)-specific personal competencies (PCs) that distinguish successful candidates beyond job categories. We propose a…

Computation and Language · Computer Science 2026-04-02 Wanxin Li , Denver McNeney , Nivedita Prabhu , Charlene Zhang , Renee Barr , Matthew Kitching , Khanh Dao Duc , Anthony S. Boyce

Large language models (LLMs) have achieved remarkable success in text-based tasks but often struggle to provide actionable guidance in real-world physical environments. This is because of their inability to recognize their limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Muhammad Saif Ullah Khan , Muhammad Zeshan Afzal , Didier Stricker

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Akrit Mudvari , Yuang Jiang , Leandros Tassiulas

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

Large language Models (LLMs) have demonstrated remarkable skills across various domains. Understanding the mechanisms behind their abilities and implementing controls over them is becoming increasingly important for developing better…

Computation and Language · Computer Science 2025-04-01 Yongce Li , Chung-En Sun , Tsui-Wei Weng

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

We present a framework for robot skill acquisition, which 1) efficiently scale up data generation of language-labelled robot data and 2) effectively distills this data down into a robust multi-task language-conditioned visuo-motor policy.…

Robotics · Computer Science 2023-10-03 Huy Ha , Pete Florence , Shuran Song

Autoregressive large language models (LLMs) compress knowledge from their training data through next-token conditional distributions. This limits tractable querying of this knowledge to start-to-end autoregressive sampling. However, many…

Machine Learning · Computer Science 2024-03-15 Edward J. Hu , Moksh Jain , Eric Elmoznino , Younesse Kaddar , Guillaume Lajoie , Yoshua Bengio , Nikolay Malkin

This paper proposes a novel neuro-symbolic approach for sensor signal-based knowledge discovery, focusing on identifying latent subclasses in time series classification tasks. The approach leverages gradient-based saliency maps derived from…

Artificial Intelligence · Computer Science 2025-11-11 Tim Bohne , Anne-Kathrin Patricia Windler , Martin Atzmueller

Small language models (SLMs) enable low-cost, private, on-device inference, but they often fail on problems that require specialized domain knowledge or multi-step reasoning. Existing approaches for improving reasoning either rely on scale…

Computation and Language · Computer Science 2026-01-08 Kenan Alkiek , David Jurgens , Vinod Vydiswaran

The quality of training data impacts the performance of pre-trained large language models (LMs). Given a fixed budget of tokens, we study how to best select data that leads to good downstream model performance across tasks. We develop a new…

Computation and Language · Computer Science 2023-08-01 Mayee F. Chen , Nicholas Roberts , Kush Bhatia , Jue Wang , Ce Zhang , Frederic Sala , Christopher Ré

In the quest to enable robots to coexist with humans, understanding dynamic situations and selecting appropriate actions based on common sense and affordances are essential. Conventional AI systems face challenges in applying affordance, as…

Artificial Intelligence · Computer Science 2025-04-03 Kazuma Arii , Satoshi Kurihara