English
Related papers

Related papers: Contrast Sets for Evaluating Language-Guided Robot…

200 papers

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

With large language models, robots can understand language more flexibly and more capable than ever before. This survey reviews and situates recent literature into a spectrum with two poles: 1) mapping between language and some manually…

Robotics · Computer Science 2024-06-25 Vanya Cohen , Jason Xinyu Liu , Raymond Mooney , Stefanie Tellex , David Watkins

Large-language models are capable of completing a variety of tasks, but remain unpredictable and intractable. Representation engineering seeks to resolve this problem through a new approach utilizing samples of contrasting inputs to detect…

Artificial Intelligence · Computer Science 2025-02-26 Lukasz Bartoszcze , Sarthak Munshi , Bryan Sukidi , Jennifer Yen , Zejia Yang , David Williams-King , Linh Le , Kosi Asuzu , Carsten Maple

Most policy search algorithms require thousands of training episodes to find an effective policy, which is often infeasible with a physical robot. This survey article focuses on the extreme other end of the spectrum: how can a robot adapt…

Modern robotics is gravitating toward increasingly collaborative human robot interaction. Tools such as acceleration policies can naturally support the realization of reactive, adaptive, and compliant robots. These tools require us to model…

Robotics · Computer Science 2017-10-09 Daniel Kappler , Franziska Meier , Nathan Ratliff , Stefan Schaal

The prevailing approach to aligning Large Language Models (LLMs) typically relies on human or AI feedback and assumes access to specific types of preference datasets. In our work, we question the efficacy of such datasets and explore…

Machine Learning · Computer Science 2024-03-19 Hao Sun

Decision support systems for classification tasks are predominantly designed to predict the value of the ground truth labels. However, since their predictions are not perfect, these systems also need to make human experts understand when…

Machine Learning · Computer Science 2024-07-17 Eleni Straitouri , Manuel Gomez Rodriguez

There has been a recent paradigm shift in robotics to data-driven learning for planning and control. Due to large number of experiences required for training, most of these approaches use a self-supervised paradigm: using sensors to measure…

Robotics · Computer Science 2016-10-07 Lerrel Pinto , James Davidson , Abhinav Gupta

Ambiguities are inevitable in human-robot interaction, especially when a robot follows user instructions in a large, shared space. For example, if a user asks the robot to find an object in a home environment with underspecified…

Robotics · Computer Science 2025-04-03 Fethiye Irmak Dogan , Maithili Patel , Weiyu Liu , Iolanda Leite , Sonia Chernova

Method comparisons are essential to provide recommendations and guidance for applied researchers, who often have to choose from a plethora of available approaches. While many comparisons exist in the literature, these are often not neutral…

Methodology · Statistics 2022-12-07 Sarah Friedrich , Tim Friede

Decoding from the output distributions of large language models to produce high-quality text is a complex challenge in language modeling. Various approaches, such as beam search, sampling with temperature, $k-$sampling, nucleus…

Computation and Language · Computer Science 2024-10-22 Esteban Garces Arias , Julian Rodemann , Meimingwei Li , Christian Heumann , Matthias Aßenmacher

Industrial robots typically require very structured and predictable working environments, and explicit programming, in order to perform well. Therefore, expensive and time-consuming engineering work is a major obstruction when mediating…

Robotics · Computer Science 2019-05-28 Martin Karlsson

This work presents a system to benchmark humanoid posture control and balance performances under perturbed conditions. The specific benchmarking scenario consists, for example, of balancing upright stance while performing voluntary…

Robotics · Computer Science 2021-04-27 Vittorio Lippi , Thomas Mergner , Thomas Seel , Christoph Maurer

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

High Energy Physics - Experiment · Physics 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

Although the self-supervised pre-training of transformer models has resulted in the revolutionizing of natural language processing (NLP) applications and the achievement of state-of-the-art results with regard to various benchmarks, this…

Computation and Language · Computer Science 2023-01-26 Xiang Chen , Xin Xie , Zhen Bi , Hongbin Ye , Shumin Deng , Ningyu Zhang , Huajun Chen

Ensuring validation for highly automated driving poses significant obstacles to the widespread adoption of highly automated vehicles. Scenario-based testing offers a potential solution by reducing the homologation effort required for these…

Machine Learning · Computer Science 2023-09-19 Maximilian Zipfl , Moritz Jarosch , J. Marius Zöllner

Program synthesis aims to automatically generate an executable program that conforms to the given specification. Recent advancements have demonstrated that deep neural methodologies and large-scale pretrained language models are highly…

Robotics · Computer Science 2023-12-14 Tianyi Chen , Qidi Wang , Zhen Dong , Liwei Shen , Xin Peng

A command-following robot that serves people in everyday life must continually improve itself in deployment domains with minimal help from its end users, instead of engineers. Previous methods are either difficult to continuously improve…

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

Robotics · Computer Science 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

To enable robots to instruct humans in collaborations, we identify several aspects of language processing that are not commonly studied in this context. These include location, planning, and generation. We suggest evaluations for each task,…

Artificial Intelligence · Computer Science 2021-10-12 Seth Pate , Wei Xu , Ziyi Yang , Maxwell Love , Siddarth Ganguri , Lawson L. S. Wong