English
Related papers

Related papers: SOCRATES: Text-based Human Search and Approach usi…

200 papers

Understanding how people interact with their surroundings and each other is essential for enabling robots to act in socially compliant and context-aware ways. While 3D Scene Graphs have emerged as a powerful semantic representation for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ermanno Bartoli , Dennis Rotondi , Buwei He , Patric Jensfelt , Kai O. Arras , Iolanda Leite

As robots enter the messy human world so the vital matter of safety takes on a fresh complexion with physical contact becoming inevitable and even desirable. We report on an artistic-exploration of how dancers, working as part of a…

One of the first and foremost non-verbal interactions that humans perform is a handshake. It has an impact on first impressions as touch can convey complex emotions. This makes handshaking an important skill for the repertoire of a social…

Robotics · Computer Science 2021-03-29 Vignesh Prasad , Ruth Stock-Homburg , Jan Peters

Current NLP techniques have been greatly applied in different domains. In this paper, we propose a human-in-the-loop framework for robotic grasping in cluttered scenes, investigating a language interface to the grasping process, which…

Robotics · Computer Science 2022-09-29 Yaoxian Song , Penglei Sun , Pengfei Fang , Linyi Yang , Yanghua Xiao , Yue Zhang

Perceiving the environment through touch is important for robots to reach in cluttered environments, but devising a way to sense without disturbing objects is challenging. This work presents the design and modelling of whisker-inspired…

Robotics · Computer Science 2022-10-25 Michael A. Lin , Emilio Reyes , Jeannette Bohg , Mark R. Cutkosky

The deployment of robot assistants in large indoor spaces has seen significant growth, with escorting tasks becoming a key application. However, most current escorting robots primarily rely on navigation-focused strategies, assuming that…

Robotics · Computer Science 2025-07-01 Siddhartha Mondal , Avik Mitra , Chayan Sarkar

This paper presents the HFUT-LMC team's solution to the WWW 2025 challenge on Text-based Person Anomaly Search (TPAS). The primary objective of this challenge is to accurately identify pedestrians exhibiting either normal or abnormal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Jiayi He , Shengeng Tang , Ao Liu , Lechao Cheng , Jingjing Wu , Yanyan Wei

Text-based person search (TBPS) aims to retrieve the images of the target person from a large image gallery based on a given natural language description. Existing methods are dominated by training models with parallel image-text pairs,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Yang Bai , Jingyao Wang , Min Cao , Chen Chen , Ziqiang Cao , Liqiang Nie , Min Zhang

The paper presents a new method, SearchTrack, for multiple object tracking and segmentation (MOTS). To address the association problem between detected objects, SearchTrack proposes object-customized search and motion-aware features. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Zhong-Min Tsai , Yu-Ju Tsai , Chien-Yao Wang , Hong-Yuan Liao , Youn-Long Lin , Yung-Yu Chuang

Human and robot partners increasingly need to work together to perform tasks as a team. Robots designed for such collaboration must reason about how their task-completion strategies interplay with the behavior and skills of their human team…

Robotics · Computer Science 2022-11-08 Michelle Zhao , Reid Simmons , Henny Admoni

We present an active visual search model for finding objects in unknown environments. The proposed algorithm guides the robot towards the sought object using the relevant stimuli provided by the visual sensors. Existing search strategies…

Robotics · Computer Science 2021-02-08 Amir Rasouli , Pablo Lanillos , Gordon Cheng , John K. Tsotsos

An important factor in developing control models for human-robot collaboration is how acceptable they are to their human partners. One such method for creating acceptable control models is to attempt to mimic human-like behaviour in robots…

Robotics · Computer Science 2022-07-12 Rebeka Kropivšek Leskovar , Tadej Petrič

Conversation is the natural mode for information exchange in daily life, a spoken conversational interaction for search input and output is a logical format for information seeking. However, the conceptualisation of user-system interactions…

Information Retrieval · Computer Science 2019-10-31 Johanne R. Trippas , Damiano Spina , Paul Thomas , Mark Sanderson , Hideo Joho , Lawrence Cavedon

In human-robot cooperation, the robot cooperates with humans to accomplish the task together. Existing approaches assume the human has a specific goal during the cooperation, and the robot infers and acts toward it. However, in real-world…

Robotics · Computer Science 2023-09-15 Lingfeng Tao , Michael Bowman , Jiucai Zhang , Xiaoli Zhang

This paper presents a novel system that enables intelligent robots to exhibit realistic body gestures while communicating with humans. The proposed system consists of a listening model and a speaking model used in corresponding…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Minjie Hua , Fuyuan Shi , Yibing Nan , Kai Wang , Hao Chen , Shiguo Lian

Person-job fit is an essential part of online recruitment platforms in serving various downstream applications like Job Search and Candidate Recommendation. Recently, pretrained large language models have further enhanced the effectiveness…

Computation and Language · Computer Science 2024-01-19 Yihan Cao , Xu Chen , Lun Du , Hao Chen , Qiang Fu , Shi Han , Yushu Du , Yanbin Kang , Guangming Lu , Zi Li

Understanding human behavior is key for robots and intelligent systems that share a space with people. Accordingly, research that enables such systems to perceive, track, learn and predict human behavior as well as to plan and interact with…

A service robot can provide a smoother interaction experience if it has the ability to proactively detect whether a nearby user intends to interact, in order to adapt its behavior e.g. by explicitly showing that it is available to provide a…

Robotics · Computer Science 2024-10-07 Gabriele Abbate , Alessandro Giusti , Viktor Schmuck , Oya Celiktutan , Antonio Paolillo

Vision and language understanding techniques have achieved remarkable progress, but currently it is still difficult to well handle problems involving very fine-grained details. For example, when the robot is told to "bring me the book in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Si Liu , Zitian Wang , Yulu Gao , Lejian Ren , Yue Liao , Guanghui Ren , Bo Li , Shuicheng Yan

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT heavily relies on the…

Computation and Language · Computer Science 2023-11-03 Jingyuan Qi , Zhiyang Xu , Ying Shen , Minqian Liu , Di Jin , Qifan Wang , Lifu Huang