English
Related papers

Related papers: The ObjectFolder Benchmark: Multisensory Learning …

200 papers

The objective of this paper is a model that is able to discover, track and segment multiple moving objects in a video. We make four contributions: First, we introduce an object-centric segmentation model with a depth-ordered layer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyu Xie , Weidi Xie , Andrew Zisserman

As augmented reality technology and hardware become more mature and affordable, researchers have been exploring more intuitive and discoverable interaction techniques for immersive environments. In this paper, we investigate multimodal…

Human-Computer Interaction · Computer Science 2022-12-02 Xiaoyan Zhou , Adam S. Williams , Francisco R. Ortega

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

Open-vocabulary object perception has become an important topic in artificial intelligence, which aims to identify objects with novel classes that have not been seen during training. Under this setting, open-vocabulary object detection…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Haiji Liang , Ruize Han

The emergence of multimodal large language models (MLLMs) has driven breakthroughs in egocentric vision applications. These applications necessitate persistent, context-aware understanding of objects, as users interact with tools in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yuqian Yuan , Ronghao Dang , Long Li , Wentong Li , Dian Jiao , Xin Li , Deli Zhao , Fan Wang , Wenqiao Zhang , Jun Xiao , Yueting Zhuang

The original ImageNet benchmark enforces a single-label assumption, despite many images depicting multiple objects. This leads to label noise and limits the richness of the learning signal. Multi-label annotations more accurately reflect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Junyu Chen , Md Yousuf Harun , Christopher Kanan

There has been increasing interest in smart factories powered by robotics systems to tackle repetitive, laborious tasks. One impactful yet challenging task in robotics-powered smart factory applications is robotic grasping: using robotic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Yuhao Chen , E. Zhixuan Zeng , Maximilian Gilles , Alexander Wong

One of the greatest challenges for detecting moving objects in the solar system from wide-field survey data is determining whether a signal indicates a true object or is due to some other source, like noise. Object verification has relied…

This paper introduces Amazon Robotic Manipulation Benchmark (ARMBench), a large-scale, object-centric benchmark dataset for robotic manipulation in the context of a warehouse. Automation of operations in modern warehouses requires a robotic…

Robotics · Computer Science 2023-03-30 Chaitanya Mitash , Fan Wang , Shiyang Lu , Vikedo Terhuja , Tyler Garaas , Felipe Polido , Manikantan Nambi

We introduce SonicSense, a holistic design of hardware and software to enable rich robot object perception through in-hand acoustic vibration sensing. While previous studies have shown promising results with acoustic sensing for object…

Robotics · Computer Science 2024-10-04 Jiaxun Liu , Boyuan Chen

Object detection has greatly improved over the past decade thanks to advances in deep learning and large-scale datasets. However, detecting objects reflected in surfaces remains an underexplored area. Reflective surfaces are ubiquitous in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yiquan Wu , Zhongtian Wang , You Wu , Ling Huang , Hui Zhou , Shuiwang Li

Recently, by introducing large-scale dataset and strong transformer network, video-language pre-training has shown great success especially for retrieval. Yet, existing video-language transformer models do not explicitly fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Alex Jinpeng Wang , Yixiao Ge , Guanyu Cai , Rui Yan , Xudong Lin , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Patrick Dendorfer , Hamid Rezatofighi , Anton Milan , Javen Shi , Daniel Cremers , Ian Reid , Stefan Roth , Konrad Schindler , Laura Leal-Taixé

We present an attention-based model for recognizing multiple objects in images. The proposed model is a deep recurrent neural network trained with reinforcement learning to attend to the most relevant regions of the input image. We show…

Machine Learning · Computer Science 2015-04-24 Jimmy Ba , Volodymyr Mnih , Koray Kavukcuoglu

This study presents a multisensory machine learning architecture for object recognition by employing a novel dataset that was constructed with the iCub robot, which is equipped with three cameras and a depth sensor. The proposed…

Robotics · Computer Science 2020-09-15 Murat Kirtay , Guido Schillaci , Verena V. Hafner

The majority of artificial intelligence research, as it relates from which to biological senses has been focused on vision. The recent explosion of machine learning and in particular, dee p learning, can be partially attributed to the…

Artificial Intelligence · Computer Science 2018-01-03 Jason Toy

We extensively compare, qualitatively and quantitatively, 40 state-of-the-art models (28 salient object detection, 10 fixation prediction, 1 objectness, and 1 baseline) over 6 challenging datasets for the purpose of benchmarking salient…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Ali Borji , Ming-Ming Cheng , Huaizu Jiang , Jia Li

The goal of building a benchmark (suite of datasets) is to provide a unified protocol for fair evaluation and thus facilitate the evolution of a specific area. Nonetheless, we point out that existing protocols of action recognition could…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Andong Deng , Taojiannan Yang , Chen Chen

Understanding natural-language references to objects in dynamic 3D driving scenes is essential for interactive autonomous systems. In practice, many referring expressions describe targets through recent motion or short-term interactions,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiahong Yu , Ziqi Wang , Hailiang Zhao , Wei Zhai , Xueqiang Yan , Shuiguang Deng

Object counting is a foundational vision task with over a decade of dedicated research, yet state-of-the-art models still fail systematically in the mixed-object setting that dominates real-world applications such as industrial inspection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Corentin Dumery , Niki Amini-Naieni , Shervin Naini , Pascal Fua