English
Related papers

Related papers: Egocentric Video Description based on Temporally-L…

200 papers

Egocentric vision aims to capture and analyse the world from the first-person perspective. We explore the possibilities for egocentric wearable devices to improve and enhance industrial use cases w.r.t. data collection, annotation,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Vivek Chavan , Oliver Heimann , Jörg Krüger

The way people look in terms of facial attributes (ethnicity, hair color, facial hair, etc.) and the clothes or accessories they wear (sunglasses, hat, hoodies, etc.) is highly dependent on geo-location and weather condition, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-24 Jing Wang , Yu Cheng , Rogerio Schmidt Feris

Perceiving the world from both egocentric (first-person) and exocentric (third-person) perspectives is fundamental to human cognition, enabling rich and complementary understanding of dynamic environments. In recent years, allowing the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yuping He , Yifei Huang , Guo Chen , Lidong Lu , Baoqi Pei , Jilan Xu , Tong Lu , Yoichi Sato

Visual lifelogging consists of acquiring images that capture the daily experiences of the user by wearing a camera over a long period of time. The pictures taken offer considerable potential for knowledge mining concerning how people live…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Marc Bolaños , Mariella Dimiccoli , Petia Radeva

The availability and use of egocentric data are rapidly increasing due to the growing use of wearable cameras. Our aim is to study the effect (positive, neutral or negative) of egocentric images or events on an observer. Given egocentric…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Estefania Talavera , Petia Radeva , Nicolai Petkov

In egocentric videos, actions occur in quick succession. We capitalise on the action's temporal context and propose a method that learns to attend to surrounding actions in order to improve recognition performance. To incorporate the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Evangelos Kazakos , Jaesung Huh , Arsha Nagrani , Andrew Zisserman , Dima Damen

While wearable cameras are becoming increasingly popular, locating relevant information in large unstructured collections of egocentric images is still a tedious and time consuming processes. This paper addresses the problem of organizing…

Artificial Intelligence · Computer Science 2016-11-03 Mariella Dimiccoli , Marc Bolaños , Estefania Talavera , Maedeh Aghaei , Stavri G. Nikolov , Petia Radeva

We consider the problem of localizing visitors in a cultural site from egocentric (first person) images. Localization information can be useful both to assist the user during his visit (e.g., by suggesting where to go and what to see next)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Francesco Ragusa , Antonino Furnari , Sebastiano Battiato , Giovanni Signorello , Giovanni Maria Farinella

Egocentric assistants often rely on first-person view data to capture user behavior and context for personalized services. Since different users exhibit distinct habits, preferences, and routines, such personalization is essential for truly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yanshuo Wang , Yuan Xu , Xuesong Li , Jie Hong , Yizhou Wang , Chang Wen Chen , Wentao Zhu

In a wearable camera video, we see what the camera wearer sees. While this makes it easy to know roughly what he chose to look at, it does not immediately reveal when he was engaged with the environment. Specifically, at what moments did…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Yu-Chuan Su , Kristen Grauman

We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 931 unique camera…

The automatic discovery of behaviour is of high importance when aiming to assess and improve the quality of life of people. Egocentric images offer a rich and objective description of the daily life of the camera wearer. This work proposes…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Martin Menchon , Estefania Talavera , Jose M Massa , Petia Radeva

We present a method to analyze images taken from a passive egocentric wearable camera along with the contextual information, such as time and day of week, to learn and predict everyday activities of an individual. We collected a dataset of…

Computer Vision and Pattern Recognition · Computer Science 2015-10-07 Daniel Castro , Steven Hickson , Vinay Bettadapura , Edison Thomaz , Gregory Abowd , Henrik Christensen , Irfan Essa

Lifelogging devices are spreading faster everyday. This growth can represent great benefits to develop methods for extraction of meaningful information about the user wearing the device and his/her environment. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2015-07-09 Marc Bolaños , Petia Radeva

Thanks to the low operational cost and large storage capacity of smartphones and wearable devices, people are recording many hours of daily activities, sport actions and home videos. These videos, also known as egocentric videos, are…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Washington Luis Souza Ramos , Michel Melo Silva , Mario Fernando Montenegro Campos , Erickson Rangel Nascimento

Humans naturally perceive surrounding scenes by unifying sound and sight in a first-person view. Likewise, machines are advanced to approach human intelligence by learning with multisensory inputs from an egocentric perspective. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Chao Huang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Collecting large-scale egocentric video datasets with dense spatial and temporal annotations is costly, slow, and often constrained by environmental biases, privacy constraints, and limited coverage of interaction patterns. While synthetic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Rosario Leonardi , Francesco Ragusa , Daniele Materia , Alessandro Passanisi , James Fort , Jakob Engel , Giovanni Maria Farinella

With the rapid increase of users of wearable cameras in recent years and of the amount of data they produce, there is a strong need for automatic retrieval and summarization techniques. This work addresses the problem of automatically…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Aniol Lidon , Marc Bolaños , Mariella Dimiccoli , Petia Radeva , Maite Garolera , Xavier Giró-i-Nieto

Egocentric videos are characterised by their ability to have the first person view. With the popularity of Google Glass and GoPro, use of egocentric videos is on the rise. Recognizing action of the wearer from egocentric videos is an…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Suriya Singh , Chetan Arora , C. V. Jawahar

The emergence of low-cost personal mobiles devices and wearable cameras and the increasing storage capacity of video-sharing websites have pushed forward a growing interest towards first-person videos. Since most of the recorded videos…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Michel Melo Silva , Washington Luis Souza Ramos , Joao Pedro Klock Ferreira , Mario Fernando Montenegro Campos , Erickson Rangel Nascimento