English
Related papers

Related papers: Metric-based multimodal meta-learning for human mo…

200 papers

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…

Sound · Computer Science 2022-03-01 Dengxin Dai , Arun Balajee Vasudevan , Jiri Matas , Luc Van Gool

The problem of identifying geometric structure in data is a cornerstone of (unsupervised) learning. As a result, Geometric Representation Learning has been widely applied across scientific and engineering domains. In this work, we…

Machine Learning · Computer Science 2025-06-03 Imran Nasim , Melanie Weber

Utilizing the sensor characteristics of the audio, visible camera, and thermal camera, the robustness of person recognition can be enhanced. Existing multimodal person recognition frameworks are primarily formulated assuming that multimodal…

Multimedia · Computer Science 2022-10-25 Vijay John , Yasutomo Kawanishi

There are several confounding factors that can reduce the accuracy of gait recognition systems. These factors can reduce the distinctiveness, or alter the features used to characterise gait, they include variations in clothing, lighting,…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Christoforos C. Charalambous , Anil A. Bharath

With the emergence of deep learning, metric learning has gained significant popularity in numerous machine learning tasks dealing with complex and large-scale datasets, such as information retrieval, object recognition and recommendation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Imam Mustafa Kamal , Hyerim Bae , Ling Liu

Deep representation learning offers a powerful paradigm for mapping input data onto an organized embedding space and is useful for many music information retrieval tasks. Two central methods for representation learning include deep metric…

Sound · Computer Science 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Sensor-aided beamforming reduces the overheads associated with beam training in millimeter-wave (mmWave) multi-input-multi-output (MIMO) communication systems. Most prior work, though, neglects the challenges associated with establishing…

Signal Processing · Electrical Eng. & Systems 2025-09-17 Kartik Patel , Robert W. Heath

Session-based recommenders, used for making predictions out of users' uninterrupted sequences of actions, are attractive for many applications. Here, for this task we propose using metric learning, where a common embedding space for…

Information Retrieval · Computer Science 2021-01-08 Bartłomiej Twardowski , Paweł Zawistowski , Szymon Zaborowski

With the rapid advancement of technology, different biometric user authentication, and identification systems are emerging. Traditional biometric systems like face, fingerprint, and iris recognition, keystroke dynamics, etc. are prone to…

Human motion characteristics are used to monitor the progression of neurological diseases and mood disorders. Since perceptions of emotions are also interleaved with body posture and movements, emotion recognition from human gait can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Matthew Malek-Podjaski , Fani Deligianni

With the advancement of video analysis technology, the multi-object tracking (MOT) problem in complex scenes involving pedestrians is gaining increasing importance. This challenge primarily involves two key tasks: pedestrian detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jiayi Chen , Chunhua Deng

Current multi-person localisation and tracking systems have an over reliance on the use of appearance models for target re-identification and almost no approaches employ a complete deep learning solution for both objectives. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Gait based biometric aims to discriminate among people by the way or manner they walk. It represents a biometric at distance which has many advantages over other biometric modalities. State-of-the-art methods require a limited cooperation…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Imad Rida

Metric-based meta-learning has attracted a lot of attention due to its effectiveness and efficiency in few-shot learning. Recent studies show that metric scaling plays a crucial role in the performance of metric-based meta-learning…

Machine Learning · Computer Science 2020-08-27 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-lai Chung

Predicting where people can walk in a scene is important for many tasks, including autonomous driving systems and human behavior analysis. Yet learning a computational model for this purpose is challenging due to semantic ambiguity and a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Jin Sun , Hadar Averbuch-Elor , Qianqian Wang , Noah Snavely

Person re-identification is challenging due to the large variations of pose, illumination, occlusion and camera view. Owing to these variations, the pedestrian data is distributed as highly-curved manifolds in the feature space, despite the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-02 Hailin Shi , Yang Yang , Xiangyu Zhu , Shengcai Liao , Zhen Lei , Weishi Zheng , Stan Z. Li

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

We present an imitation learning framework that extracts distinctive legged locomotion behaviors and transitions between them from unlabeled real-world motion data. By automatically discovering behavioral modes and mapping user steering…

Robotics · Computer Science 2026-03-06 Dongho Kang , Jin Cheng , Fatemeh Zargarbashi , Taerim Yoon , Sungjoon Choi , Stelian Coros

Recent urbanization has coincided with the enrichment of geotagged data, such as street view and point-of-interest (POI). Region embedding enhanced by the richer data modalities has enabled researchers and city administrators to understand…

Machine Learning · Computer Science 2021-05-07 Tianyuan Huang , Zhecheng Wang , Hao Sheng , Andrew Y. Ng , Ram Rajagopal

While current deep learning models achieve high performance by learning statistical correlations from vast datasets,which stands in stark contrast to human learning. They lack the flexibility of humans-particularly preverbal infants-to…

Machine Learning · Computer Science 2026-04-24 Kyotaro Ushida , Takayuki Komatsu , Yoshiyuki Ohmura , Yasuo Kuniyoshi