English
Related papers

Related papers: Guided Masked Self-Distillation Modeling for Distr…

200 papers

Human movements in urban areas are essential to understand human-environment interactions. However, activities and associated movements are full of uncertainties due to the complexity of a city. In this paper, we propose a novel…

Information Retrieval · Computer Science 2024-04-24 Yuqin Jiang , Andrey A. Popov , Zhenlong Li , Michael E. Hodgson , Binghu Huang

Event cameras are gaining popularity due to their unique properties, such as their low latency and high dynamic range. One task where these benefits can be crucial is real-time object detection. However, RGB detectors still outperform…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Lei Li , Alexander Liniger , Mario Millhaeusler , Vagia Tsiminaki , Yuanyou Li , Dengxin Dai

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

Autonomous systems have advanced significantly, but challenges persist in accident-prone environments where robust decision-making is crucial. A single vehicle's limited sensor range and obstructed views increase the likelihood of…

Artificial Intelligence · Computer Science 2025-09-24 Rui Liu , Zikang Wang , Peng Gao , Yu Shen , Pratap Tokekar , Ming Lin

Active depth sensors like structured light, lidar, and time-of-flight systems sample the depth of the entire scene uniformly at a fixed scan rate. This leads to limited spatio-temporal resolution where redundant static information is…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Manasi Muglikar , Diederik Paul Moeys , Davide Scaramuzza

It is currently difficult to distill discrete diffusion models. In contrast, continuous diffusion literature has many distillation approaches methods that can reduce sampling steps to a handful. Our method, Discrete Moment Matching…

Machine Learning · Computer Science 2026-03-23 Emiel Hoogeboom , David Ruhe , Jonathan Heek , Thomas Mensink , Tim Salimans

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

Machine Learning · Computer Science 2024-10-14 Peiran Wang , Haohan Wang

Multimodal sentiment analysis (MSA) aims to understand human sentiment through multimodal data. Most MSA efforts are based on the assumption of modality completeness. However, in real-world applications, some practical factors cause…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Mingcheng Li , Dingkang Yang , Xiao Zhao , Shuaibing Wang , Yan Wang , Kun Yang , Mingyang Sun , Dongliang Kou , Ziyun Qian , Lihua Zhang

An event-based state estimation approach for reducing communication in a networked control system is proposed. Multiple distributed sensor-actuator-agents observe a dynamic process and sporadically exchange their measurements and inputs…

Systems and Control · Computer Science 2017-01-30 Sebastian Trimpe

Deep Metric Learning (DML) methods have been proven relevant for visual similarity learning. However, they sometimes lack generalization properties because they are trained often using an inappropriate sample selection strategy or due to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jorge Gonzalez-Zapata , Ivan Reyes-Amezcua , Daniel Flores-Araiza , Mauricio Mendez-Ruiz , Gilberto Ochoa-Ruiz , Andres Mendez-Vazquez

The rise of sixth generation (6G) wireless networks promises to deliver ultra-reliable, low-latency, and energy-efficient communications, sensing, and computing. However, traditional centralized artificial intelligence (AI) paradigms are…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Nhan Thanh Nguyen , Mengyuan Ma , Nir Shlezinger , Junil Choi , Yonina C. Eldar , A. Lee Swindlehurst , Markku Juntti

In this paper, we present a new data-efficient voxel-based self-supervised learning method for event cameras. Our pre-training overcomes the limitations of previous methods, which either sacrifice temporal information by converting event…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Zhenpeng Huang , Chao Li , Hao Chen , Yongjian Deng , Yifeng Geng , Limin Wang

Dataset distillation compresses large datasets into compact synthetic ones to reduce storage and computational costs. Among various approaches, distribution matching (DM)-based methods have attracted attention for their high efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fengli Ran , Xiao Pu , Bo Liu , Xiuli Bi , Bin Xiao

Large machine-learning training datasets can be distilled into small collections of informative synthetic data samples. These synthetic sets support efficient model learning and reduce the communication cost of data sharing. Thus,…

Machine Learning · Computer Science 2024-08-13 William Holland , Chandra Thapa , Sarah Ali Siddiqui , Wei Shao , Seyit Camtepe

The rapid growth of wearable sensor technologies holds substantial promise for the field of personalized and context-aware Human Activity Recognition. Given the inherently decentralized nature of data sources within this domain, the…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

Masked autoencoders have become popular training paradigms for self-supervised visual representation learning. These models randomly mask a portion of the input and reconstruct the masked portion according to the target representations. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xingbin Liu , Jinghao Zhou , Tao Kong , Xianming Lin , Rongrong Ji

Federated learning enables the creation of a powerful centralized model without compromising data privacy of multiple participants. While successful, it does not incorporate the case where each participant independently designs its own…

Machine Learning · Computer Science 2019-10-10 Daliang Li , Junpu Wang

Masked image modeling (MIM) has shown great promise for self-supervised learning (SSL) yet been criticized for learning inefficiency. We believe the insufficient utilization of training signals should be responsible. To alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Xin Ma , Chang Liu , Chunyu Xie , Long Ye , Yafeng Deng , Xiangyang Ji

Wearable sensor-based human activity recognition (HAR) has emerged as a principal research area and is utilized in a variety of applications. Recently, deep learning-based methods have achieved significant improvement in the HAR field with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Sungho Suh , Vitor Fortes Rey , Paul Lukowicz

Semantic segmentation requires a holistic understanding of the physical world, as it assigns semantic labels to spatially continuous and structurally coherent objects rather than to isolated pixels. However, existing data-free knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongxuan Sun , Tao Wu