In this report, we present our champion solutions for the Natural Language Queries and GoalStep tracks of the Ego4D Episodic Memory Challenge at CVPR 2026. Both tracks require accurately localizing temporal segments from long untrimmed egocentric videos. To address these tasks, we propose a reranking-based framework that effectively leverages the strong video-language reasoning capability of multimodal large language model (MLLM) while preserving the efficiency and candidate recall of conventional localization pipelines. Specifically, we first obtain a set of candidate segments from existing localization model OSGNet, and then employ MLLM to select the segment that best matches the given query, thereby refining the final prediction. Ultimately, our method achieved first place in both the Natural Language Queries and GoalStep tracks. Our code can be found at https://github.com/iLearn-Lab/CVPR25-OSGNet.
Cite
@article{arxiv.2605.20818,
title = {OSGNet with MLLM Reranking @ Ego4D Episodic Memory Challenge 2026},
author = {Yisen Feng and Leigang Qu and Haoyu Zhang and Qiaohui Chu and Meng Liu and Xuemeng Song and Weili Guan and Liqiang Nie},
journal= {arXiv preprint arXiv:2605.20818},
year = {2026}
}
Comments
Champion solution for the Natural Language Queries and GoalStep tracks of the Ego4D Challenge at the CVPR EgoVis Workshop 2026