English

Optimizing Multimodal LLMs for Egocentric Video Understanding: A Solution for the HD-EPIC VQA Challenge

Computer Vision and Pattern Recognition 2026-01-16 v1 Multimedia Image and Video Processing

Abstract

Multimodal Large Language Models (MLLMs) struggle with complex video QA benchmarks like HD-EPIC VQA due to ambiguous queries/options, poor long-range temporal reasoning, and non-standardized outputs. We propose a framework integrating query/choice pre-processing, domain-specific Qwen2.5-VL fine-tuning, a novel Temporal Chain-of-Thought (T-CoT) prompting for multi-step reasoning, and robust post-processing. This system achieves 41.6% accuracy on HD-EPIC VQA, highlighting the need for holistic pipeline optimization in demanding video understanding. Our code, fine-tuned models are available at https://github.com/YoungSeng/Egocentric-Co-Pilot.

Keywords

Cite

@article{arxiv.2601.10228,
  title  = {Optimizing Multimodal LLMs for Egocentric Video Understanding: A Solution for the HD-EPIC VQA Challenge},
  author = {Sicheng Yang and Yukai Huang and Shitong Sun and Weitong Cai and Jiankang Deng and Jifei Song and Zhensong Zhang},
  journal= {arXiv preprint arXiv:2601.10228},
  year   = {2026}
}

Comments

4 pages, 1 figure, CVPR 2025 EgoVis Workshop, 2nd Place in HD-EPIC Challenge

R2 v1 2026-07-01T09:05:33.896Z