English

First Place Solution to the Multiple-choice Video QA Track of The Second Perception Test Challenge

Computer Vision and Pattern Recognition 2024-09-23 v1 Artificial Intelligence Machine Learning

Abstract

In this report, we present our first-place solution to the Multiple-choice Video Question Answering (QA) track of The Second Perception Test Challenge. This competition posed a complex video understanding task, requiring models to accurately comprehend and answer questions about video content. To address this challenge, we leveraged the powerful QwenVL2 (7B) model and fine-tune it on the provided training set. Additionally, we employed model ensemble strategies and Test Time Augmentation to boost performance. Through continuous optimization, our approach achieved a Top-1 Accuracy of 0.7647 on the leaderboard.

Keywords

Cite

@article{arxiv.2409.13538,
  title  = {First Place Solution to the Multiple-choice Video QA Track of The Second Perception Test Challenge},
  author = {Yingzhe Peng and Yixiao Yuan and Zitian Ao and Huapeng Zhou and Kangqi Wang and Qipeng Zhu and Xu Yang},
  journal= {arXiv preprint arXiv:2409.13538},
  year   = {2024}
}