English
Related papers

Related papers: Open-Ended Video Game Glitch Detection with Agenti…

200 papers

Recent advancements in image generation models have enabled the prediction of future Graphical User Interface (GUI) states based on user instructions. However, existing benchmarks primarily focus on general domain visual fidelity, leaving…

Despite remarkable recent progress, existing long-form VideoQA datasets fall short of meeting the criteria for genuine long-form video understanding. This is primarily due to the use of short videos for question curation, and the reliance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hongjie Zhang , Lu Dong , Yi Liu , Yifei Huang , Yali Wang , Limin Wang , Yu Qiao

Video game development increasingly relies on using visual programming languages as the primary way to build video game features. The aim of using visual programming is to move game logic into the hands of game designers, who may not be as…

Software Engineering · Computer Science 2023-09-08 Kalvin Eng , Abram Hindle , Alexander Senchenko

Language model agents excel in long-session planning and reasoning, but existing benchmarks primarily focus on goal-oriented tasks with explicit objectives, neglecting creative adaptation in unfamiliar environments. To address this, we…

Computation and Language · Computer Science 2025-05-27 Cheng Qian , Peixuan Han , Qinyu Luo , Bingxiang He , Xiusi Chen , Yuji Zhang , Hongyi Du , Jiarui Yao , Xiaocheng Yang , Denghui Zhang , Yunzhu Li , Heng Ji

In this work, we enable gamers to share their gaming experience on social media by automatically generating eye-catching highlight reels from their gameplay session Our automation will save time for gamers while increasing audience…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Vignesh Edithal , Le Zhang , Ilia Blank , Imran Junejo

Glitch tokens, inputs that trigger unpredictable or anomalous behavior in Large Language Models (LLMs), pose significant challenges to model reliability and safety. Existing detection methods primarily rely on heuristic embedding patterns…

Artificial Intelligence · Computer Science 2025-11-11 Zihui Wu , Haichang Gao , Ping Wang , Shudong Zhang , Zhaoxiang Liu , Shiguo Lian

Multimodal Large Language Models (MLLMs), are recent advancement of Vision-Language Models (VLMs) that have driven major advances in video understanding. However, their vulnerability to adversarial tampering and manipulations remains…

Despite the remarkable progress of Vision-Language Models (VLMs) in adopting "Thinking-with-Images" capabilities, accurately evaluating the authenticity of their reasoning process remains a critical challenge. Existing benchmarks mainly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xuchen Li , Xuzhao Li , Renjie Pi , Shiyu Hu , Jian Zhao , Jiahui Gao

Large language models can generate plausible game code, but turning this capability into \emph{iterative creative improvement} remains difficult. In practice, single-shot generation often produces brittle runtime behavior, weak accumulation…

Artificial Intelligence · Computer Science 2026-04-23 Hongnan Ma , Han Wang , Shenglin Wang , Tieyue Yin , Yiwei Shi , Yucong Huang , Yingtian Zou , Muning Wen , Mengyue Yang

Understanding the limitations and weaknesses of state-of-the-art models in artificial intelligence is crucial for their improvement and responsible application. In this research, we focus on CLIP, a model renowned for its integration of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Ayush Ranjan , Daniel Wen , Karthik Bhat

Existing vision-language understanding benchmarks largely consist of images of objects in their usual contexts. As a consequence, recent multimodal large language models can perform well with only a shallow visual understanding by relying…

We address the problem of text-guided video temporal grounding, which aims to identify the time interval of a certain event based on a natural language description. Different from most existing methods that only consider RGB images as…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Yi-Wen Chen , Yi-Hsuan Tsai , Ming-Hsuan Yang

Recent advancements in predictive models have demonstrated exceptional capabilities in predicting the future state of objects and scenes. However, the lack of categorization based on inherent characteristics continues to hinder the progress…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yiran Qin , Zhelun Shi , Jiwen Yu , Xijun Wang , Enshen Zhou , Lijun Li , Zhenfei Yin , Xihui Liu , Lu Sheng , Jing Shao , Lei Bai , Wanli Ouyang , Ruimao Zhang

Despite rapid advances in video generative models, robust metrics for evaluating visual and temporal correctness of complex human actions remain elusive. Critically, existing pure-vision encoders and Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xavier Thomas , Youngsun Lim , Ananya Srinivasan , Audrey Zheng , Deepti Ghadiyaram

The ability to perceive how objects change over time is a crucial ingredient in human intelligence. However, current benchmarks cannot faithfully reflect the temporal understanding abilities of video-language models (VidLMs) due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shicheng Li , Lei Li , Shuhuai Ren , Yuanxin Liu , Yi Liu , Rundong Gao , Xu Sun , Lu Hou

Video Models have achieved remarkable success in high-fidelity video generation with coherent motion dynamics. Analogous to the development from text generation to text-based reasoning in language modeling, the development of video models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Cheng Yang , Haiyuan Wan , Yiran Peng , Xin Cheng , Zhaoyang Yu , Jiayi Zhang , Junchi Yu , Xinlei Yu , Xiawu Zheng , Dongzhan Zhou , Chenglin Wu

We present gg-bench, a collection of game environments designed to evaluate general reasoning capabilities in language models. Unlike most static benchmarks, gg-bench is a data generating process where new evaluation instances can be…

Artificial Intelligence · Computer Science 2025-05-13 Vivek Verma , David Huang , William Chen , Dan Klein , Nicholas Tomlin

Recent progress in text-to-video (T2V) generation has enabled the synthesis of visually compelling and temporally coherent videos from natural language. However, these models often fall short in basic physical commonsense, producing outputs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Enes Sanli , Baris Sarper Tezcan , Aykut Erdem , Erkut Erdem

As agentic AI systems increasingly operate autonomously, establishing trust through verifiable evaluation becomes critical. Yet existing benchmarks lack the transparency and auditability needed to assess whether agents behave reliably. We…

Computation and Language · Computer Science 2025-12-02 Hyunjun Kim , Sooyoung Ryu

As robotic systems execute increasingly difficult task sequences, so does the number of ways in which they can fail. Video Anomaly Detection (VAD) frameworks typically focus on singular, low-level kinematic or action failures, struggling to…

Robotics · Computer Science 2026-03-11 Nerea Gallego , Fernando Salanova , Claudio Mannarano , Cristian Mahulea , Eduardo Montijano