English
Related papers

Related papers: VLM as Policy: Common-Law Content Moderation Frame…

200 papers

We introduce VideoComp, a benchmark and learning framework for advancing video-text compositionality understanding, aimed at improving vision-language models (VLMs) in fine-grained temporal alignment. Unlike existing benchmarks focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Dahun Kim , AJ Piergiovanni , Ganesh Mallya , Anelia Angelova

Recently, Vision Large Language Models (VLLMs) integrated with vision encoders have shown promising performance in vision understanding. The key of VLLMs is to encode visual content into sequences of visual tokens, enabling VLLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zhuqiang Lu , Zhenfei Yin , Mengwei He , Zhihui Wang , Zicheng Liu , Zhiyong Wang , Kun Hu

We evaluate multimodal large language models (MLLMs) for topic-aligned captioning in financial short-form videos (SVs) by testing joint reasoning over transcripts (T), audio (A), and video (V). Using 624 annotated YouTube SVs, we assess all…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Siddhant Sukhani , Yash Bhardwaj , Riya Bhadani , Veer Kejriwal , Michael Galarnyk , Sudheer Chava

The task of cultivating healthy communication in online communities becomes increasingly urgent, as gaming and social media experiences become progressively more immersive and life-like. We approach the challenge of moderating online…

Computers and Society · Computer Science 2023-06-09 Henrik Axelsen , Johannes Rude Jensen , Sebastian Axelsen , Valdemar Licht , Omri Ross

As Artificial General Intelligence (AGI) becomes increasingly integrated into various facets of human life, ensuring the safety and ethical alignment of such systems is paramount. Previous studies primarily focus on single-modality threats,…

Artificial Intelligence · Computer Science 2025-02-18 Siyin Wang , Xingsong Ye , Qinyuan Cheng , Junwen Duan , Shimin Li , Jinlan Fu , Xipeng Qiu , Xuanjing Huang

Short-video platforms like Douyin and Kwai have become central to adolescent digital life, but they also risk exposing teens to algorithmically amplified harmful content. Despite its societal importance, the scale, mechanisms, and…

Cryptography and Security · Computer Science 2026-05-25 Shaoxuan Zhou , Yafei Sun , Jing Zhang , Xianghang Mi

Visual language models (VLMs) have the potential to transform medical workflows. However, the deployment is limited by sycophancy. Despite this serious threat to patient safety, a systematic benchmark remains lacking. This paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Juangui Xu , Zikun Guo , Jingwei Lv , Hongbin Lin , Shu Yang , Jun Wen , Di Wang , Lijie Hu

The integration of vision-language models into robotic systems constitutes a significant advancement in enabling machines to interact with their surroundings in a more intuitive manner. While VLMs offer rich multimodal reasoning, existing…

Artificial Intelligence · Computer Science 2025-03-03 Hamed Rahimi , Adil Bahaj , Mouad Abrini , Mahdi Khoramshahi , Mounir Ghogho , Mohamed Chetouani

Understanding surveillance video content remains a critical yet underexplored challenge in vision-language research, particularly due to its real-world complexity, irregular event dynamics, and safety-critical implications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bo Liu , Pengfei Qiao , Minhan Ma , Xuange Zhang , Yinan Tang , Peng Xu , Kun Liu , Tongtong Yuan

In recent years, with the significant evolution of multi-modal large models, many recommender researchers realized the potential of multi-modal information for user interest modeling. In industry, a wide-used modeling architecture is a…

Detecting harmful memes is crucial for safeguarding the integrity and harmony of online environments, yet existing detection methods are often resource-intensive, inflexible, and lacking explainability, limiting their applicability in…

Computation and Language · Computer Science 2026-01-29 Fengjun Pan , Xiaobao Wu , Tho Quan , Anh Tuan Luu

Illegal content reporting mechanisms are a key technical and organizational measure through which online platforms address illegal content under the European Union Digital Services Act (DSA). Article 16 requires user notices to be…

Human-Computer Interaction · Computer Science 2026-05-25 Marie-Therese Sekwenz , Shreyan Biswas , Rita Hermann-Gsenger , Ujwal Gadiraju

Streaming vision-language models (VLMs) continuously generate responses given an instruction prompt and an online stream of input frames. This is a core mechanism for real-time visual assistants. Existing VLM frameworks predominantly assess…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Pavan Kumar Anasosalu Vasu , Cem Koc , Fartash Faghri , Chun-Liang Li , Bo Feng , Zhengfeng Lai , Meng Cao , Oncel Tuzel , Hadi Pouransari

Multi-modal large language models (MLLMs) have demonstrated considerable potential across various downstream tasks that require cross-domain knowledge. MLLMs capable of processing videos, known as Video-MLLMs, have attracted broad interest…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiajun Fei , Dian Li , Zhidong Deng , Zekun Wang , Gang Liu , Hui Wang

Video Moment Retrieval (VMR) aims to localize a specific temporal segment within an untrimmed long video given a natural language query. Existing methods often suffer from inadequate training annotations, i.e., the sentence typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Weitong Cai , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu

Existing multilingual vision-language (VL) benchmarks often only cover a handful of languages. Consequently, evaluations of large vision-language models (LVLMs) predominantly target high-resource languages, underscoring the need for…

Computation and Language · Computer Science 2025-02-19 Fabian David Schmidt , Florian Schneider , Chris Biemann , Goran Glavaš

Large language models' (LLMs') outputs are shaped by opaque and frequently-changing company content moderation policies and practices. LLM moderation often takes the form of refusal; models' refusal to produce text about certain topics both…

Computation and Language · Computer Science 2025-10-03 Yunlang Dai , Emma Lurie , Danaé Metaxa , Sorelle A. Friedler

Content moderation (removing or limiting the distribution of posts based on their contents) is one tool social networks use to fight problems such as harassment and disinformation. Manually screening all content is usually impractical given…

Information Retrieval · Computer Science 2021-08-31 Eugene Yang , David D. Lewis , Ophir Frieder

This paper focuses to detect the fake news on the short video platforms. While significant research efforts have been devoted to this task with notable progress in recent years, current detection accuracy remains suboptimal due to the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Junxi Wang , Jize liu , Na Zhang , Yaxiong Wang

As Vision-Language Models (VLMs) move into interactive, multi-turn use, safety concerns intensify for multimodal multi-turn dialogue, which is characterized by concealment of malicious intent, contextual risk accumulation, and cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Guolei Huang , Qinzhi Peng , Gan Xu , Yao Huang , Yuxuan Lu , Yongjun Shen