中文
相关论文

相关论文: Socio-Culturally Aware Evaluation Framework for LL…

200 篇论文

Given the societal impact of unsafe content generated by large language models (LLMs), ensuring that LLM services comply with safety standards is a crucial concern for LLM service providers. Common content moderation methods are limited by…

计算与语言 · 计算机科学 2024-09-06 Jialin Wu , Jiangyi Deng , Shengyuan Pang , Yanjiao Chen , Jiayang Xu , Xinfeng Li , Wenyuan Xu

Large language models (LLMs) have demonstrated substantial commonsense understanding through numerous benchmark evaluations. However, their understanding of cultural commonsense remains largely unexamined. In this paper, we conduct a…

计算与语言 · 计算机科学 2024-05-09 Siqi Shen , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Soujanya Poria , Rada Mihalcea

Recent multimodal large language models have shown promising ability in generating humorous captions for images, yet they still lack stable control over explicit cultural context, making it difficult to jointly maintain image relevance,…

计算与语言 · 计算机科学 2026-04-21 Run Xu , Lu Li , Rongzhao Zhang , Jie Xu

Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection…

社会与信息网络 · 计算机科学 2023-11-15 Luca Luceri , Eric Boniardi , Emilio Ferrara

Machine learning (ML) enabled classification models are becoming increasingly popular for tackling the sheer volume and speed of online misinformation and other content that could be identified as harmful. In building these models, data…

计算机与社会 · 计算机科学 2023-07-12 Andrés Domínguez Hernández , Richard Owen , Dan Saattrup Nielsen , Ryan McConville

Large language models are increasingly used to represent human opinions, values, or beliefs, and their steerability towards these ideals is an active area of research. Existing work focuses predominantly on aligning marginal response…

计算与语言 · 计算机科学 2026-04-22 Tristan Williams , Franziska Weeber , Sebastian Padó , Alan Akbik

In the digital world, memes present a unique challenge for content moderation due to their potential to spread harmful content. Although detection methods have improved, proactive solutions such as intervention are still limited, with…

计算与语言 · 计算机科学 2024-06-11 Prince Jha , Raghav Jain , Konika Mandal , Aman Chadha , Sriparna Saha , Pushpak Bhattacharyya

Large language models (LLMs) are now used worldwide, yet their multimodal understanding and reasoning often degrade outside Western, high-resource settings. We propose MMA-ASIA, a comprehensive framework to evaluate LLMs' cultural awareness…

WARNING: This paper contains examples of offensive materials. To address the proliferation of toxic content on social media, we introduce SMARTER, we introduce SMARTER, a data-efficient two-stage framework for explainable content moderation…

计算与语言 · 计算机科学 2026-04-23 Huy Nghiem , Advik Sachdeva , Hal Daumé

Automatic grading of subjective questions remains a significant challenge in examination assessment due to the diversity in question formats and the open-ended nature of student responses. Existing works primarily focus on a specific type…

计算与语言 · 计算机科学 2025-10-10 Fanwei Zhua , Jiaxuan He , Xiaoxiao Chen , Zulong Chen , Quan Lu , Chenrui Mei

Large language models (LLMs) can support democratic deliberation at scales previously constrained by turn-taking and facilitation bandwidth. Recent work shows that LLM-generated group statements are often preferred over human-mediated…

计算与语言 · 计算机科学 2026-05-27 Wajdi Zaghouani

Modern businesses are increasingly challenged by the time and expense required to generate and assess high-quality content. Human writers face time constraints, and extrinsic evaluations can be costly. While Large Language Models (LLMs)…

人工智能 · 计算机科学 2025-12-10 Thanh Vu , Richi Nayak , Thiru Balasubramaniam

In the field of emotion recognition, the development of high-performance models remains a challenge due to the scarcity of high-quality, diverse emotional datasets. Emotional expressions are inherently subjective, shaped by individual…

计算与语言 · 计算机科学 2025-09-16 Keito Inoshita , Rushia Harada

The increasing use of Large Language Models (LLMs) as proxies for human participants in social science research presents a promising, yet methodologically risky, paradigm shift. While LLMs offer scalability and cost-efficiency, their…

计算与语言 · 计算机科学 2026-02-24 Simon Münker , Nils Schwager , Kai Kugler , Michael Heseltine , Achim Rettinger

The increasing use of synthetic data generated by Large Language Models (LLMs) presents both opportunities and challenges in data-driven applications. While synthetic data provides a cost-effective, scalable alternative to real-world data…

计算与语言 · 计算机科学 2025-07-25 Tevin Atwal , Chan Nam Tieu , Yefeng Yuan , Zhan Shi , Yuhong Liu , Liang Cheng

Traditional online content moderation systems struggle to classify modern multimodal means of communication, such as memes, a highly nuanced and information-dense medium. This task is especially hard in a culturally diverse society like…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Cao Yuxuan , Wu Jiayang , Alistair Cheong Liang Chuen , Bryan Shan Guanrong , Theodore Lee Chong Jen , Sherman Chann Zhi Shen

Research has shown that while large language models (LLMs) can generate their responses based on cultural context, they are not perfect and tend to generalize across cultures. However, when evaluating the cultural bias of a language…

计算与语言 · 计算机科学 2025-12-29 Vitthal Bhandari

Despite the growing utility of Large Language Models (LLMs) for simulating human behavior, the extent to which these synthetic personas accurately reflect world and moral value systems across different cultural conditionings remains…

计算与语言 · 计算机科学 2026-02-02 Candida M. Greco , Lucio La Cava , Andrea Tagarelli

Recent advances in large language models (LLMs) have demonstrated strong performance on simple text classification tasks, frequently under zero-shot settings. However, their efficacy declines when tackling complex social media challenges…

计算与语言 · 计算机科学 2025-04-23 Elyas Meguellati , Assaad Zeghina , Shazia Sadiq , Gianluca Demartini

Large language models (LLMs) are increasingly being utilised across a range of tasks and domains, with a burgeoning interest in their application within the field of journalism. This trend raises concerns due to our limited understanding of…

计算与语言 · 计算机科学 2024-06-18 Filip Trhlik , Pontus Stenetorp