English
Related papers

Related papers: ChineseHarm-Bench: A Chinese Harmful Content Detec…

200 papers

The proliferation of hate speech on Chinese social media poses urgent societal risks, yet traditional systems struggle to decode context-dependent rhetorical strategies and evolving slang. To bridge this gap, we propose a novel three-stage…

Computation and Language · Computer Science 2025-12-11 Binglin Wu , Jiaxiu Zou , Xianneng Li

The widespread dissemination of toxic online posts is increasingly damaging to society. However, research on detecting toxic language in Chinese has lagged significantly. Existing datasets lack fine-grained annotation of toxic types and…

Computation and Language · Computer Science 2023-05-09 Junyu Lu , Bo Xu , Xiaokun Zhang , Changrong Min , Liang Yang , Hongfei Lin

Chinese essay writing and its evaluation are critical in educational contexts, yet the capabilities of Large Language Models (LLMs) in this domain remain largely underexplored. Existing benchmarks often rely on coarse-grained text quality…

Computation and Language · Computer Science 2025-06-04 Fan Gao , Dongyuan Li , Ding Xia , Fei Mi , Yasheng Wang , Lifeng Shang , Baojun Wang

Chinese Patronizing and Condescending Language (CPCL) is an implicitly discriminatory toxic speech targeting vulnerable groups on Chinese video platforms. The existing dataset lacks user comments, which are a direct reflection of video…

Multimedia · Computer Science 2025-09-25 Jiaxun Yang , Yifei Han , Long Zhang , Yujie Liu , Bin Li , Bo Gao , Yangfan He , Kejia Zhan

The application of large language models (LLMs) has achieved remarkable success in various fields, but their effectiveness in specialized domains like the Chinese insurance industry remains underexplored. The complexity of insurance…

Computation and Language · Computer Science 2025-01-22 Jing Ding , Kai Feng , Binbin Lin , Jiarui Cai , Qiushi Wang , Yu Xie , Xiaojin Zhang , Zhongyu Wei , Wei Chen

Large Language Models (LLMs) are widely applied across various domains due to their powerful text generation capabilities. While LLM-generated texts often resemble human-written ones, their misuse can lead to significant societal risks.…

Computation and Language · Computer Science 2026-03-31 Zhuoshang Wang , Yubing Ren , Guoyu Zhao , Xiaowei Zhu , Hao Li , Yanan Cao

The widespread adoption of large language models (LLMs) across various regions underscores the urgent need to evaluate their alignment with human values. Current benchmarks, however, fall short of effectively uncovering safety…

Computation and Language · Computer Science 2024-05-31 Kexin Huang , Xiangyang Liu , Qianyu Guo , Tianxiang Sun , Jiawei Sun , Yaru Wang , Zeyang Zhou , Yixu Wang , Yan Teng , Xipeng Qiu , Yingchun Wang , Dahua Lin

Large language models (LLMs) offer promising opportunities for organizational research. However, their built-in moderation systems can create problems when researchers try to analyze harmful content, often refusing to follow certain…

Artificial Intelligence · Computer Science 2025-06-23 Mustafa Akben , Aaron Satko

Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. Benefiting from their emergent abilities, LLMs have attracted more and more researchers to study their…

Computation and Language · Computer Science 2024-10-28 Yinghui Li , Haojing Huang , Shirong Ma , Yong Jiang , Yangning Li , Feng Zhou , Hai-Tao Zheng , Qingyu Zhou

While large language models (LLMs) have showcased impressive capabilities, they struggle with addressing legal queries due to the intricate complexities and specialized expertise required in the legal field. In this paper, we introduce…

Computation and Language · Computer Science 2024-06-24 Zhiwei Fei , Songyang Zhang , Xiaoyu Shen , Dawei Zhu , Xiao Wang , Maosong Cao , Fengzhe Zhou , Yining Li , Wenwei Zhang , Dahua Lin , Kai Chen , Jidong Ge

Large language models (LLMs) excel in many diverse applications beyond language generation, e.g., translation, summarization, and sentiment analysis. One intriguing application is in text classification. This becomes pertinent in the realm…

Computation and Language · Computer Science 2024-03-14 Tharindu Kumarage , Amrita Bhattacharjee , Joshua Garland

Large language models (LLMs) have made significant progress in natural language processing tasks and demonstrate considerable potential in the legal domain. However, legal applications demand high standards of accuracy, reliability, and…

Computation and Language · Computer Science 2024-11-27 Haitao Li , You Chen , Qingyao Ai , Yueyue Wu , Ruizhe Zhang , Yiqun Liu

Large language models (LLMs) have become integral to various real-world applications, leveraging massive, web-sourced datasets like Common Crawl, C4, and FineWeb for pretraining. While these datasets provide linguistic data essential for…

Computation and Language · Computer Science 2025-08-14 Sai Krishna Mendu , Harish Yenala , Aditi Gulati , Shanu Kumar , Parag Agrawal

With the rapid evolution of large language models (LLMs), there is a growing concern that they may pose risks or have negative social impacts. Therefore, evaluation of human values alignment is becoming increasingly important. Previous work…

Computation and Language · Computer Science 2023-07-20 Guohai Xu , Jiayi Liu , Ming Yan , Haotian Xu , Jinghui Si , Zhuoran Zhou , Peng Yi , Xing Gao , Jitao Sang , Rong Zhang , Ji Zhang , Chao Peng , Fei Huang , Jingren Zhou

As large language models (LLMs) are increasingly applied to various NLP tasks, their inherent biases are gradually disclosed. Therefore, measuring biases in LLMs is crucial to mitigate its ethical risks. However, most existing bias…

Computation and Language · Computer Science 2025-08-08 Tian Lan , Xiangdong Su , Xu Liu , Ruirui Wang , Ke Chang , Jiang Li , Guanglai Gao

The recent advances in natural language processing (NLP), have led to a new trend of applying large language models (LLMs) to real-world scenarios. While the latest LLMs are astonishingly fluent when interacting with humans, they suffer…

Computation and Language · Computer Science 2023-10-27 Tong Xiang , Liangzhi Li , Wangyue Li , Mingbai Bai , Lu Wei , Bowen Wang , Noa Garcia

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment.…

Computation and Language · Computer Science 2024-03-05 Mohammad Dehghani

While the capabilities of Large Language Models (LLMs) have been studied in both Simplified and Traditional Chinese, it is yet unclear whether LLMs exhibit differential performance when prompted in these two variants of written Chinese.…

Computation and Language · Computer Science 2025-05-29 Hanjia Lyu , Jiebo Luo , Jian Kang , Allison Koenecke

Large Language Models (LLMs) have demonstrated significant potential and effectiveness across multiple application domains. To assess the performance of mainstream LLMs in public security tasks, this study aims to construct a specialized…

Artificial Intelligence · Computer Science 2024-03-22 Xin Tong , Bo Jin , Zhi Lin , Binjun Wang , Ting Yu , Qiang Cheng

Large Language Models (LLMs) are poised to transform healthcare under China's Healthy China 2030 initiative, yet they introduce new ethical and patient-safety challenges. We present a novel 12,000-item Q&A benchmark covering 11 ethics and 9…

Computation and Language · Computer Science 2025-05-13 Mouxiao Bian , Rongzhao Zhang , Chao Ding , Xinwei Peng , Jie Xu