English
Related papers

Related papers: System Report for CCL25-Eval Task 10: Prompt-Drive…

200 papers

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

Computation and Language · Computer Science 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

Standard multi-task benchmarks are essential for developing pretraining models that can generalize to various downstream tasks. Existing benchmarks for natural language processing (NLP) usually focus only on understanding or generating…

Computation and Language · Computer Science 2022-01-19 Jian Guan , Zhuoer Feng , Yamei Chen , Ruilin He , Xiaoxi Mao , Changjie Fan , Minlie Huang

The rapid increase in hate speech on social media has exposed an unprecedented impact on society, making automated methods for detecting such content important. Unlike prior black-box models, we propose a novel transparent method for…

Large language models (LLMs) offer new opportunities for scalable analysis of online discourse. Yet their use in multilingual social science research remains constrained by model size, cost and linguistic bias. We develop a lightweight,…

Computation and Language · Computer Science 2025-12-30 Andrea Nasuto , Stefano Maria Iacus , Francisco Rowe , Devika Jain

Static benchmarks fail to capture LLM vulnerabilities emerging through community experimentation in online forums. We present PrompTrend, a system that collects vulnerability data across platforms and evaluates them using multidimensional…

Cryptography and Security · Computer Science 2025-07-28 Tarek Gasmi , Ramzi Guesmi , Mootez Aloui , Jihene Bennaceur

Entity-level fine-grained sentiment analysis in the financial domain is a crucial subtask of sentiment analysis and currently faces numerous challenges. The primary challenge stems from the lack of high-quality and large-scale annotated…

Computation and Language · Computer Science 2023-09-18 Yinyu Lan , Yanru Wu , Wang Xu , Weiqiang Feng , Youhao Zhang

The last decade has witnessed a surge in the interaction of people through social networking platforms. While there are several positive aspects of these social platforms, the proliferation has led them to become the breeding ground for…

Computation and Language · Computer Science 2022-05-05 Souvic Chakraborty , Parag Dutta , Sumegh Roychowdhury , Animesh Mukherjee

Chinese essay writing and its evaluation are critical in educational contexts, yet the capabilities of Large Language Models (LLMs) in this domain remain largely underexplored. Existing benchmarks often rely on coarse-grained text quality…

Computation and Language · Computer Science 2025-06-04 Fan Gao , Dongyuan Li , Ding Xia , Fei Mi , Yasheng Wang , Lifeng Shang , Baojun Wang

With the continuous emergence of Chinese Large Language Models (LLMs), how to evaluate a model's capabilities has become an increasingly significant issue. The absence of a comprehensive Chinese benchmark that thoroughly assesses a model's…

Computation and Language · Computer Science 2023-10-17 Yanyang Li , Jianqiao Zhao , Duo Zheng , Zi-Yuan Hu , Zhi Chen , Xiaohui Su , Yongfeng Huang , Shijia Huang , Dahua Lin , Michael R. Lyu , Liwei Wang

Domain-Specific Chinese Relation Extraction (DSCRE) aims to extract relations between entities from domain-specific Chinese text. Despite the rapid development of PLMs in recent years, especially LLMs, DSCRE still faces three core…

Computation and Language · Computer Science 2024-04-30 Zhengpeng Shi , Haoran Luo

The introduction of large language models (LLMs) has enhanced automation in software engineering tasks, including in Model Driven Engineering (MDE). However, using general-purpose LLMs for domain modeling has its limitations. One approach…

Software Engineering · Computer Science 2025-07-22 Vladyslav Bulhakov , Giordano d'Aloisio , Claudio Di Sipio , Antinisca Di Marco , Davide Di Ruscio

Sarcasm detection remains a challenge in natural language understanding, as sarcastic intent often relies on subtle cross-modal cues spanning text, speech, and vision. While prior work has primarily focused on textual or visual-textual…

Computation and Language · Computer Science 2025-09-22 Zhu Li , Xiyuan Gao , Yuqing Zhang , Shekhar Nayak , Matt Coler

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge. Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural…

Computation and Language · Computer Science 2023-02-09 Rui Cao , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

Given the rise of conflicts on social media, effective classification models to detect harmful behaviours are essential. Following the garbage-in-garbage-out maxim, machine learning performance depends heavily on training data quality.…

Computation and Language · Computer Science 2025-07-01 Oliver Warke , Joemon M. Jose , Faegheh Hasibi , Jan Breitsohl

With an increasing number of parameters and pre-training data, generative large language models (LLMs) have shown remarkable capabilities to solve tasks with minimal or no task-related examples. Notably, LLMs have been successfully employed…

Computation and Language · Computer Science 2023-10-31 Christoph Leiter , Juri Opitz , Daniel Deutsch , Yang Gao , Rotem Dror , Steffen Eger

This work presents an ontology-integrated large language model (LLM) framework for chemical engineering that unites structured domain knowledge with generative reasoning. The proposed pipeline aligns model training and inference with the…

Machine Learning · Computer Science 2025-12-15 Crystal Su , Kuai Yu , Jingrui Zhang , Mingyuan Shao , Daniel Bauer

When performing tasks like automatic speech recognition or spoken language understanding for a given utterance, access to preceding text or audio provides contextual information can improve performance. Considering the recent advances in…

Computation and Language · Computer Science 2023-12-18 Suwon Shon , Kwangyoun Kim , Prashant Sridhar , Yi-Te Hsu , Shinji Watanabe , Karen Livescu

Large Language Models (LLMs) have shown prominent performance in various downstream tasks and prompt engineering plays a pivotal role in optimizing LLMs' performance. This paper, not only as an overview of current prompt engineering…

Computation and Language · Computer Science 2024-09-18 Haochen Li , Jonathan Leung , Zhiqi Shen

With the rapid evolution of large language models (LLMs), there is a growing concern that they may pose risks or have negative social impacts. Therefore, evaluation of human values alignment is becoming increasingly important. Previous work…

Computation and Language · Computer Science 2023-07-20 Guohai Xu , Jiayi Liu , Ming Yan , Haotian Xu , Jinghui Si , Zhuoran Zhou , Peng Yi , Xing Gao , Jitao Sang , Rong Zhang , Ji Zhang , Chao Peng , Fei Huang , Jingren Zhou

Large language models (LLMs) have demonstrated impressive results on natural language tasks, and security researchers are beginning to employ them in both offensive and defensive systems. In cyber-security, there have been multiple research…

Cryptography and Security · Computer Science 2024-03-05 Jiacen Xu , Jack W. Stokes , Geoff McDonald , Xuesong Bai , David Marshall , Siyue Wang , Adith Swaminathan , Zhou Li