English
Related papers

Related papers: SEAR: A Multimodal Dataset for Analyzing AR-LLM-Dr…

200 papers

Detecting synthetic from real speech is increasingly crucial due to the risks of misinformation and identity impersonation. While various datasets for synthetic speech analysis have been developed, they often focus on specific areas,…

Sound · Computer Science 2025-07-18 Zhoulin Ji , Chenhao Lin , Hang Wang , Chao Shen

As large language models (LLMs) continue to advance in capability and influence, ensuring their security and preventing harmful outputs has become crucial. A promising approach to address these concerns involves training models to…

Computation and Language · Computer Science 2024-12-24 Muxi Diao , Rumei Li , Shiyang Liu , Guogang Liao , Jingang Wang , Xunliang Cai , Weiran Xu

Artificial intelligence (AI) technologies should adhere to human norms to better serve our society and avoid disseminating harmful or misleading information, particularly in Conversational Information Retrieval (CIR). Previous work,…

Computation and Language · Computer Science 2023-10-03 Yiyao Yu , Junjie Wang , Yuxiang Zhang , Lin Zhang , Yujiu Yang , Tetsuya Sakai

Multi-purpose Large Language Models (LLMs), a subset of generative Artificial Intelligence (AI), have recently made significant progress. While expectations for LLMs to assist systems engineering (SE) tasks are paramount; the…

Computation and Language · Computer Science 2025-02-17 Taylan G. Topcu , Mohammed Husain , Max Ofsa , Paul Wach

The rapid growth of messaging scams creates an escalating challenge for user security and financial safety. In this paper, we present the \textit{Anticipate, Simulate, Reason} (ASR) generative AI framework to enable users to proactively…

Human-Computer Interaction · Computer Science 2025-07-28 Xue Wen Tan , Kenneth See , Stanley Kok

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

Computation and Language · Computer Science 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

Cognitive behavioral therapy (CBT) is a widely used therapeutic method for guiding individuals toward restructuring their thinking patterns as a means of addressing anxiety, depression, and other challenges. We developed a large language…

Self-supervised learning (SSL) has significantly advanced acoustic representation learning. However, most existing models are optimised for either speech or audio event understanding, resulting in a persistent gap between these two domains.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-05 Xiaoyu Yang , Yifan Yang , Zengrui Jin , Ziyun Cui , Wen Wu , Baoxiang Li , Chao Zhang , Phil Woodland

Speech emotion recognition (SER) is constantly gaining attention in recent years due to its potential applications in diverse fields and thanks to the possibility offered by deep learning technologies. However, recent studies have shown…

Sound · Computer Science 2024-04-30 Nicolas Facchinetti , Federico Simonetta , Stavros Ntalampiras

Training large foundation models using self-supervised objectives on unlabeled data, followed by fine-tuning on downstream tasks, has emerged as a standard procedure. Unfortunately, the efficacy of this approach is often constrained by both…

ASR has achieved remarkable global progress, yet African low-resource languages remain rigorously underrepresented, producing barriers to digital inclusion across the continent with more than +2000 languages. This systematic literature…

Automatic speech recognition (ASR) in clinical dialogue demands robustness to full-duplex interaction, speaker overlap, and low-latency constraints, yet open benchmarks remain scarce. We present MMedFD, the first real-world Chinese…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-29 Hongzhao Chen , XiaoYang Wang , Jing Lan , Hexiao Ding , Yufeng Jiang , MingHui Yang , DanHui Xu , Jun Luo , Nga-Chun Ng , Gerald W. Y. Cheng , Yunlin Mao , Jung Sun Yoo

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis of 3,390…

Cryptography and Security · Computer Science 2025-07-30 Atil Samancioglu

Recent advances in multimodal AI have enabled progress in detecting synthetic and out-of-context content. However, existing efforts largely overlook the intent behind AI-generated images. To fill this gap, we introduce S-HArM, a multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Anastasios Skoularikis , Stefanos-Iordanis Papadopoulos , Symeon Papadopoulos , Panagiotis C. Petrantonakis

Despite their strong performance in multimodal emotion reasoning, existing Multimodal Large Language Models (MLLMs) often overlook the scenarios involving emotion conflicts, where emotional cues from different modalities are inconsistent.…

Artificial Intelligence · Computer Science 2025-10-14 Zhiyuan Han , Beier Zhu , Yanlong Xu , Peipei Song , Xun Yang

We release the EARS (Expressive Anechoic Recordings of Speech) dataset, a high-quality speech dataset comprising 107 speakers from diverse backgrounds, totaling in 100 hours of clean, anechoic speech data. The dataset covers a large range…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Julius Richter , Yi-Chiao Wu , Steven Krenn , Simon Welker , Bunlong Lay , Shinji Watanabe , Alexander Richard , Timo Gerkmann

Natural language processing of conversational speech requires the availability of high-quality transcripts. In this paper, we express our skepticism towards the recent reports of very low Word Error Rates (WERs) achieved by modern Automatic…

The last two years have seen a rapid growth in concerns around the safety of large language models (LLMs). Researchers and practitioners have met these concerns by creating an abundance of datasets for evaluating and improving LLM safety.…

Computation and Language · Computer Science 2025-01-13 Paul Röttger , Fabio Pernisi , Bertie Vidgen , Dirk Hovy

Scams exploiting real-time social engineering -- such as phishing, impersonation, and phone fraud -- remain a persistent and evolving threat across digital platforms. Existing defenses are largely reactive, offering limited protection…

Cryptography and Security · Computer Science 2026-01-21 Ismail Hossain , Sai Puppala , Md Jahangir Alam , Sajedul Talukder

Social Engineering (SE) is one of the most dangerous aspect an attacker can use against a given entity (private citizen, industry, government, ...). In order to perform SE attacks, it is necessary to collect as much information as possible…

Cryptography and Security · Computer Science 2016-09-26 Alan Ferrari , Angelo Consoli