English
Related papers

Related papers: Interactive Dual-Conformer with Scene-Inspired Mas…

200 papers

The task of joint dialog sentiment classification (DSC) and act recognition (DAR) aims to simultaneously predict the sentiment label and act label for each utterance in a dialog. In this paper, we put forward a new framework which models…

Computation and Language · Computer Science 2022-03-09 Bowen Xing , Ivor W. Tsang

Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes…

Sound · Computer Science 2022-06-22 Kayo Nada , Keisuke Imoto , Takao Tsuchiya

In this technical report, a low-complexity deep learning system for acoustic scene classification (ASC) is presented. The proposed system comprises two main phases: (Phase I) Training a teacher network; and (Phase II) training a student…

Sound · Computer Science 2023-05-17 Lam Pham , Dat Ngo , Cam Le , Anahid Jalali , Alexander Schindler

While speech interaction finds widespread utility within the Extended Reality (XR) domain, conventional vocal speech keyword spotting systems continue to grapple with formidable challenges, including suboptimal performance in noisy…

Human-Computer Interaction · Computer Science 2024-01-29 Zhuojiang Cai , Yuhan Ma , Feng Lu

Meetings are a common activity in professional contexts, and it remains challenging to endow vocal assistants with advanced functionalities to facilitate meeting management. In this context, a task like active speaker detection can provide…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Lionel Pibre , Francisco Madrigal , Cyrille Equoy , Frédéric Lerasle , Thomas Pellegrini , Julien Pinquier , Isabelle Ferrané

Most research in synthetic speech detection (SSD) focuses on improving performance on standard noise-free datasets. However, in actual situations, noise interference is usually present, causing significant performance degradation in SSD…

Sound · Computer Science 2024-04-17 Cunhang Fan , Mingming Ding , Jianhua Tao , Ruibo Fu , Jiangyan Yi , Zhengqi Wen , Zhao Lv

In this paper, we consider the problem of reducing the bit error rate of flash-based solid state drives (SSDs) when cells are subject to inter-cell interference (ICI). By observing that the outputs of adjacent victim cells can be correlated…

Information Theory · Computer Science 2019-02-12 Hachem Yassine , Mihai-Alin Badiu , Justin Coon

Incremental learning requires a model to continually learn new tasks from streaming data. However, traditional fine-tuning of a well-trained deep neural network on a new task will dramatically degrade performance on the old task -- a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Can Peng , Kun Zhao , Sam Maksoud , Meng Li , Brian C. Lovell

The Dynamic Saliency Prediction (DSP) task simulates the human selective attention mechanism to perceive the dynamic scene, which is significant and imperative in many vision tasks. Most of existing methods only consider visual cues, while…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Hailong Ning , Bin Zhao , Zhanxuan Hu , Lang He , Ercheng Pei

After pre-training by generating the next word conditional on previous words, the Language Model (LM) acquires the ability of In-Context Learning (ICL) that can learn a new task conditional on the context of the given in-context examples…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Haokun Chen , Xu Yang , Yuhang Huang , Zihan Wu , Jing Wang , Xin Geng

Contextual clinical reasoning demands robust inference grounded in complex, heterogeneous clinical records. While state-of-the-art fine-tuning, in-context learning (ICL), and retrieval-augmented generation (RAG) enable knowledge exposure,…

Quantitative Methods · Quantitative Biology 2026-04-09 Chuang Zhao , Hongke Zhao , Xiaofang Zhou , Xiaomeng Li

Inter-symbol interference (ISI) with heteroscedastic, or state-dependent, noise is a defining feature of molecular communication via diffusion (MCvD). However, such noise variance dependency across ISI states has not been systematically…

Information Theory · Computer Science 2026-03-09 Erencem Ozbey , H. Birkan Yilmaz , Chan-Byoung Chae

Anomalous Sound Detection (ASD) is often formulated as a machine attribute classification task, a strategy necessitated by the common scenario where only normal data is available for training. However, the exhaustive collection of machine…

Sound · Computer Science 2025-09-22 Xin Fang , Guirui Zhong , Qing Wang , Fan Chu , Lei Wang , Mengui Qian , Mingqi Cai , Jiangzhao Wu , Jianqing Gao , Jun Du

Current text classification methods typically encode the text merely into embedding before a naive or complicated classifier, which ignores the suggestive information contained in the label text. As a matter of fact, humans classify…

Computation and Language · Computer Science 2022-09-26 Ziyuan Wang , Hailiang Huang , Songqiao Han

Many deep learning based automated medical image segmentation systems, in reality, face difficulties in deployment due to the cost of massive data annotation and high latency in model iteration. We propose a dynamic interactive learning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mu Tian , Xiaohui Chen , Yi Gao

We introduce and define a novel task-Scene-Aware Visually-Driven Speech Synthesis, aimed at addressing the limitations of existing speech generation models in creating immersive auditory experiences that align with the real physical world.…

Sound · Computer Science 2026-02-04 Chengyuan Ma , Jiawei Jin , Ruijie Xiong , Chunxiang Jin , Canxiang Yan , Wenming Yang

In this paper, we propose a novel framework for speech-image retrieval. We utilize speech-image contrastive (SIC) learning tasks to align speech and image representations at a coarse level and speech-image matching (SIM) learning tasks to…

Computation and Language · Computer Science 2024-09-12 Lifeng Zhou , Yuke Li

Multimodal sentiment analysis (MSA), which supposes to improve text-based sentiment analysis with associated acoustic and visual modalities, is an emerging research area due to its potential applications in Human-Computer Interaction (HCI).…

Multimedia · Computer Science 2022-09-07 Yihe Liu , Ziqi Yuan , Huisheng Mao , Zhiyun Liang , Wanqiuyue Yang , Yuanzhe Qiu , Tie Cheng , Xiaoteng Li , Hua Xu , Kai Gao

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Event-based semantic segmentation (ESS) is a fundamental yet challenging task for event camera sensing. The difficulties in interpreting and annotating event data limit its scalability. While domain adaptation from images to event data can…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lingdong Kong , Youquan Liu , Lai Xing Ng , Benoit R. Cottereau , Wei Tsang Ooi