English
Related papers

Related papers: Adversarial Encoder-Multi-Task-Decoder for Multi-S…

200 papers

While vision-and-language models significantly advance in many fields, the challenge of continual learning is unsolved. Parameter-efficient modules like adapters and prompts present a promising way to alleviate catastrophic forgetting.…

Machine Learning · Computer Science 2024-10-16 Hong Li , Zhiquan Tan , Xingyu Li , Weiran Huang

We address the challenging open problem of learning an effective latent space for symbolic music data in generative music modeling. We focus on leveraging adversarial regularization as a flexible and natural mean to imbue variational…

Sound · Computer Science 2020-02-21 Andrea Valenti , Antonio Carta , Davide Bacciu

Unsupervised learning methods have recently shown their competitiveness against supervised training. Typically, these methods use a single objective to train the entire network. But one distinct advantage of unsupervised over supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Zefan Li , Chenxi Liu , Alan Yuille , Bingbing Ni , Wenjun Zhang , Wen Gao

Generative AI, powered by large language models (LLMs), has revolutionized applications across text, audio, images, and video. This study focuses on developing and evaluating encoder-decoder architectures for the American Sign Language…

Machine Learning · Computer Science 2025-01-14 Vouk Praun-Petrovic , Aadhvika Koundinya , Lavanya Prahallad

Vision-language pre-training (VLP) models excel at interpreting both images and text but remain vulnerable to multimodal adversarial examples (AEs). Advancing the generation of transferable AEs, which succeed across unseen models, is key to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Xiaojun Jia , Sensen Gao , Qing Guo , Ke Ma , Yihao Huang , Simeng Qin , Yang Liu , Ivor Tsang Fellow , Xiaochun Cao

This paper describes our system to SemEval-2026 Task 3 Track A Subtask 1 on Dimensional Aspect Sentiment Regression (DimASR). We propose a lightweight and resource-efficient system built entirely on multilingual pre-trained encoders,…

Computation and Language · Computer Science 2026-05-12 Liyuan Huang , Jiawei He , Wutao Shen , Lin Li , Jin Zhang

The use of ML in engineering has grown steadily to support a wide array of applications. Among these methods, deep neural networks have been widely adopted due to their performance and accessibility, but they require large, high-quality…

Machine Learning · Computer Science 2025-10-31 Aidan Furlong , Robert Salko , Xingang Zhao , Xu Wu

The rapid advancements in large language models (LLMs) have significantly enhanced natural language processing capabilities, facilitating the development of AudioLLMs that process and understand speech and audio inputs alongside text.…

Sound · Computer Science 2025-04-22 Wenyu Zhang , Shuo Sun , Bin Wang , Xunlong Zou , Zhuohan Liu , Yingxu He , Geyu Lin , Nancy F. Chen , Ai Ti Aw

In recent years, self-supervised learning (SSL) models have made significant progress in audio deepfake detection (ADD) tasks. However, existing SSL models mainly rely on large-scale real speech for pre-training and lack the learning of…

Sound · Computer Science 2025-09-05 Yunqi Hao , Yihao Chen , Minqiang Xu , Jianbo Zhan , Liang He , Lei Fang , Sian Fang , Lin Liu

A data-driven framework is proposed towards the end of predictive modeling of complex spatio-temporal dynamics, leveraging nested non-linear manifolds. Three levels of neural networks are used, with the goal of predicting the future state…

Computational Physics · Physics 2020-09-14 Jiayang Xu , Karthik Duraisamy

Low-resource automatic speech recognition (ASR) is challenging, as the low-resource target language data cannot well train an ASR model. To solve this issue, meta-learning formulates ASR for each source language into many small ASR tasks…

Computation and Language · Computer Science 2021-04-13 Yubei Xiao , Ke Gong , Pan Zhou , Guolin Zheng , Xiaodan Liang , Liang Lin

In this paper, a robust classification-autoencoder (CAE) is proposed, which has strong ability to recognize outliers and defend adversaries. The main idea is to change the autoencoder from an unsupervised learning model into a classifier,…

Machine Learning · Computer Science 2022-06-08 Lijia Yu , Xiao-Shan Gao

Large language models (LLMs) excel in natural language processing but adapting these LLMs to speech processing tasks efficiently is not straightforward. Direct task-specific fine-tuning is limited by overfitting risks, data requirements,…

Computation and Language · Computer Science 2025-06-02 Maike Züfle , Jan Niehues

In multiple domains such as malware detection, automated driving systems, or fraud detection, classification algorithms are susceptible to being attacked by malicious agents willing to perturb the value of instance covariates to pursue…

Machine Learning · Statistics 2025-07-10 Victor Gallego , Roi Naveiro , Alberto Redondo , David Rios Insua , Fabrizio Ruggeri

Multi-label classification (MLC) is an ML task of predictive modeling in which a data instance can simultaneously belong to multiple classes. MLC is increasingly gaining interest in different application domains such as text mining,…

Machine Learning · Computer Science 2022-11-22 Ana Kostovska , Carola Doerr , Sašo Džeroski , Dragi Kocev , Panče Panov , Tome Eftimov

Future communication networks must address the scarce spectrum to accommodate extensive growth of heterogeneous wireless devices. Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Anu Jagannath , Jithin Jagannath

Automated disease diagnosis using medical image analysis relies on deep learning, often requiring large labeled datasets for supervised model training. Diseases like Acute Myeloid Leukemia (AML) pose challenges due to scarce and costly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Salome Kazeminia , Max Joosten , Dragan Bosnacki , Carsten Marr

Traditional language models, adept at next-token prediction in text sequences, often struggle with transduction tasks between distinct symbolic systems, particularly when parallel data is scarce. Addressing this issue, we introduce…

Machine Learning · Computer Science 2024-02-19 Mohammad Hossein Amani , Nicolas Mario Baldwin , Amin Mansouri , Martin Josifoski , Maxime Peyrard , Robert West

Learning visual feature representations for video analysis is a daunting task that requires a large amount of training samples and a proper generalization framework. Many of the current state of the art methods for video captioning and…

Machine Learning · Computer Science 2018-09-20 Oliver Nina , Washington Garcia , Scott Clouse , Alper Yilmaz

This paper presents an approach to improve the forecast of computational fluid dynamics (CFD) simulations of urban air pollution using deep learning, and most specifically adversarial training. This adversarial approach aims to reduce the…

Machine Learning · Computer Science 2021-04-19 César Quilodrán-Casas , Rossella Arcucci , Laetitia Mottet , Yike Guo , Christopher Pain