English
Related papers

Related papers: Align-Consistency: Improving Non-autoregressive an…

200 papers

Deep learning models have demonstrated exceptional performance across a wide range of computer vision tasks. However, their performance often degrades significantly when faced with distribution shifts, such as domain or dataset changes.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Samuel Barbeau , Pedram Fekri , David Osowiechi , Ali Bahri , Moslem Yazdanpanah , Masih Aminbeidokhti , Christian Desrosiers

Transformer-based sequential recommendation (SR) has been booming in recent years, with the self-attention mechanism as its key component. Self-attention has been widely believed to be able to effectively select those informative and…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Qichen Ye , Yueqi Xie , Jingqi Gao , Shoujin Wang , Jae Boum Kim , Chenyu You , Sunghun Kim

We present Mask CTC, a novel non-autoregressive end-to-end automatic speech recognition (ASR) framework, which generates a sequence by refining outputs of the connectionist temporal classification (CTC). Neural sequence-to-sequence models…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Yosuke Higuchi , Shinji Watanabe , Nanxin Chen , Tetsuji Ogawa , Tetsunori Kobayashi

Cross-domain sequential recommendation (CDSR) aims to uncover and transfer users' sequential preferences across multiple recommendation domains. While significant endeavors have been made, they primarily concentrated on developing advanced…

Information Retrieval · Computer Science 2024-08-22 Mingjia Yin , Hao Wang , Wei Guo , Yong Liu , Zhi Li , Sirui Zhao , Zhen Wang , Defu Lian , Enhong Chen

In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semi-supervised learning framework for leveraging unlabeled data under the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Yassine Ouali , Céline Hudelot , Myriam Tami

Reservoir computing (RC) establishes the basis for the processing of time-series data by exploiting the high-dimensional spatiotemporal response of a recurrent neural network to an input signal. In particular, RC trains only the output…

Machine Learning · Computer Science 2025-10-17 Hayato Nihei , Sou Nobukawa , Yusuke Sakemi , Kazuyuki Aihara

The most successful multi-domain text classification (MDTC) approaches employ the shared-private paradigm to facilitate the enhancement of domain-invariant features through domain-specific attributes. Additionally, they employ adversarial…

Computation and Language · Computer Science 2023-12-20 Juntao Hu , Yuan Wu

In active learning, the focus is mainly on the selection strategy of unlabeled data for enhancing the generalization capability of the next learning cycle. For this, various uncertainty measurement methods have been proposed. On the other…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 SeulGi Hong , Heonjin Ha , Junmo Kim , Min-Kook Choi

Sequential recommendation methods are increasingly important in cutting-edge recommender systems. Through leveraging historical records, the systems can capture user interests and perform recommendations accordingly. State-of-the-art…

Information Retrieval · Computer Science 2023-08-10 Chong Liu , Xiaoyang Liu , Rongqin Zheng , Lixin Zhang , Xiaobo Liang , Juntao Li , Lijun Wu , Min Zhang , Leyu Lin

Generative reward models (GRMs) have emerged as a promising approach for aligning Large Language Models (LLMs) with human preferences by offering greater representational capacity and flexibility than traditional scalar reward models.…

Artificial Intelligence · Computer Science 2026-04-21 Yu Liang , Liangxin Liu , Longzheng Wang , Yan Wang , Yueyang Zhang , Long Xia , Zhiyuan Sun , Daiting Shi

Language models contain ranking-based knowledge and are powerful solvers of in-context ranking tasks. For instance, they may have parametric knowledge about the ordering of countries by size or may be able to rank product reviews by…

Machine Learning · Computer Science 2024-02-06 Niklas Stoehr , Pengxiang Cheng , Jing Wang , Daniel Preotiuc-Pietro , Rajarshi Bhowmik

Automatic Speech Recognition (ASR) is an integral component of modern technology, powering applications such as voice-activated assistants, transcription services, and accessibility tools. Yet ASR systems continue to struggle with the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-20 Mohammad Reza Peyghan , Saman Soleimani Roudi , Saeedreza Zouashkiani , Sajjad Amini , Fatemeh Rajabi , Shahrokh Ghaemmaghami

Unsupervised person re-identification (ReID) aims at learning discriminative identity features for person retrieval without any annotations. Recent advances accomplish this task by leveraging clustering-based pseudo labels, but these pseudo…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 De Cheng , Haichun Tai , Nannan Wang , Zhen Wang , Xinbo Gao

Consistency regularization describes a class of approaches that have yielded ground breaking results in semi-supervised classification problems. Prior work has established the cluster assumption - under which the data distribution consists…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Geoff French , Samuli Laine , Timo Aila , Michal Mackiewicz , Graham Finlayson

Consistency training, which exploits both supervised and unsupervised learning with different augmentations on image, is an effective method of utilizing unlabeled data in semi-supervised learning (SSL) manner. Here, we present another…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Juyong Lee , Seunghyuk Cho

Reinforcement Learning (RL) is a powerful method for controlling dynamic systems, but its learning mechanism can lead to unpredictable actions that undermine the safety of critical systems. Here, we propose RL with Adaptive Regularization…

Machine Learning · Computer Science 2024-11-01 Haozhe Tian , Homayoun Hamedmoghadam , Robert Shorten , Pietro Ferraro

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao

Recent work has aimed to improve LLM generations by filtering out hallucinations, thereby improving the precision of the information in responses. Correctness of a long-form response, however, also depends on the recall of multiple pieces…

Computation and Language · Computer Science 2024-05-24 Raghuveer Thirukovalluru , Yukun Huang , Bhuwan Dhingra

Adaptive cubic regularization (ARC) methods for unconstrained optimization compute steps from linear systems involving a shifted Hessian in the spirit of the Levenberg-Marquardt and trust-region methods. The standard approach consists in…

Optimization and Control · Mathematics 2021-04-01 Jean-Pierre Dussault , Dominique Orban

Recurrent models are a popular choice for video enhancement tasks such as video denoising or super-resolution. In this work, we focus on their stability as dynamical systems and show that they tend to fail catastrophically at inference time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Thomas Tanay , Aivar Sootla , Matteo Maggioni , Puneet K. Dokania , Philip Torr , Ales Leonardis , Gregory Slabaugh