English
Related papers

Related papers: Preference-based training framework for automatic …

200 papers

Recent advances have made long-form report-generating systems widely available. This has prompted evaluation frameworks that use LLM-as-judge protocols and claim verification, along with meta-evaluation frameworks that seek to validate…

Recent generative models have significantly advanced speech restoration tasks, yet their training objectives often misalign with human perceptual preferences, resulting in suboptimal quality. While post-training alignment has proven…

Sound · Computer Science 2025-11-18 Junan Zhang , Xueyao Zhang , Jing Yang , Yuancheng Wang , Fan Fan , Zhizheng Wu

Query rewriting (QR) systems are widely used to reduce the friction caused by errors in a spoken language understanding pipeline. However, the underlying supervised models require a large number of labeled pairs, and these pairs are hard…

Computation and Language · Computer Science 2020-12-22 Yunmo Chen , Sixing Lu , Fan Yang , Xiaojiang Huang , Xing Fan , Chenlei Guo

In online conferencing applications, estimating the perceived quality of an audio signal is crucial to ensure high quality of experience for the end user. The most reliable way to assess the quality of a speech signal is through human…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-24 Bastiaan Tamm , Rik Vandenberghe , Hugo Van hamme

This paper presents an algorithm for modulation-domain speech enhancement using a Kalman filter. The proposed estimator jointly models the estimated dynamics of the spectral amplitudes of speech and noise to obtain an MMSE estimation of the…

Sound · Computer Science 2018-02-01 Yu Wang , Mike Brookes

Preference learning methods such as Direct Preference Optimization (DPO) are known to induce reliance on spurious correlations, leading to sycophancy and length bias in today's language models and potentially severe goal misgeneralization…

Machine Learning · Computer Science 2026-05-13 Christian Moya , Alex Semendinger , Guang Lin , Elliott Thornley

In recent years, there have been amazing advances in deep learning methods for machine reading. In machine reading, the machine reader has to extract the answer from the given ground truth paragraph. Recently, the state-of-the-art machine…

Computation and Language · Computer Science 2018-04-13 Phu Mon Htut , Samuel R. Bowman , Kyunghyun Cho

In this study, we present an approach to train a single speech enhancement network that can perform both personalized and non-personalized speech enhancement. This is achieved by incorporating a frame-wise conditioning input that specifies…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-24 Zhepei Wang , Ritwik Giri , Devansh Shah , Jean-Marc Valin , Michael M. Goodwin , Paris Smaragdis

Traditional language model alignment methods, such as Direct Preference Optimization (DPO), are limited by their dependence on static, pre-collected paired preference data, which hampers their adaptability and practical applicability. To…

Computation and Language · Computer Science 2024-06-03 Yueqin Yin , Zhendong Wang , Yujia Xie , Weizhu Chen , Mingyuan Zhou

Image Quality Assessment algorithms predict a quality score for a pristine or distorted input image, such that it correlates with human opinion. Traditional methods required a non-distorted "reference" version of the input image to compare…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Subhayan Mukherjee , Giuseppe Valenzise , Irene Cheng

The next token prediction loss is the dominant self-supervised training objective for large language models and has achieved promising results in a variety of downstream tasks. However, upon closer investigation of this objective, we find…

Computation and Language · Computer Science 2025-02-25 Zhili Feng , Dhananjay Ram , Cole Hawkins , Aditya Rawal , Jinman Zhao , Sheng Zha

Speech recognition systems have achieved high recognition performance for several tasks. However, the performance of such systems is dependent on the tremendously costly development work of preparing vast amounts of task-matched transcribed…

Computation and Language · Computer Science 2017-11-13 Taku Kato , Takahiro Shinozaki

We introduce our submission to the AudioMOS Challenge (AMC) 2025 Track 3: mean opinion score (MOS) prediction for speech with multiple sampling frequencies (SFs). Our submitted model integrates an SF-independent (SFI) convolutional layer…

Second pass rescoring is a critical component of competitive automatic speech recognition (ASR) systems. Large language models have demonstrated their ability in using pre-trained information for better rescoring of ASR hypothesis.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-11 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Yile Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko

We present a study on the design of multilingual Answer Sentence Selection (AS2) models, which are a core component of modern Question Answering (QA) systems. The main idea is to transfer data, created from one resource rich language, e.g.,…

Computation and Language · Computer Science 2021-02-23 Thuy Vu , Alessandro Moschitti

We reformulate explanation quality assessment as a ranking problem rather than a generation problem. Instead of optimizing models to produce a single "best" explanation token-by-token, we train reward models to discriminate among multiple…

Artificial Intelligence · Computer Science 2026-04-28 Thomas Bailleux , Tanmoy Mukherjee , Emmanuel Lonca , Pierre Marquis , Zied Bouraoui

Automatic methods to predict Mean Opinion Score (MOS) of listeners have been researched to assure the quality of Text-to-Speech systems. Many previous studies focus on architectural advances (e.g. MBNet, LDNet, etc.) to capture relations…

Sound · Computer Science 2022-06-29 Aki Kunikoshi , Jaebok Kim , Wonsuk Jun , Kåre Sjölander

Non-intrusive speech quality assessment (SQA) systems suffer from limited training data and costly human annotations, hindering their generalization to real-time conferencing calls. In this work, we propose leveraging large language models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-11 Fredrik Cumlin , Xinyu Liang , Anubhab Ghosh , Saikat Chatterjee

Conducting pairwise comparisons is a widely used approach in curating human perceptual preference data. Typically raters are instructed to make their choices according to a specific set of rules that address certain dimensions of image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Hossein Talebi , Ehsan Amid , Peyman Milanfar , Manfred K. Warmuth

In designing personalized ranking algorithms, it is desirable to encourage a high precision at the top of the ranked list. Existing methods either seek a smooth convex surrogate for a non-smooth ranking metric or directly modify updating…

Machine Learning · Statistics 2018-08-15 Kuan Liu , Prem Natarajan