English
Related papers

Related papers: Preference-based training framework for automatic …

200 papers

Learning from human preferences is crucial for language models (LMs) to effectively cater to human needs and societal values. Previous research has made notable progress by leveraging human feedback to follow instructions. However, these…

Computation and Language · Computer Science 2023-12-12 Jian Hu , Li Tao , June Yang , Chandler Zhou

Recent work in the domain of speech enhancement has explored the use of self-supervised speech representations to aid in the training of neural speech enhancement models. However, much of this work focuses on using the deepest or final…

Sound · Computer Science 2023-06-27 George Close , William Ravenscroft , Thomas Hain , Stefan Goetze

Subjective tests are the gold standard for evaluating speech quality and intelligibility; however, they are time-consuming and expensive. Thus, objective measures that align with human perceptions are crucial. This study evaluates the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-11 Hsin-Tien Chiang , Kuo-Hsuan Hung , Szu-Wei Fu , Heng-Cheng Kuo , Ming-Hsueh Tsai , Yu Tsao

Recent studies show that Question Answering (QA) based on Answer Sentence Selection (AS2) can be improved by generating an improved answer from the top-k ranked answer sentences (termed GenQA). This allows for synthesizing the information…

Computation and Language · Computer Science 2022-10-25 Matteo Gabburo , Rik Koncel-Kedziorski , Siddhant Garg , Luca Soldaini , Alessandro Moschitti

Alignment is a crucial step to enhance the instruction-following and conversational abilities of language models. Despite many recent work proposing new algorithms, datasets, and training pipelines, there is a lack of comprehensive studies…

Computation and Language · Computer Science 2024-10-04 Xiao Yu , Qingyang Wu , Yu Li , Zhou Yu

Model selection is a problem that has occupied machine learning researchers for a long time. Recently, its importance has become evident through applications in deep learning. We propose an agreement-based learning framework that prevents…

Machine Learning · Computer Science 2018-06-05 Emmanouil Antonios Platanios

Readability assessment aims to automatically classify text by the level appropriate for learning readers. Traditional approaches to this task utilize a variety of linguistically motivated features paired with simple machine learning models.…

Computation and Language · Computer Science 2020-08-04 Tovly Deutsch , Masoud Jasbi , Stuart Shieber

Recruitment of appropriate people for certain positions is critical for any companies or organizations. Manually screening to select appropriate candidates from large amounts of resumes can be exhausted and time-consuming. However, there is…

Information Retrieval · Computer Science 2018-10-09 Yong Luo , Huaizheng Zhang , Yongjie Wang , Yonggang We , Xinwen Zhang

Deep learning-based speech enhancement has shown unprecedented performance in recent years. The most popular mono speech enhancement frameworks are end-to-end networks mapping the noisy mixture into an estimate of the clean speech. With…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-02 Bahareh Tolooshams , Kazuhito Koishida

We propose MambaRate, which predicts Mean Opinion Scores (MOS) with limited bias regarding the sampling rate of the waveform under evaluation. It is designed for Track 3 of the AudioMOS Challenge 2025, which focuses on predicting MOS for…

We consider a wireless network scenario applicable to metropolitan areas with developed public transport networks and high commute demands, where the mobile user equipments (UEs) move along fixed and predetermined trajectories and request…

Optimization and Control · Mathematics 2022-02-22 Wanjun Ning , Zimu Xu , Jingjin Wu , Tiejun Tong

Preference learning is a widely adopted post-training technique that aligns large language models (LLMs) to human preferences and improves specific downstream task capabilities. In this work we systematically investigate how specific…

Computation and Language · Computer Science 2024-12-23 Joongwon Kim , Anirudh Goyal , Aston Zhang , Bo Xiong , Rui Hou , Melanie Kambadur , Dhruv Mahajan , Hannaneh Hajishirzi , Liang Tan

Assessing soft skills such as empathy, ethical judgment, and communication is essential in competitive selection processes, yet human scoring is often inconsistent and biased. While Large Language Models (LLMs) have improved Automated Essay…

Computation and Language · Computer Science 2026-02-03 Ryan Huynh , Frank Guerin , Alison Callwood

English proficiency assessments have become a necessary metric for filtering and selecting prospective candidates for both academia and industry. With the rise in demand for such assessments, it has become increasingly necessary to have the…

Computation and Language · Computer Science 2021-12-01 Pakhi Bamdev , Manraj Singh Grover , Yaman Kumar Singla , Payman Vafaee , Mika Hama , Rajiv Ratn Shah

Large language models (LLMs) have recently shown great advances in a variety of tasks, including natural language understanding and generation. However, their use in high-stakes decision-making scenarios is still limited due to the…

Computation and Language · Computer Science 2023-11-14 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan O Arik , Tomas Pfister , Somesh Jha

As speech processing systems in mobile and edge devices become more commonplace, the demand for unintrusive speech quality monitoring increases. Deep learning methods provide high-quality estimates of objective and subjective speech quality…

Previous methods for predicting room acoustic parameters and speech quality metrics have focused on the single-channel case, where room acoustics and Mean Opinion Score (MOS) are predicted for a single recording device. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Jozef Coldenhoff , Andrew Harper , Paul Kendrick , Tijana Stojkovic , Milos Cernak

Direct Preference Optimization (DPO) has emerged as a de-facto approach for aligning language models with human preferences. Recent work has shown DPO's effectiveness relies on training data quality. In particular, clear quality differences…

Machine Learning · Computer Science 2025-01-28 Nirav Diwan , Tolga Ergen , Dongsub Shim , Honglak Lee

Direct Preference Optimization (DPO) has emerged as a promising approach for aligning large language models with human preferences. While prior work mainly extends DPO from the aspect of the objective function, we instead improve DPO from…

Machine Learning · Computer Science 2026-02-17 Xun Deng , Han Zhong , Rui Ai , Fuli Feng , Zheng Wang , Xiangnan He

A key requirement in developing Generative Language Models (GLMs) is to have their values aligned with human values. Preference-based alignment is a widely used paradigm for this purpose, in which preferences over generation pairs are first…

Computation and Language · Computer Science 2024-04-16 Yang Gao , Dana Alon , Donald Metzler
‹ Prev 1 8 9 10 Next ›