English
Related papers

Related papers: Dynamic Acoustic Model Architecture Optimization i…

200 papers

The use of spatial information with multiple microphones can improve far-field automatic speech recognition (ASR) accuracy. However, conventional microphone array techniques degrade speech enhancement performance when there is an array…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-23 Kenichi Kumatani , Minhua Wu , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

As progress is made on training machine learning models on incrementally expanding classification tasks (i.e., incremental learning), a next step is to translate this progress to industry expectations. One technique missing from incremental…

Machine Learning · Computer Science 2022-05-23 James Seale Smith , Zachary Seymour , Han-Pang Chiu

Diffusion large language models (dLLMs) are promising alternatives to autoregressive large language models (AR-LLMs), as they potentially allow higher inference throughput. Reinforcement learning (RL) is a crucial component for dLLMs to…

Machine Learning · Computer Science 2026-02-24 Yuchen Zhu , Wei Guo , Jaemoo Choi , Petr Molodyk , Bo Yuan , Molei Tao , Yongxin Chen

Adversarially robust optimization (ARO) has emerged as the *de facto* standard for training models that hedge against adversarial attacks in the test stage. While these models are robust against adversarial attacks, they tend to suffer…

Optimization and Control · Mathematics 2025-06-12 Aras Selvi , Eleonora Kreacic , Mohsen Ghassemi , Vamsi Potluru , Tucker Balch , Manuela Veloso

Despite the efficacy of Direct Preference Optimization (DPO) in aligning Large Language Models (LLMs), reward hacking remains a pivotal challenge. This issue emerges when LLMs excessively reduce the probability of rejected completions to…

Computation and Language · Computer Science 2025-08-26 Chenxu Yang , Ruipeng Jia , Mingyu Zheng , Naibin Gu , Zheng Lin , Siyuan Chen , Weichong Yin , Hua Wu , Weiping Wang

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Alexandre Ducorroy , Rachid Riad

Topology optimization (TO) is a popular and powerful computational approach for designing novel structures, materials, and devices. Two computational challenges have limited the applicability of TO to a variety of industrial applications.…

Computational Engineering, Finance, and Science · Computer Science 2020-12-01 Sirui Bi , Jiaxin Zhang , Guannan Zhang

Transfer learning is a popular technique for improving the performance of neural networks. However, existing methods are limited to transferring parameters between networks with same architectures. We present a method for transferring…

Machine Learning · Computer Science 2022-12-29 Maciej A. Czyzewski , Daniel Nowak , Kamil Piechowiak

To balance the quality and inference cost of a Foundation Model (FM, such as large language models (LLMs)) powered software, people often opt to train a routing model that routes requests to FMs with different sizes and capabilities.…

Machine Learning · Computer Science 2025-06-03 Kirill Vasilevski , Dayi Lin , Ahmed E. Hassan

Learned construction heuristics for scheduling problems have become increasingly competitive with established solvers and heuristics in recent years. In particular, significant improvements have been observed in solution approaches using…

Artificial Intelligence · Computer Science 2024-06-12 Constantin Waubert de Puiseau , Christian Dörpelkus , Jannik Peters , Hasan Tercan , Tobias Meisen

Given an existing trained neural network, it is often desirable to learn new capabilities without hindering performance of those already learned. Existing approaches either learn sub-optimal solutions, require joint training, or incur a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Amir Rosenfeld , John K. Tsotsos

Millimeter-wave vehicular networks incur enormous beam-training overhead to enable narrow-beam communications. This paper proposes a learning and adaptation framework in which the dynamics of the communication beams are learned and then…

Machine Learning · Computer Science 2021-10-27 Muddassar Hussain , Nicolo Michelusi

Adversarial Training is the most effective approach for improving the robustness of Deep Neural Networks (DNNs). However, compared to the large body of research in optimizing the adversarial training process, there are few investigations…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 ShengYun Peng , Weilin Xu , Cory Cornelius , Kevin Li , Rahul Duggal , Duen Horng Chau , Jason Martin

Distributed AI systems face critical memory management challenges across computation, communication, and deployment layers. RRAM based in memory computing suffers from scalability limitations due to device non idealities and fixed array…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Zixuan Li , Chuanzhen Wang , Haotian Sun

With the widespread application of automatic speech recognition (ASR) systems, their vulnerability to adversarial attacks has been extensively studied. However, most existing adversarial examples are generated on specific individual models,…

Sound · Computer Science 2025-03-26 Weifei Jin , Junjie Su , Hejia Wang , Yulin Ye , Jie Hao

In this paper, we address the problem of transmit beamspace design for multiple-input multiple-output (MIMO) radar with colocated antennas in application to direction-of-arrival (DOA) estimation. A new method for designing the transmit…

Information Theory · Computer Science 2015-06-16 Arash Khabbazibasmenj , Aboulnasr Hassanien , Sergiy A. Vorobyov , Matthew W. Morency

The automation of feature extraction of machine learning has been successfully realized by the explosive development of deep learning. However, the structures and hyperparameters of deep neural network architectures also make huge…

Machine Learning · Computer Science 2024-10-01 Wenzhu Shao

A communication enabled indoor intelligent robots (IRs) service framework is proposed, where non-orthogonal multiple access (NOMA) technique is adopted to enable highly reliable communications. In cooperation with the ultramodern indoor…

Artificial Intelligence · Computer Science 2020-11-30 Ruikang Zhong , Xiao Liu , Yuanwei Liu , Yue Chen , Xianbin Wang

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

Aligning large-scale vision-language models (VLMs) for complex reasoning via reinforcement learning is often hampered by the limitations of existing policy optimization algorithms, such as static training schedules and the rigid, uniform…

Artificial Intelligence · Computer Science 2025-10-02 Yunhao Wang , Ziting Li , Shuai Chen , Tao Liu , Chao Song , Junjie Jiang , Jian Zhu , Peng Gao , Bin Qin