中文
相关论文

相关论文: Adaptive Channel Allocation for Robust Differentia…

200 篇论文

Differential Attention (DA) has been proposed as a refinement to standard attention, suppressing redundant or noisy context through a subtractive structure and thereby reducing contextual hallucination. While this design sharpens…

机器学习 · 计算机科学 2026-03-17 Tsubasa Takahashi , Shojiro Yamabe , Futa Waseda , Kento Sasaki

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

神经与进化计算 · 计算机科学 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

The success of neural architecture search (NAS) has historically been limited by excessive compute requirements. While modern weight-sharing NAS methods such as DARTS are able to finish the search in single-digit GPU days, extracting the…

机器学习 · 计算机科学 2021-12-28 Miroslav Fil , Binxin Ru , Clare Lyle , Yarin Gal

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

High sensitivity of neural architecture search (NAS) methods against their input such as step-size (i.e., learning rate) and search space prevents practitioners from applying them out-of-the-box to their own problems, albeit its purpose is…

机器学习 · 计算机科学 2019-05-22 Youhei Akimoto , Shinichi Shirakawa , Nozomu Yoshinari , Kento Uchida , Shota Saito , Kouhei Nishida

This paper considers the problem of resource-constrained and noise-limited localization and estimation of dynamic targets that are sparsely distributed over a large area. We generalize an existing framework [Bashan et al, 2008] for adaptive…

信息论 · 计算机科学 2014-04-09 Gregory E. Newstadt , Dennis L. Wei , Alfred O. Hero

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

机器学习 · 计算机科学 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Existing neural architecture search (NAS) methods often return an architecture with good search performance but generalizes poorly to the test setting. To achieve better generalization, we propose a novel neighborhood-aware NAS formulation…

机器学习 · 计算机科学 2021-11-01 Xiaofang Wang , Shengcao Cao , Mengtian Li , Kris M. Kitani

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

声音 · 计算机科学 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

Randomized controlled trials typically assume that prognostic covariates are known and available at no cost. In practice, obtaining high-dimensional pretreatment data is costly, forcing a trade-off between covariate-adaptive precision and a…

机器学习 · 统计学 2026-05-08 Kateryna Husar , Alexander Volfovsky

In previous works, only parameter weights of ASR models are optimized under fixed-topology architecture. However, the design of successful model architecture has always relied on human experience and intuition. Besides, many hyperparameters…

音频与语音处理 · 电气工程与系统科学 2020-07-28 Yi-Chen Chen , Jui-Yang Hsu , Cheng-Kuang Lee , Hung-yi Lee

Eye movement biometrics has received increasing attention thanks to its highly secure identification. Although deep learning (DL) models have shown success in eye movement recognition, their architectures largely rely on human prior…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Huafeng Qin , Hongyu Zhu , Xin Jin , Xin Yu , Mounim A. El-Yacoubi , Shuqiang Yang

Change-point detection (CPD) is crucial for identifying abrupt shifts in data, which influence decision-making and efficient resource allocation across various domains. To address the challenges posed by the costly and time-intensive data…

机器学习 · 计算机科学 2023-12-07 Hao Zhao , Rong Pan

Anomaly detection in time-series data is crucial for identifying faults, failures, threats, and outliers across a range of applications. Recently, deep learning techniques have been applied to this topic, but they often struggle in…

机器学习 · 计算机科学 2024-01-23 Lixu Wang , Shichao Xu , Xinyu Du , Qi Zhu

Adaptive data analysis (ADA) involves a dynamic interaction between an analyst and a dataset owner, where the analyst submits queries sequentially, adapting them based on previous answers. This process can become adversarial, as the analyst…

人机交互 · 计算机科学 2025-01-22 Amir Hossein Hadavi , Mohammad M. Mojahedian , Mohammad Reza Aref

In many learning situations, resources at inference time are significantly more constrained than resources at training time. This paper studies a general paradigm, called Differentiable ARchitecture Compression (DARC), that combines model…

机器学习 · 计算机科学 2019-05-21 Shashank Singh , Ashish Khetan , Zohar Karnin

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

机器学习 · 计算机科学 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Approximate Nearest Neighbor Search (ANNS) presents an inherent tradeoff between performance and recall (i.e., result quality). Each ANNS algorithm provides its own algorithm-dependent parameters to allow applications to influence the…

数据库 · 计算机科学 2025-08-19 Manos Chatzakis , Yannis Papakonstantinou , Themis Palpanas

Neural architecture search (NAS) approaches aim at automatically finding novel CNN architectures that fit computational constraints while maintaining a good performance on the target platform. We introduce a novel efficient one-shot NAS…

计算机视觉与模式识别 · 计算机科学 2020-05-22 Maxim Berman , Leonid Pishchulin , Ning Xu , Matthew B. Blaschko , Gerard Medioni

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam