English
Related papers

Related papers: A mixture model for aggregation of multiple pre-tr…

200 papers

Adaptive filters are at the core of many signal processing applications, ranging from acoustic noise supression to echo cancelation, array beamforming, channel equalization, to more recent sensor network applications in surveillance, target…

Systems and Control · Electrical Eng. & Systems 2021-12-24 Jerónimo Arenas-García , Luis A. Azpicueta-Ruiz , Magno T. M. Silva , Vitor H. Nascimento , Ali H. Sayed

Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network models is crucial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiaoliang Liu , Furao Shen , Jian Zhao , Changhai Nie

We propose clustered federated multitask learning to address statistical challenges in non-independent and identically distributed data across clients. Our approach tackles complexities in hierarchical wireless networks by clustering…

Networking and Internet Architecture · Computer Science 2024-07-15 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Amr Mohamed

Datasets for training object recognition systems are steadily increasing in size. This paper investigates the question of whether existing detectors will continue to improve as data grows, or saturate in performance due to limited model…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 Xiangxin Zhu , Carl Vondrick , Charless Fowlkes , Deva Ramanan

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

Existing works show that augmenting the training data of pre-trained language models (PLMs) for classification tasks fine-tuned via parameter-efficient fine-tuning methods (PEFT) using both clean and adversarial examples can enhance their…

Computation and Language · Computer Science 2024-06-18 Tuc Nguyen , Thai Le

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

A recently-proposed technique called self-adaptive training augments modern neural networks by allowing them to adjust training labels on the fly, to avoid overfitting to samples that may be mislabeled or otherwise non-representative. By…

Machine Learning · Computer Science 2020-06-16 Daniel Chiu , Franklyn Wang , Scott Duke Kominers

The main approaches for the formation of generalized conclusions about operation quality of complex hierarchical network systems are analized. Advantages and drawbacks of the "weakest" element method and a weighted linear aggregation method…

Systems and Control · Computer Science 2016-03-24 Olexandr Polishchuk

Samples from intimate (non-linear) mixtures are generally modeled as being drawn from a smooth manifold. Scenarios where the data contains multiple intimate mixtures with some constituent materials in common can be thought of as manifolds…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Arun M. Saranathan , Mario Parente

Network pruning is one of the most dominant methods for reducing the heavy inference cost of deep neural networks. Existing methods often iteratively prune networks to attain high compression ratio without incurring significant loss in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Duong H. Le , Trung-Nhan Vo , Nam Thoai

The importance of accurately quantifying forecast uncertainty has motivated much recent research on probabilistic forecasting. In particular, a variety of deep learning approaches has been proposed, with forecast distributions obtained as…

Machine Learning · Statistics 2024-11-11 Benedikt Schulz , Lutz Köhler , Sebastian Lerch

Image clustering has recently attracted significant attention due to the increased availability of unlabelled datasets. The efficiency of traditional clustering algorithms heavily depends on the distance functions used and the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

Federated learning has a variety of applications in multiple domains by utilizing private training data stored on different devices. However, the aggregation process in federated learning is highly vulnerable to adversarial attacks so that…

Machine Learning · Computer Science 2021-01-12 Shuhao Fu , Chulin Xie , Bo Li , Qifeng Chen

We explore a key architectural aspect of deep convolutional neural networks: the pattern of internal skip connections used to aggregate outputs of earlier layers for consumption by deeper layers. Such aggregation is critical to facilitate…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ligeng Zhu , Ruizhi Deng , Michael Maire , Zhiwei Deng , Greg Mori , Ping Tan

Traditional image clustering methods take a two-step approach, feature learning and clustering, sequentially. However, recent research results demonstrated that combining the separated phases in a unified framework and training them jointly…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Fengfu Li , Hong Qiao , Bo Zhang , Xuanyang Xi

We address a core problem of computer vision: Detection and description of 2D feature points for image matching. For a long time, hand-crafted designs, like the seminal SIFT algorithm, were unsurpassed in accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Aritra Bhowmik , Stefan Gumhold , Carsten Rother , Eric Brachmann

An approach to the acceleration of parametric weak classifier boosting is proposed. Weak classifier is called parametric if it has fixed number of parameters and, so, can be represented as a point into multidimensional space. Genetic…

Machine Learning · Computer Science 2009-06-05 Boris Yangel

Clustering large, mixed data is a central problem in data mining. Many approaches adopt the idea of k-means, and hence are sensitive to initialisation, detect only spherical clusters, and require a priori the unknown number of clusters. We…

Machine Learning · Statistics 2020-11-13 Joshua Tobin , Mimi Zhang

The wide and rapid adoption of deep learning by practitioners brought unintended consequences in many situations such as in the infamous case of Google Photos' racist image recognition algorithm; thus, necessitated the utilization of the…

Machine Learning · Computer Science 2019-05-24 Mehmet Yigit Yildirim , Mert Ozer , Hasan Davulcu