English
Related papers

Related papers: Optimizing Genetic Algorithms with Multilayer Perc…

200 papers

In this paper, we formulate the hyperparameter tuning problem in machine learning as a bilevel program. The bilevel program is solved using a micro genetic algorithm that is enhanced with a linear program. While the genetic algorithm…

Machine Learning · Computer Science 2024-07-02 Ankur Sinha , Paritosh Pankaj

Over the last decades, hand-crafted feature extractors have been used to encode image visual properties into feature vectors. Recently, data-driven feature learning approaches have been successfully explored as alternatives for producing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Érico M. Pereira , Ricardo da S. Torres , Jefersson A. dos Santos

Deep learning methods have been exerting their strengths in long-term time series forecasting. However, they often struggle to strike a balance between expressive power and computational efficiency. Resorting to multi-layer perceptrons…

Machine Learning · Computer Science 2024-05-21 Nannan Bian , Minhong Zhu , Li Chen , Weiran Cai

Objective: A variety of pattern analysis techniques for model training in brain interfaces exploit neural feature dimensionality reduction based on feature ranking and selection heuristics. In the light of broad evidence demonstrating the…

Machine Learning · Computer Science 2019-04-08 Ozan Ozdenizci , Deniz Erdogmus

Person re-identification aims at establishing the identity of a pedestrian from a gallery that contains images of multiple people obtained from a multi-camera system. Many challenges such as occlusions, drastic lighting and pose variations…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Guodong Ding , Salman Khan , Zhenmin Tang , Fatih Porikli

Image super-resolution reconstruction achieves better results than traditional methods with the help of the powerful nonlinear representation ability of convolution neural network. However, some existing algorithms also have some problems,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Yuxi Cai , Huicheng Lai

In deep learning, Multi-Layer Perceptrons (MLPs) have once again garnered attention from researchers. This paper introduces MC-MLP, a general MLP-like backbone for computer vision that is composed of a series of fully-connected (FC) layers.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zhimin Zhu , Jianguo Zhao , Tong Mu , Yuliang Yang , Mengyu Zhu

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

In this work, we present a novel mask guided attention (MGA) method for fine-grained patchy image classification. The key challenge of fine-grained patchy image classification lies in two folds, ultra-fine-grained inter-category variances…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Jun Wang , Xiaohan Yu , Yongsheng Gao

Because of high dimensionality, correlation among covariates, and noise contained in data, dimension reduction (DR) techniques are often employed to the application of machine learning algorithms. Principal Component Analysis (PCA), Linear…

Machine Learning · Statistics 2019-10-08 Katherine C. Kempfert , Yishi Wang , Cuixian Chen , Samuel W. K. Wong

Although deep face recognition has achieved impressive progress in recent years, controversy has arisen regarding discrimination based on skin tone, questioning their deployment into real-world scenarios. In this paper, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Mei Wang , Yaobin Zhang , Weihong Deng

Lung cancer stands as the preeminent cause of cancer-related mortality globally. Prompt and precise diagnosis, coupled with effective treatment, is imperative to reduce the fatality rates associated with this formidable disease. This study…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Bitasadat Jamshidi , Nastaran Ghorbani , Mohsen Rostamy-Malkhalifeh

We present a novel approach for adaptive, differentiable parameterization of large-scale random fields. If the approach is coupled with any gradient-based optimization algorithm, it can be applied to a variety of optimization problems,…

Machine Learning · Computer Science 2020-06-09 Maksim Elizarev , Andrei Mukhin , Aleksey Khlyupin

In this work we revisit the most fundamental building block in deep learning, the multi-layer perceptron (MLP), and study the limits of its performance on vision tasks. Empirical insights into MLPs are important for multiple reasons. (1)…

Machine Learning · Computer Science 2023-10-04 Gregor Bachmann , Sotiris Anagnostidis , Thomas Hofmann

Generalization of time series prediction remains an important open issue in machine learning, wherein earlier methods have either large generalization error or local minima. We develop an analytically solvable, unsupervised learning scheme…

Machine Learning · Statistics 2022-01-21 Takuya Isomura , Taro Toyoizumi

Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Many top-performing methods for image segmentation are based on deep CNN models. However, deep CNN models fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma , Mengjie Zhang

The fine-tuning of Large Language Models (LLMs) is pivotal for achieving optimal performance across diverse downstream tasks. However, while full fine-tuning delivers superior results, it entails significant computational and resource…

Computation and Language · Computer Science 2025-01-15 Yao Liang , Yuwei Wang , Yi Zeng

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

This work concerns the estimation of multidimensional nonlinear regression models using multilayer perceptrons (MLPs). The main problem with such models is that we need to know the covariance matrix of the noise to get an optimal estimator.…

Statistics Theory · Mathematics 2008-02-22 Joseph Rynkiewicz

With the productive evolution of large language models (LLMs) in the field of natural language processing (NLP), tons of effort has been made to effectively fine-tune common pre-trained LLMs to fulfill a variety of tasks in one or multiple…

Computation and Language · Computer Science 2024-02-06 Chao Song , Zhihao Ye , Qiqiang Lin , Qiuying Peng , Jun Wang