English
Related papers

Related papers: Transformer-CNN: Fast and Reliable tool for QSAR

200 papers

X-ray Photoelectron Spectroscopy (XPS) is a crucial technique for material surface analysis, yet interpreting its spectra is often challenging for both human analysts and automated methods due to the prevalence of variable spectral shifts…

Materials Science · Physics 2026-03-06 Issa Saddiq , Yuxin Fan , Robert G. Palgrave , Mark A. Isaacs , David Morgan , Keith T. Butler

Speech Emotion Recognition is a crucial area of research in human-computer interaction. While significant work has been done in this field, many state-of-the-art networks struggle to accurately recognize emotions in speech when the data is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Rashedul Hasan , Meher Nigar , Nursadul Mamun , Sayan Paul

In this work, we discuss the application of convolutional neural networks (CNNs) as a tool to advantageously initialize Stokes profile inversions. To demonstrate the usefulness of CNNs, we concentrate in this paper on the inversion of LTE…

Instrumentation and Methods for Astrophysics · Physics 2021-07-14 R. Gafeira , D. Orozco Suárez , I. Milic , C. Quintero Noda , B. Ruiz Cobo , H. Uitenbroek

Coreset selection is among the most effective ways to reduce the training time of CNNs, however, only limited is known on how the resultant models will behave under variations of the coreset size, and choice of datasets and models.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Animesh Gupta , Irtiza Hasan , Dilip K. Prasad , Deepak K. Gupta

Quantum machine learning (QML) offers a promising avenue for advancing representation learning in complex signal domains. In this study, we investigate the use of parameterised quantum circuits (PQCs) for speech emotion recognition (SER) a…

Machine Learning · Computer Science 2025-06-26 Thejan Rajapakshe , Rajib Rana , Farina Riaz , Sara Khalifa , Björn W. Schuller

In healthcare and biomedical applications, extreme computational requirements pose a significant barrier to adopting representation learning. Representation learning can enhance the performance of deep learning architectures by learning…

Machine Learning · Computer Science 2023-08-22 Pranav Singh , Jacopo Cirrone

In this paper, we propose a novel Explanation Neural Network (XNN) to explain the predictions made by a deep network. The XNN works by learning a nonlinear embedding of a high-dimensional activation vector of a deep network layer into a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongang Qi , Saeed Khorram , Fuxin Li

Raman spectroscopy, a photonic modality based on the inelastic backscattering of coherent light, is a valuable asset to the intraoperative sensing space, offering non-ionizing potential and highly-specific molecular fingerprint-like…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Ashutosh Raman , Ren A. Odion , Kent K. Yamamoto , Weston Ross , Tuan Vo-Dinh , Patrick J. Codd

Foundational models based on the transformer architecture are currently the state-of-the-art in general language modeling, as well as in scientific areas such as material science and climate. However, training and deploying these models is…

Machine Learning · Computer Science 2025-10-16 Adarsha Balaji , Sandeep Madireddy , Prasanna Balaprakash

Fine-tuning Pre-trained protein language models (PLMs) has emerged as a prominent strategy for enhancing downstream prediction tasks, often outperforming traditional supervised learning approaches. As a widely applied powerful technique in…

Computation and Language · Computer Science 2024-04-24 Yang Tan , Mingchen Li , Bingxin Zhou , Bozitao Zhong , Lirong Zheng , Pan Tan , Ziyi Zhou , Huiqun Yu , Guisheng Fan , Liang Hong

Convolutional neural network (CNN) architectures have originated and revolutionized machine learning for images. In order to take advantage of CNNs in predictive modeling with audio data, standard FFT-based signal processing methods are…

Sound · Computer Science 2025-02-20 Pavol Harar , Roswitha Bammer , Anna Breger , Monika Dörfler , Zdenek Smekal

End-to-end speech recognition is a promising technology for enabling compact automatic speech recognition (ASR) systems since it can unify the acoustic and language model into a single neural network. However, as a drawback, training of…

Computation and Language · Computer Science 2022-02-17 Yotaro Kubo , Shigeki Karita , Michiel Bacchiani

Convolutional neural networks (CNN) and Transformer have wildly succeeded in multimedia applications. However, more effort needs to be made to harmonize these two architectures effectively to satisfy speech enhancement. This paper aims to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-31 Xinmeng Xu , Weiping Tu , Yuhong Yang

Designing implants for large and complex cranial defects is a challenging task, even for professional designers. Current efforts on automating the design process focused mainly on convolutional neural networks (CNN), which have produced…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jianning Li , David G. Ellis , Antonio Pepe , Christina Gsaxner , Michele R. Aizenberg , Jens Kleesiek , Jan Egger

Spiking neural networks (SNNs) have garnered interest due to their energy efficiency and superior effectiveness on neuromorphic chips compared with traditional artificial neural networks (ANNs). One of the mainstream approaches to…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Zhipeng Huang , Jianhao Ding , Zhiyu Pan , Haoran Li , Ying Fang , Zhaofei Yu , Jian K. Liu

SMILES is a linear representation of chemical structures which encodes the connection table, and the stereochemistry of a molecule as a line of text with a grammar structure denoting atoms, bonds, rings and chains, and this information can…

Machine Learning · Computer Science 2018-12-03 Arindam Paul , Dipendra Jha , Reda Al-Bahrani , Wei-keng Liao , Alok Choudhary , Ankit Agrawal

Spiking neural networks (SNNs) show great potential due to their energy efficiency, fast processing capabilities, and robustness. There are two main approaches to constructing SNNs. Direct training methods require much memory, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zihan Huang , Xinyu Shi , Zecheng Hao , Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Visual embeddings from Convolutional Neural Networks (CNN) trained on the ImageNet dataset for the ILSVRC challenge have shown consistently good performance for transfer learning and are widely used in several tasks, including image…

Information Retrieval · Computer Science 2018-09-26 Felipe del Rio , Pablo Messina , Vicente Dominguez , Denis Parra

Quantum Recurrent Neural Networks (QRNNs) are robust candidates for modelling and predicting future values in multivariate time series. However, the effective implementation of some QRNN models is limited by the need for mid-circuit…

Quantum Physics · Physics 2025-01-31 José Daniel Viqueira , Daniel Faílde , Mariamo M. Juane , Andrés Gómez , David Mera

Web test automation techniques often rely on crawlers to infer models of web applications for automated test generation. However, current crawlers rely on state equivalence algorithms that struggle to distinguish near-duplicate pages, often…

Software Engineering · Computer Science 2026-02-24 Kasun Kanaththage , Luigi Libero Lucio Starace , Matteo Biagiola , Paolo Tonella , Andrea Stocco