English
Related papers

Related papers: Notes on Deep Learning for NLP

200 papers

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the…

Neurons and Cognition · Quantitative Biology 2020-05-21 Jesse A. Livezey , Joshua I. Glaser

Recent advancements in tabular deep learning (DL) have led to substantial performance improvements, surpassing the capabilities of traditional models. With the adoption of techniques from natural language processing (NLP), such as language…

Machine Learning · Computer Science 2024-11-27 Anton Frederik Thielmann , Soheila Samiee

Modern AI is based on deep artificial neural networks (NNs). As of 2025, the most cited scientific article of the 21st century is an NN paper on deep residual learning with residual connections. Who invented this? We present a timeline of…

Machine Learning · Computer Science 2025-09-30 Juergen Schmidhuber

In recent years, deep learning revolutionized machine learning and its applications, producing results comparable to human experts in several domains, including neuroscience. Each year, hundreds of scientific publications present…

Quantitative Methods · Quantitative Biology 2023-01-13 Louis Fabrice Tshimanga , Manfredo Atzori , Federico Del Pup , Maurizio Corbetta

Deep learning (DL) is a high dimensional data reduction technique for constructing high-dimensional predictors in input-output models. DL is a form of machine learning that uses hierarchical layers of latent features. In this article, we…

Machine Learning · Statistics 2018-08-06 Nicholas G. Polson , Vadim O. Sokolov

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

While a lot of work has been done in understanding representations learned within deep NLP models and what knowledge they capture, little attention has been paid towards individual neurons. We present a technique called as Linguistic…

Computation and Language · Computer Science 2024-01-17 Nadir Durrani , Fahim Dalvi , Hassan Sajjad

We present a method for visualising the response of a deep neural network to a specific input. For image data for instance our method will highlight areas that provide evidence in favor of, and against choosing a certain class. The method…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Luisa M. Zintgraf , Taco S. Cohen , Max Welling

This work proposes to analyse some keywords for bias analysis. For this, we are using several NLP approaches and compare them based on their capability of detecting keywords to analyse bias. The overall findings show that our proposed…

Computers and Society · Computer Science 2023-02-08 Abdurrezak Efe , Gizem Gezici , Aysenur Uzun , Uygar Kurt

Recognition of objects using Deep Neural Networks is an active area of research and many breakthroughs have been made in the last few years. The paper attempts to indicate how far this field has progressed. The paper briefly describes the…

Computer Vision and Pattern Recognition · Computer Science 2014-12-12 Soren Goyal , Paul Benjamin

Over the last several years, the field of Structured prediction in NLP has had seen huge advancements with sophisticated probabilistic graphical models, energy-based networks, and its combination with deep learning-based approaches. This…

Computation and Language · Computer Science 2021-10-06 Chauhan Dev , Naman Biyani , Nirmal P. Suthar , Prashant Kumar , Priyanshu Agarwal

These notes are very informal notes on the Langlands program. I had some pleasure in daring to ask colleagues to explain to me the importance of some of the recent results on Langlands program, so I thought I will record (to the best of my…

Group Theory · Mathematics 2007-05-23 Michele Vergne

Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed…

Machine Learning · Computer Science 2025-05-30 Chang Yue , Niraj K. Jha

In recent years, natural language processing (NLP) has got great development with deep learning techniques. In the sub-field of machine translation, a new approach named Neural Machine Translation (NMT) has emerged and got massive attention…

Computation and Language · Computer Science 2020-02-19 Shuoheng Yang , Yuxin Wang , Xiaowen Chu

Deep-learning models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) have been successfully used for process-mining tasks. They have achieved better performance for different predictive tasks than traditional…

Machine Learning · Computer Science 2021-05-04 Ishwar Venugopal , Jessica Töllich , Michael Fairbank , Ansgar Scherp

Deep learning is bringing remarkable contributions to the field of argumentation mining, but the existing approaches still need to fill the gap toward performing advanced reasoning tasks. In this position paper, we posit that…

Artificial Intelligence · Computer Science 2020-01-29 Andrea Galassi , Kristian Kersting , Marco Lippi , Xiaoting Shao , Paolo Torroni

Deep learning (DL) models for natural language processing (NLP) tasks often handle private data, demanding protection against breaches and disclosures. Data protection laws, such as the European Union's General Data Protection Regulation…

Computation and Language · Computer Science 2022-05-23 Samuel Sousa , Roman Kern

Lecture notes on optimization for machine learning, derived from a course at Princeton University and tutorials given in MLSS, Buenos Aires, as well as Simons Foundation, Berkeley.

Machine Learning · Computer Science 2019-09-10 Elad Hazan

In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous…

Neural and Evolutionary Computing · Computer Science 2014-11-20 Juergen Schmidhuber

Objective: We investigate whether deep learning techniques for natural language processing (NLP) can be used efficiently for patient phenotyping. Patient phenotyping is a classification task for determining whether a patient has a medical…