English
Related papers

Related papers: End to End Binarized Neural Networks for Text Clas…

200 papers

Deep convolutional neural networks (CNNs) have shown appealing performance on various computer vision tasks in recent years. This motivates people to deploy CNNs to realworld applications. However, most of state-of-art CNNs require large…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Qinghao Hu , Peisong Wang , Jian Cheng

Entity Linking (EL) is an essential task for semantic text understanding and information extraction. Popular methods separately address the Mention Detection (MD) and Entity Disambiguation (ED) stages of EL, without leveraging their mutual…

Computation and Language · Computer Science 2018-08-30 Nikolaos Kolitsas , Octavian-Eugen Ganea , Thomas Hofmann

Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Xilin Liu , Andrew G. Richardson

Recent binary representation learning models usually require sophisticated binary optimization, similarity measure or even generative models as auxiliaries. However, one may wonder whether these non-trivial components are needed to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Yuming Shen , Jie Qin , Jiaxin Chen , Li Liu , Fan Zhu

Large-scale embedding-based retrieval (EBR) is the cornerstone of search-related industrial applications. Given a user query, the system of EBR aims to identify relevant information from a large corpus of documents that may be tens or…

Information Retrieval · Computer Science 2023-02-20 Yukang Gan , Yixiao Ge , Chang Zhou , Shupeng Su , Zhouchuan Xu , Xuyuan Xu , Quanchao Hui , Xiang Chen , Yexin Wang , Ying Shan

Bridging logical and algorithmic reasoning with modern machine learning techniques is a fundamental challenge with potentially transformative impact. On the algorithmic side, many NP-hard problems can be expressed as integer programs, in…

Machine Learning · Computer Science 2024-12-16 Anselm Paulus , Michal Rolínek , Vít Musil , Brandon Amos , Georg Martius

The large pre-trained BERT has achieved remarkable performance on Natural Language Processing (NLP) tasks but is also computation and memory expensive. As one of the powerful compression approaches, binarization extremely reduces the…

Computation and Language · Computer Science 2022-03-15 Haotong Qin , Yifu Ding , Mingyuan Zhang , Qinghua Yan , Aishan Liu , Qingqing Dang , Ziwei Liu , Xianglong Liu

Deep learning is one of the most successful and far-reaching strategies used in machine learning today. However, the scale and utility of neural networks is still greatly limited by the current hardware used to train them. These concerns…

Machine Learning · Computer Science 2022-01-12 Davis Arthur , Prasanna Date

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During…

Machine Learning · Computer Science 2016-03-18 Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Deep neural networks have been successfully deployed in a wide variety of applications including computer vision and speech recognition. However, computational and storage complexity of these models has forced the majority of computations…

Machine Learning · Computer Science 2018-08-28 Mahdi Nazemi , Ghasem Pasandi , Massoud Pedram

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

There has been a great deal of recent interest in binarized neural networks, especially because of their explainability. At the same time, automatic differentiation algorithms such as backpropagation fail for binarized neural networks,…

Machine Learning · Computer Science 2024-09-04 Johannes Aspman , Georgios Korpas , Jakub Marecek

Semantic hashing has become a powerful paradigm for fast similarity search in many information retrieval systems. While fairly successful, previous techniques generally require two-stage training, and the binary constraints are handled…

Computation and Language · Computer Science 2018-05-16 Dinghan Shen , Qinliang Su , Paidamoyo Chapfuwa , Wenlin Wang , Guoyin Wang , Lawrence Carin , Ricardo Henao

Convolutional neural networks have achieved astonishing results in different application areas. Various methods that allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks are a…

Machine Learning · Computer Science 2018-12-06 Joseph Bethge , Marvin Bornstein , Adrian Loy , Haojin Yang , Christoph Meinel

Imagine experiencing a crash as the passenger of an autonomous vehicle. Wouldn't you want to know why it happened? Current end-to-end optimizable deep neural networks (DNNs) in 3D detection, multi-object tracking, and motion forecasting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Benjamin Thérien , Krzysztof Czarnecki

Embedded distributed inference of Neural Networks has emerged as a promising approach for deploying machine-learning models on resource-constrained devices in an efficient and scalable manner. The inference task is distributed across a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Federico Nicolás Peccia , Oliver Bringmann

Recently the deep learning techniques have achieved success in multi-label classification due to its automatic representation learning ability and the end-to-end learning framework. Existing deep neural networks in multi-label…

Machine Learning · Computer Science 2018-02-06 Huihui He , Rui Xia

Deep neural networks have seen tremendous success for different modalities of data including images, videos, and speech. This success has led to their deployment in mobile and embedded systems for real-time applications. However, making…

Computer Vision and Pattern Recognition · Computer Science 2019-01-31 Nitthilan Kannappan Jayakodi , Anwesha Chatterjee , Wonje Choi , Janardhan Rao Doppa , Partha Pratim Pande

Deep learning models have been efficient lately on image parsing tasks. However, deep learning models are not fully capable of exploiting visual and contextual information simultaneously. The proposed three-layer context-based deep…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma

Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results…

Computation and Language · Computer Science 2020-02-17 Akshit Tyagi , Varun Sharma , Rahul Gupta , Lynn Samson , Nan Zhuang , Zihang Wang , Bill Campbell