English
Related papers

Related papers: Deep Temporal-Recurrent-Replicated-Softmax for Top…

200 papers

We develop a Deep-Text Recurrent Network (DTRN) that regards scene text reading as a sequence labelling problem. We leverage recent advances of deep convolutional neural networks to generate an ordered high-level sequence from a whole word…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Pan He , Weilin Huang , Yu Qiao , Chen Change Loy , Xiaoou Tang

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

Natural language processing tools have become frequently used in social sciences such as economics, political science, and sociology. Many publications apply topic modeling to elicit latent topics in text corpora and their development over…

General Economics · Economics 2024-04-30 W. Benedikt Schmal

Nowadays, modern earth observation programs produce huge volumes of satellite images time series (SITS) that can be useful to monitor geographical areas through time. How to efficiently analyze such kind of information is still an open…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Dino Ienco , Raffaele Gaetano , Claire Dupaquier , Pierre Maurel

This paper presents ATEM, a novel framework for studying topic evolution in scientific archives. ATEM is based on dynamic topic modeling and dynamic graph embedding techniques that explore the dynamics of content and citations of documents…

Information Retrieval · Computer Science 2023-06-06 Hamed Rahimi , Hubert Naacke , Camelia Constantin , Bernd Amann

Topic models have been the prominent tools for automatic topic discovery from text corpora. Despite their effectiveness, topic models suffer from several limitations including the inability of modeling word ordering information in…

Computation and Language · Computer Science 2022-02-10 Yu Meng , Yunyi Zhang , Jiaxin Huang , Yu Zhang , Jiawei Han

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction…

Machine Learning · Computer Science 2019-10-22 Shenghao Qin , Jiacheng Zhu , Jimmy Qin , Wenshuo Wang , Ding Zhao

Recurrent neural networks (RNNs), such as long short-term memory networks (LSTMs), serve as a fundamental building block for many sequence learning tasks, including machine translation, language modeling, and question answering. In this…

Computation and Language · Computer Science 2017-08-09 Stephen Merity , Nitish Shirish Keskar , Richard Socher

Topic models are a popular approach for extracting semantic information from large document collections. However, recent studies suggest that the topics generated by these models often do not align well with human intentions. Although…

Information Retrieval · Computer Science 2025-02-10 Mayank Nagda , Phil Ostheimer , Sophie Fellenz

We investigate the computational complexity of various problems for simple recurrent neural networks (RNNs) as formal models for recognizing weighted languages. We focus on the single-layer, ReLU-activation, rational-weight RNNs with…

Formal Languages and Automata Theory · Computer Science 2018-03-06 Yining Chen , Sorcha Gilroy , Andreas Maletti , Jonathan May , Kevin Knight

Extracting coherent and human-understandable themes from large collections of unstructured historical newspaper archives presents significant challenges due to topic evolution, Optical Character Recognition (OCR) noise, and the sheer volume…

Computation and Language · Computer Science 2025-12-15 Keerthana Murugaraj , Salima Lamsiyah , Marten During , Martin Theobald

Recurrent Neural Networks (RNNs) have been widely used in processing natural language tasks and achieve huge success. Traditional RNNs usually treat each token in a sentence uniformly and equally. However, this may miss the rich semantic…

Computation and Language · Computer Science 2018-11-14 Chang Xu , Weiran Huang , Hongwei Wang , Gang Wang , Tie-Yan Liu

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during…

Machine Learning · Computer Science 2023-06-13 Peter DelMastro , Rushiv Arora , Edward Rietman , Hava T. Siegelmann

The rapid proliferation of the Internet and the widespread adoption of social networks have significantly accelerated information dissemination. However, this transformation has introduced complexities in information capture and processing,…

Social and Information Networks · Computer Science 2025-03-06 Yuchuan Jiang , Chaolong Jia , Yunyi Qin , Wei Cai , Yongsen Qian

A single, stationary topic model such as latent Dirichlet allocation is inappropriate for modeling corpora that span long time periods, as the popularity of topics is likely to change over time. A number of models that incorporate time have…

Machine Learning · Statistics 2015-03-20 Avinava Dubey , Ahmed Hefny , Sinead Williamson , Eric P. Xing

Recurrent Neural Networks are showing much promise in many sub-areas of natural language processing, ranging from document classification to machine translation to automatic question answering. Despite their promise, many recurrent models…

Computation and Language · Computer Science 2017-05-02 Adams Wei Yu , Hongrae Lee , Quoc V. Le

Learning the dynamics of spatiotemporal events is a fundamental problem. Neural point processes enhance the expressivity of point process models with deep neural networks. However, most existing methods only consider temporal dynamics…

Machine Learning · Computer Science 2024-12-10 Zihao Zhou , Xingyi Yang , Ryan Rossi , Handong Zhao , Rose Yu

This study addresses an image-matching problem in challenging cases, such as large scene variations or textureless scenes. To gain robustness to such situations, most previous studies have attempted to encode the global contexts of a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Khang Truong Giang , Soohwan Song , Sungho Jo

Monitoring online customer reviews is important for business organisations to measure customer satisfaction and better manage their reputations. In this paper, we propose a novel dynamic Brand-Topic Model (dBTM) which is able to…

Information Retrieval · Computer Science 2023-01-19 Runcong Zhao , Lin Gui , Hanqi Yan , Yulan He