English
Related papers

Related papers: When Counting Meets HMER: Counting-Aware Network f…

200 papers

In this paper, we study semi-supervised Handwritten Mathematical Expression Recognition (HMER) via exploring both labeled data and extra unlabeled data. We propose a novel consistency regularization framework, termed SemiHMER, which…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Kehua Chen , Haoyang Shen

In this paper, we propose a novel speech emotion recognition model called Cross Attention Network (CAN) that uses aligned audio and text signals as inputs. It is inspired by the fact that humans recognize speech as a combination of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-27 Yoonhyung Lee , Seunghyun Yoon , Kyomin Jung

Offline handwritten mathematical expression recognition is a challenging task, because handwritten mathematical expressions mainly have two problems in the process of recognition. On one hand, it is how to correctly recognize different…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Guangcun Shan , Hongyu Wang , Wei Liang

Offline Handwritten Mathematical Expression Recognition (HMER) has been dramatically advanced recently by employing tree decoders as part of the encoder-decoder method. Despite the tree decoder-based methods regard the expressions as a tree…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zihao Lin , Jinrong Li , Fan Yang , Shuangping Huang , Xu Yang , Jianmin Lin , Ming Yang

Encoder-decoder models have made great progress on handwritten mathematical expression recognition recently. However, it is still a challenge for existing methods to assign attention to image features accurately. Moreover, those…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Wenqi Zhao , Liangcai Gao , Zuoyu Yan , Shuai Peng , Lin Du , Ziyin Zhang

This work proposes an attention-based sequence-to-sequence model for handwritten word recognition and explores transfer learning for data-efficient training of HTR systems. To overcome training data scarcity, this work leverages models…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Dmitrijs Kass , Ekta Vats

The Handwritten Mathematical Expression Recognition (HMER) task is a critical branch in the field of OCR. Recent studies have demonstrated that incorporating bidirectional context information significantly improves the performance of HMER…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Hanbo Cheng , Chenyu Liu , Pengfei Hu , Zhenrong Zhang , Jiefeng Ma , Jun Du

Sequence classification has numerous applications in various fields. Despite extensive studies in the last decades, many challenges still exist, particularly in pattern-based methods. Existing pattern-based methods measure the…

Machine Learning · Computer Science 2023-10-23 Junjie Dong , Mudi Jiang , Lianyu Hu , Zengyou He

Large foundation models have achieved significant performance gains through scalable training on massive datasets. However, the field of \textbf{H}andwritten \textbf{M}athematical \textbf{E}xpression \textbf{R}ecognition (HMER) has been…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Haoyang Li , Jiaqing Li , Jialun Cao , Zongyuan Yang , Yongping Xiong

We demonstrate that an attention-based encoder-decoder model can be used for sentence-level grammatical error identification for the Automated Evaluation of Scientific Writing (AESW) Shared Task 2016. The attention-based encoder-decoder…

Computation and Language · Computer Science 2016-04-19 Allen Schmaltz , Yoon Kim , Alexander M. Rush , Stuart M. Shieber

Handwritten document recognition (HDR) is one of the most challenging tasks in the field of computer vision, due to the various writing styles and complex layouts inherent in handwritten texts. Traditionally, this problem has been…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Mohammed Hamdan , Abderrahmane Rahiche , Mohamed Cheriet

Encoder-decoder models have become an effective approach for sequence learning tasks like machine translation, image captioning and speech recognition, but have yet to show competitive results for handwritten text recognition. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Johannes Michael , Roger Labahn , Tobias Grüning , Jochen Zöllner

Since their introduction, graph attention networks achieved outstanding results in graph representation learning tasks. However, these networks consider only pairwise relationships among nodes and then they are not able to fully exploit…

Machine Learning · Computer Science 2022-09-20 Lorenzo Giusti , Claudio Battiloro , Lucia Testa , Paolo Di Lorenzo , Stefania Sardellitti , Sergio Barbarossa

Unconstrained handwritten text recognition is a challenging computer vision task. It is traditionally handled by a two-step approach, combining line segmentation followed by text line recognition. For the first time, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Denis Coquenet , Clément Chatelain , Thierry Paquet

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by utilizing…

Computation and Language · Computer Science 2018-11-13 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Takaaki Hori , Shinji Watanabe , Hynek Hermansky

In recent years, great success has been achieved in many tasks of natural language processing (NLP), e.g., named entity recognition (NER), especially in the high-resource language, i.e., English, thanks in part to the considerable amount of…

Computation and Language · Computer Science 2023-01-10 Shengfei Lyu , Linghao Sun , Huixiong Yi , Yong Liu , Huanhuan Chen , Chunyan Miao

In this paper, a hardware-optimized approach to emotion recognition based on the efficient brain-inspired hyperdimensional computing (HDC) paradigm is proposed. Emotion recognition provides valuable information for human-computer…

Emerging Technologies · Computer Science 2021-04-08 Alisha Menon , Anirudh Natarajan , Reva Agashe , Daniel Sun , Melvin Aristio , Harrison Liew , Yakun Sophia Shao , Jan M. Rabaey

We replace the Hidden Markov Model (HMM) which is traditionally used in in continuous speech recognition with a bi-directional recurrent neural network encoder coupled to a recurrent neural network decoder that directly emits a stream of…

Neural and Evolutionary Computing · Computer Science 2014-12-05 Jan Chorowski , Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

Single image-based crowd counting has recently witnessed increased focus, but many leading methods are far from optimal, especially in highly congested scenes. In this paper, we present Hierarchical Attention-based Crowd Counting Network…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Vishwanath A. Sindagi , Vishal M. Patel

Attention mechanisms are widely used in current encoder/decoder frameworks of image captioning, where a weighted average on encoded vectors is generated at each time step to guide the caption decoding process. However, the decoder has…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Lun Huang , Wenmin Wang , Jie Chen , Xiao-Yong Wei