English
Related papers

Related papers: End-to-End Transformer Based Model for Image Capti…

200 papers

For analysing and/or understanding languages having no word boundaries based on morphological analysis such as Japanese, Chinese, and Thai, it is desirable to perform appropriate word segmentation before word embeddings. But it is…

Computation and Language · Computer Science 2019-05-24 Shunsuke Kitada , Ryunosuke Kotani , Hitoshi Iyatomi

Image Captioning, or the automatic generation of descriptions for images, is one of the core problems in Computer Vision and has seen considerable progress using Deep Learning Techniques. We propose to use Inception-ResNet Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Sulabh Katiyar , Samir Kumar Borgohain

Convolution neural networks (CNNs) have succeeded in compressive image sensing. However, due to the inductive bias of locality and weight sharing, the convolution operations demonstrate the intrinsic limitations in modeling the long-range…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Dongjie Ye , Zhangkai Ni , Hanli Wang , Jian Zhang , Shiqi Wang , Sam Kwong

Transformer-based methods have achieved impressive image restoration performance due to their capacities to model long-range dependency compared to CNN-based methods. However, advances like SwinIR adopts the window-based and local attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Dafeng Zhang , Feiyu Huang , Shizhuo Liu , Xiaobing Wang , Zhezhu Jin

In a globalized world at the present epoch of generative intelligence, most of the manual labour tasks are automated with increased efficiency. This can support businesses to save time and money. A crucial component of generative…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Pranav Dandwate , Chaitanya Shahane , Vandana Jagtap , Shridevi C. Karande

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

Computation and Language · Computer Science 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

Deep Convolutional Neural Networks (CNNs) are powerful models that have achieved excellent performance on difficult computer vision tasks. Although CNNs perform well whenever large labeled training samples are available, they work badly on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Zhouyong Liu , Shun Luo , Wubin Li , Jingben Lu , Yufan Wu , Shilei Sun , Chunguo Li , Luxi Yang

In the past few years, convolutional neural networks (CNNs) have achieved milestones in medical image analysis. Especially, the deep neural networks based on U-shaped architecture and skip-connections have been widely applied in a variety…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Hu Cao , Yueyue Wang , Joy Chen , Dongsheng Jiang , Xiaopeng Zhang , Qi Tian , Manning Wang

In this work, we present Eformer - Edge enhancement based transformer, a novel architecture that builds an encoder-decoder network using transformer blocks for medical image denoising. Non-overlapping window-based self-attention is used in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-10 Achleshwar Luthra , Harsh Sulakhe , Tanish Mittal , Abhishek Iyer , Santosh Yadav

Vision transformer based models bring significant improvements for image segmentation tasks. Although these architectures offer powerful capabilities irrespective of specific segmentation tasks, their use of computational resources can be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Manyi Yao , Abhishek Aich , Yumin Suh , Amit Roy-Chowdhury , Christian Shelton , Manmohan Chandraker

Transformer models have recently achieved impressive performance on NLP tasks, owing to new algorithms for self-supervised pre-training on very large text corpora. In contrast, recent literature suggests that simple average word models…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Muhammet Bastan , Arnau Ramisa , Mehmet Tek

It is well believed that video captioning is a fundamental but challenging task in both computer vision and artificial intelligence fields. The prevalent approach is to map an input video to a variable-length output sentence in a sequence…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jingwen Chen , Yingwei Pan , Yehao Li , Ting Yao , Hongyang Chao , Tao Mei

Studies of image captioning are shifting towards a trend of a fully end-to-end paradigm by leveraging powerful visual pre-trained models and transformer-based generation architecture for more flexible model training and faster inference…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Pengpeng Zeng , Jinkuan Zhu , Jingkuan Song , Lianli Gao

Speech Emotion Recognition is a crucial area of research in human-computer interaction. While significant work has been done in this field, many state-of-the-art networks struggle to accurately recognize emotions in speech when the data is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Rashedul Hasan , Meher Nigar , Nursadul Mamun , Sayan Paul

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Deep learning-based image compression has made great progresses recently. However, many leading schemes use serial context-adaptive entropy model to improve the rate-distortion (R-D) performance, which is very slow. In addition, the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Haisheng Fu , Feng Liang , Jie Liang , Yongqiang Wang , Guohe Zhang , Jingning Han

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

Contemporary deep learning based video captioning follows encoder-decoder framework. In encoder, visual features are extracted with 2D/3D Convolutional Neural Networks (CNNs) and a transformed version of those features is passed to the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Nayyer Aafaq , Naveed Akhtar , Wei Liu , Ajmal Mian

Deep neural networks have been applied to improve the image quality of fluorescence microscopy imaging. Previous methods are based on convolutional neural networks (CNNs) which generally require more time-consuming training of separate…

The existing image captioning approaches typically train a one-stage sentence decoder, which is difficult to generate rich fine-grained descriptions. On the other hand, multi-stage image caption model is hard to train due to the vanishing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Jiuxiang Gu , Jianfei Cai , Gang Wang , Tsuhan Chen