English
Related papers

Related papers: Dense Transformer Networks

200 papers

We present a deep learning framework for accurate visual correspondences and demonstrate its effectiveness for both geometric and semantic matching, spanning across rigid motions to intra-class shape or appearance variations. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Christopher B. Choy , JunYoung Gwak , Silvio Savarese , Manmohan Chandraker

Masked Autoencoders is a simple yet powerful self-supervised learning method. However, it learns representations indirectly by reconstructing masked input patches. Several methods learn representations directly by predicting representations…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Daisuke Niizumi , Daiki Takeuchi , Yasunori Ohishi , Noboru Harada , Kunio Kashino

Non-linear spectral decompositions of images based on one-homogeneous functionals such as total variation have gained considerable attention in the last few years. Due to their ability to extract spectral components corresponding to objects…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Tamara G. Grossmann , Yury Korolev , Guy Gilboa , Carola-Bibiane Schönlieb

Neural network (connectionist) models are designed to encode image features and provide the building blocks for object and shape recognition. These models generally call for: a) initial diffuse connections from one neuron population to…

Neurons and Cognition · Quantitative Biology 2018-01-09 Ernest Greene

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

Deep neural networks have become ubiquitous for applications related to visual recognition and language understanding tasks. However, it is often prohibitive to use typical neural networks on devices like mobile phones or smart watches…

Machine Learning · Computer Science 2017-08-10 Sujith Ravi

Artificial Neuronal Networks are models widely used for many scientific tasks. One of the well-known field of application is the approximation of high-dimensional problems via Deep Learning. In the present paper we investigate the Deep…

Numerical Analysis · Mathematics 2021-10-06 F. Calabrò , S. Cuomo , F. Giampaolo , S. Izzo , C. Nitsch , F. Piccialli , C. Trombetti

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

The combination of the U-Net based deep learning models and Transformer is a new trend for medical image segmentation. U-Net can extract the detailed local semantic and texture information and Transformer can learn the long-rang…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Sheng He , Rina Bao , P. Ellen Grant , Yangming Ou

Transformer is the state-of-the-art model in recent machine translation evaluations. Two strands of research are promising to improve models of this kind: the first uses wide networks (a.k.a. Transformer-Big) and has been the de facto…

Computation and Language · Computer Science 2019-06-06 Qiang Wang , Bei Li , Tong Xiao , Jingbo Zhu , Changliang Li , Derek F. Wong , Lidia S. Chao

Deep neural networks are widely used in various domains. However, the nature of computations at each layer of the deep networks is far from being well understood. Increasing the interpretability of deep neural networks is thus important.…

Machine Learning · Computer Science 2018-12-19 Haiping Huang

We present Shape-Tailored Deep Neural Networks (ST-DNN). ST-DNN extend convolutional networks (CNN), which aggregate data from fixed shape (square) neighborhoods, to compute descriptors defined on arbitrarily shaped regions. This is natural…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Naeemullah Khan , Angira Sharma , Ganesh Sundaramoorthi , Philip H. S. Torr

Deep learning Networks play a crucial role in the evolution of a vast number of current machine learning models for solving a variety of real world non-trivial tasks. Such networks use big data which is generally unlabeled unsupervised and…

Neural and Evolutionary Computing · Computer Science 2015-06-26 N. E. Osegi , P. Enyindah

In this paper, we propose multi-stage and deformable deep convolutional neural networks for object detection. This new deep learning object detection diagram has innovations in multiple aspects. In the proposed new deep architecture, a new…

Computer Vision and Pattern Recognition · Computer Science 2014-09-12 Wanli Ouyang , Ping Luo , Xingyu Zeng , Shi Qiu , Yonglong Tian , Hongsheng Li , Shuo Yang , Zhe Wang , Yuanjun Xiong , Chen Qian , Zhenyao Zhu , Ruohui Wang , Chen-Change Loy , Xiaogang Wang , Xiaoou Tang

Scene parsing is an important and challenging prob- lem in computer vision. It requires labeling each pixel in an image with the category it belongs to. Tradition- ally, it has been approached with hand-engineered features from color…

Machine Learning · Statistics 2014-11-18 Rahul Mohan

Deep learning became the method of choice in recent year for solving a wide variety of predictive analytics tasks. For sequence prediction, recurrent neural networks (RNN) are often the go-to architecture for exploiting sequential…

Machine Learning · Computer Science 2016-11-09 Kin Gwn Lore , Daniel Stoecklein , Michael Davies , Baskar Ganapathysubramanian , Soumik Sarkar

Current object detection approaches predict bounding boxes, but these provide little instance-specific information beyond location, scale and aspect ratio. In this work, we propose to directly regress to objects' shapes in addition to their…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Saumya Jetley , Michael Sapienza , Stuart Golodetz , Philip H. S. Torr

Local feature matching between images remains a challenging task, especially in the presence of significant appearance variations, e.g., extreme viewpoint changes. In this work, we propose DeepMatcher, a deep Transformer-based network built…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Tao Xie , Kun Dai , Ke Wang , Ruifeng Li , Lijun Zhao

At present, the great achievements of convolutional neural network(CNN) in feature and metric learning have attracted many researchers. However, the vast majority of deep network architectures have been used to represent based on real…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Siwen Jiang , Wenxuan Wei , Shihao Guo , Hongguang Fu , Lei Huang

We propose a novel deep network structure called "Network In Network" (NIN) to enhance model discriminability for local patches within the receptive field. The conventional convolutional layer uses linear filters followed by a nonlinear…

Neural and Evolutionary Computing · Computer Science 2014-03-05 Min Lin , Qiang Chen , Shuicheng Yan