English
Related papers

Related papers: Improving Semantic Segmentation in Transformers us…

200 papers

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

We propose a new learning method for heterogeneous domain adaptation (HDA), in which the data from the source domain and the target domain are represented by heterogeneous features with different dimensions. Using two different projection…

Machine Learning · Computer Science 2012-06-22 Lixin Duan , Dong Xu , Ivor Tsang

Next point-of-interest (POI) recommendation is a critical task in location-based social networks, yet remains challenging due to a high degree of variation and personalization exhibited in user movements. In this work, we explore the latent…

Information Retrieval · Computer Science 2023-10-24 Jiayi Xie , Zhenzhong Chen

Recent advances have demonstrated the powerful capability of transformer architecture in image restoration. However, our analysis indicates that existing transformerbased methods can not establish both exact global and local dependencies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhijun Tu , Kunpeng Du , Hanting Chen , Hailing Wang , Wei Li , Jie Hu , Yunhe Wang

Automatic pronunciation assessment plays a crucial role in computer-assisted pronunciation training systems. Due to the ability to perform multiple pronunciation tasks simultaneously, multi-aspect multi-granularity pronunciation assessment…

Computation and Language · Computer Science 2026-01-06 Hong Han , Hao-Chen Pei , Zhao-Zheng Nie , Xin Luo , Xin-Shun Xu

Survival prediction using whole-slide images (WSIs) is crucial in cancer re-search. Despite notable success, existing approaches are limited by their reliance on sparse slide-level labels, which hinders the learning of discriminative…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jiaqi Cui , Lu Wen , Yuchen Fei , Bo Liu , Luping Zhou , Dinggang Shen , Yan Wang

Incorporating hierarchical structures like constituency trees has been shown to be effective for various natural language processing (NLP) tasks. However, it is evident that state-of-the-art (SOTA) sequence-based models like the Transformer…

Machine Learning · Computer Science 2020-02-20 Xuan-Phi Nguyen , Shafiq Joty , Steven C. H. Hoi , Richard Socher

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

Unsupervised semantic segmentation aims to discover groupings within and across images that capture object and view-invariance of a category without external supervision. Grouping naturally has levels of granularity, creating ambiguity in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Tsung-Wei Ke , Jyh-Jing Hwang , Yunhui Guo , Xudong Wang , Stella X. Yu

Transformer's recent integration into style transfer leverages its proficiency in establishing long-range dependencies, albeit at the expense of attenuated local modeling. This paper introduces Strips Window Attention Transformer (S2WAT), a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chiyu Zhang , Xiaogang Xu , Lei Wang , Zaiyan Dai , Jun Yang

Heterogeneous information network (HIN) embedding has recently attracted much attention due to its effectiveness in dealing with the complex heterogeneous data. Meta path, which connects different object types with various semantic…

Social and Information Networks · Computer Science 2019-05-15 Sheng Zhou , Jiajun Bu , Xin Wang , Jiawei Chen , Can Wang

Many image understanding tasks involve identifying what is present and where it appears. However, tasks that address where, such as object discovery, detection, and segmentation, are often considerably more complex than image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ryota Yoshihashi , Masahiro Kada , Satoshi Ikehata , Rei Kawakami , Ikuro Sato

The Transformer is a sequence model that forgoes traditional recurrent architectures in favor of a fully attention-based approach. Besides improving performance, an advantage of using attention is that it can also help to interpret a model…

Human-Computer Interaction · Computer Science 2019-06-14 Jesse Vig

Recently, Transformer-based architecture has been introduced into single image deraining task due to its advantage in modeling non-local information. However, existing approaches tend to integrate global features based on a dense…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhentao Fan , Hongming Chen , Yufeng Li

Transformers have demonstrated remarkable performance in skeleton-based human action recognition, yet their quadratic computational complexity remains a bottleneck for real-world applications. To mitigate this, linear attention mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yue Li , Haoxuan Qu , Mengyuan Liu , Jun Liu , Yujun Cai

Medical image segmentation has seen significant improvements with transformer models, which excel in grasping far-reaching contexts and global contextual information. However, the increasing computational demands of these models,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Reza Azad , Leon Niggemeier , Michael Huttemann , Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Yury Velichko , Ulas Bagci , Dorit Merhof

Transformers have demonstrated exceptional in-context learning (ICL) capabilities, enabling applications across natural language processing, computer vision, and sequential decision-making. In reinforcement learning, ICL reframes learning…

Machine Learning · Computer Science 2025-11-14 Oliver Dippel , Alexei Lisitsa , Bei Peng

Saliency detection, finding the most important parts of an image, has become increasingly popular in computer vision. In this paper, we introduce Hierarchical Cellular Automata (HCA) -- a temporally evolving model to intelligently detect…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Yao Qin , Mengyang Feng , Huchuan Lu , Garrison W. Cottrell

Zero-shot learning (ZSL) tackles the unseen class recognition problem, transferring semantic knowledge from seen classes to unseen ones. Typically, to guarantee desirable knowledge transfer, a common (latent) space is adopted for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Shiming Chen , Guo-Sen Xie , Yang Liu , Qinmu Peng , Baigui Sun , Hao Li , Xinge You , Ling Shao

Humans are able to recognize structured relations in observation, allowing us to decompose complex scenes into simpler parts and abstract the visual world in multiple levels. However, such hierarchical reasoning ability of human perception…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Liulei Li , Tianfei Zhou , Wenguan Wang , Jianwu Li , Yi Yang