Long, Wei; Chen, Ziyang; Li, Wenting; Zhang, Yongjun; Yao, He; Peng, Jiaxin; Cui, Zhongwei (2026) Leveraging negative correlation for Full-Range Self-Attention in Vision Transformers. Pattern Recognition, 169. doi:10.1016/j.patcog.2025.111899
Reference Type | Journal (article/letter/editorial) | ||
---|---|---|---|
Title | Leveraging negative correlation for Full-Range Self-Attention in Vision Transformers | ||
Journal | Pattern Recognition | ||
Authors | Long, Wei | Author | |
Chen, Ziyang | Author | ||
Li, Wenting | Author | ||
Zhang, Yongjun | Author | ||
Yao, He | Author | ||
Peng, Jiaxin | Author | ||
Cui, Zhongwei | Author | ||
Year | 2026 (January) | Volume | 169 |
Publisher | Elsevier BV | ||
DOI | doi:10.1016/j.patcog.2025.111899Search in ResearchGate | ||
Generate Citation Formats | |||
Mindat Ref. ID | 18581657 | Long-form Identifier | mindat:1:5:18581657:5 |
GUID | 0 | ||
Full Reference | Long, Wei; Chen, Ziyang; Li, Wenting; Zhang, Yongjun; Yao, He; Peng, Jiaxin; Cui, Zhongwei (2026) Leveraging negative correlation for Full-Range Self-Attention in Vision Transformers. Pattern Recognition, 169. doi:10.1016/j.patcog.2025.111899 | ||
Plain Text | Long, Wei; Chen, Ziyang; Li, Wenting; Zhang, Yongjun; Yao, He; Peng, Jiaxin; Cui, Zhongwei (2026) Leveraging negative correlation for Full-Range Self-Attention in Vision Transformers. Pattern Recognition, 169. doi:10.1016/j.patcog.2025.111899 | ||
In | (2026) Pattern Recognition Vol. 169. Elsevier BV |
References Listed
These are the references the publisher has listed as being connected to the article. Please check the article itself for the full list of references which may differ. Not all references are currently linkable within the Digital Library.
A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al., An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, in: International Conference on Learning Representations, 2020. | |
Touvron (2021) Training data-efficient image transformers & distillation through attention , 10347 | |
Not Yet Imported: - proceedings-article : 10.1109/ICCV48922.2021.00675 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: 2021 IEEE/CVF International Conference on Computer Vision (ICCV) - proceedings-article : 10.1109/ICCV48922.2021.00061 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: 2021 IEEE/CVF International Conference on Computer Vision (ICCV) - proceedings-article : 10.1109/ICCV48922.2021.00986 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: - proceedings-article : 10.1109/CVPR52729.2023.00995 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - proceedings-article : 10.1109/CVPR52729.2023.02279 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Xie (2024) GhostFormer: Efficiently amalgamated CNN-transformer architecture for object detection 148 | |
Not Yet Imported: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - proceedings-article : 10.1109/CVPR52729.2023.00500 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Xie (2021) Adv. Neural Inf. Process. Syst. SegFormer: Simple and efficient design for semantic segmentation with transformers 34, 12077 | |
Not Yet Imported: - proceedings-article : 10.1109/CVPR52688.2022.00135 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Zhang (2024) Pattern Recognit. TCFAP-Net: Transformer-based cross-feature fusion and adaptive perception network for large-scale point cloud semantic segmentation | |
Not Yet Imported: - proceedings-article : 10.1109/CVPR52688.2022.00476 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: - proceedings-article : 10.1109/ICCV51070.2023.00548 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Shaw (2018) | |
X. Chu, Z. Tian, B. Zhang, X. Wang, C. Shen, Conditional Positional Encodings for Vision Transformers, in: International Conference on Learning Representations, 2022. | |
Not Yet Imported: - proceedings-article : 10.1109/CVPR52688.2022.01181 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: - journal-article : 10.1007/s41095-022-0274-8 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: - proceedings-article : 10.1109/CVPR52729.2023.01387 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: Computational Visual Media - journal-article : 10.1007/s41095-022-0271-y If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: - journal-article : 10.1007/s10462-022-10148-x If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Vaswani (2017) vol. 30 | |
Not Yet Imported: - proceedings-article : 10.18653/v1/2022.naacl-main.319 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Devlin (2018) | |
Long (2023) IEEE Trans. Geosci. Remote Sens. Threshold attention network for semantic segmentation of remote sensing images | |
Not Yet Imported: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - proceedings-article : 10.1109/CVPR52729.2023.01780 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
G. Chen, X. Li, Y. Yang, W. Wang, Neural clustering based visual representation learning, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 5714β5725. | |
Krizhevsky (2012) Adv. Neural Inf. Process. Syst. Imagenet classification with deep convolutional neural networks 25 | |
Not Yet Imported: - proceedings-article : 10.1109/CVPR.2016.90 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
![]() | |
Katharopoulos (2020) Transformers are rnns: Fast autoregressive transformers with linear attention , 5156 | |
Z. Shen, M. Zhang, H. Zhao, S. Yi, H. Li, Efficient attention: Attention with linear complexities, in: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2021, pp. 3531β3539. | |
Not Yet Imported: - proceedings-article : 10.1109/ICCV48922.2021.00108 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Not Yet Imported: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - proceedings-article : 10.1109/CVPR46437.2021.00084 If you would like this item imported into the Digital Library, please contact us quoting Journal ID | |
Qiang (2022) Adv. Neural Inf. Process. Syst. Attcat: Explaining transformers via attentive class activation tokens 35, 5052 | |
Deng (2009) Imagenet: A large-scale hierarchical image database , 248 | |
Lin (2014) Microsoft coco: Common objects in context , 740 | |
![]() | |
Han (2024) Agent attention: On the integration of softmax and linear attention , 124 | |
Hatamizadeh (2023) Global context vision transformers , 12633 | |
Bolya (2022) Hydra attention: Efficient attention with many heads , 35 | |
Cai (2022) | |
I. Loshchilov, F. Hutter, Decoupled Weight Decay Regularization, in: International Conference on Learning Representations, 2018. | |
X. Glorot, Y. Bengio, Understanding the difficulty of training deep feedforward neural networks, in: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 2010, pp. 249β256, JMLR Workshop and Conference Proceedings. |
See Also
These are possibly similar items as determined by title/reference text matching only.
![]() | |
![]() | |
![]() | |
![]() | |
![]() | |
![]() | |
![]() | |
![]() | |
![]() | |
![]() | |
![]() |