The remarkable strides made by the Transformer architecture in Natural Language Processing (NLP) have ignited a surge of interest within the Computer Vision (CV) community. The Transformer’s adaptation in vision tasks, termed Vision Transformers (ViTs), delineates images into non-overlapping patches, converts each patch into tokens, and subsequently applies Multi-Head Self-Attention (MHSA) to capture inter-token dependencies.…
Read More