ViT

Investigating Bidimensional Downsampling in Vision Transformer Models
[ ICIAP 2021 | Best Paper Award sponsored by NVIDIA ] We explore the application of a 2D max-pooling operator to improve the efficiency of Transformer-based architecture for classification.
Paolo Bruno, Roberto Amoroso, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, Rita Cucchiara
PDF Cite Video
Investigating Bidimensional Downsampling in Vision Transformer Models