Swin Transformer
model
Swin is a vision transformer that looks at an image in moving windows, which helps it hold detail at different scales. It is another candidate we compared before settling on a ViT-B/32.
For engineers: a hierarchical vision transformer with shifted-window attention; one of the embedder backbones we benchmarked.