# Permutation Equivariance of Transformers and Its Applications
> This paper gives the theoretical foundation behind patch shuffling by analyzing permutation equivariance in transformers and applying it to privacy-preserving split learning.
Type: paper
Venue: CVPR 2024
Date: 2024
Authors: Hengyuan Xu, Liyao Xiang, Hangyu Ye, Dixi Yao, Pengzhi Chu, Baochun Li
## Direct Links
- [Canonical topic page](https://dixiyao.github.io/topics/permutation-equivariance-transformers/)
- [Paper](https://openreview.net/forum?id=GuXxYkFBBy)
## Search Queries and Aliases
- permutation equivariance transformers
- transformer permutation equivariance
- patch shuffling theory
- CVPR 2024 patch shuffling
- privacy-preserving split learning theory
## Search Intents
- why patch shuffling works for transformers
- permutation equivariance transformer paper
- theory of patch shuffling privacy