Large Distribution Transformers