TransMix for CIFAR10

[khawar-islam]

Dear @kevin-ssy

How we can utilize TransMix for CIFAR-10 dataset? I have to conduct some experiments on CIFAR-10 dataset

[kevin-ssy]

We did not test on CIFAR-10 but if you want to then you should first follow the instructions of timm to run Vision Transformer on CIFAR-10.

Then you can apply TransMix on top of the baseline there.

[khawar-islam]

Thanks @kevin-ssy in your config file, the arch name is deit_small_patch16_224_return_attn. Are sure deit_small_patch16_224_return_attn exist in timm models? I have seen deit_small_patch16_224 in timm models