PAWS introduces a way to combine a small fraction of labeled samples with unlabeled ones during the pre-training of vision models. With its simple and unique approach, it sets SOTA in semi-supervised learning that too with far less compute and parameters.Here's my implementation of PAWS in TensorFlow: https://github.com/sayakpaul/PAWS-TF/