Show HN: Visualize ResNet Embeddings with UMAP

4 points

3 years ago

I took my personal backup (mostly family photos, some random scans, etc), extracted the embeddings from ResNet (pen-ultimate layer activations), and then plotted them with the UMAP algorithm and bokeh library

This was a one-afternoon learning exercise while doing the awesome Fast AI course. The results are quite fun. ResNet returns 512 feature and UMAP maps those features into 2D plane, preserving distances as much as possible. The outliers show that the embeddings "make sense", clustering the images that are similar to other ones in the cluster, and different from those outside the cluster.