Interactive demo
JEPA Token Explorer
A window into the patch tokens learned by my from-scratch I-JEPA on 28×28 MNIST. Click a digit in the gallery, then click or drag across a patch (4×4 tile) to inspect its token — its attention map, its nearest neighbours in embedding space, how that attention sharpened over 500 epochs of training, and where the token lands in a t-SNE of every patch.
gallery
selected digit
attention from this patch
epoch:
nearest-neighbour patches (cosine)
each: the source digit with the matching patch boxed
attention over training
this patch's attention map at each checkpoint
token t-SNE (all patch tokens, coloured by digit)
the white ring is your selected token