← back to projects

Interactive demo

JEPA Token Explorer

A window into the patch tokens learned by my from-scratch I-JEPA on 28×28 MNIST. Click a digit in the gallery, then click or drag across a patch (4×4 tile) to inspect its token — its attention map, its nearest neighbours in embedding space, how that attention sharpened over 500 epochs of training, and where the token lands in a t-SNE of every patch.

gallery

selected digit

attention from this patch

epoch: