My guess is that the rods and cones in the retina gets imprinted with this motion, so that when you look away they still want to see the pattern. It could also be the firing of the neurons from the ganglion cells, that get fucked up by this pattern...
edit: holy shit, amazing
Cool effect though :)
it's an old trick though.
the world longer : P