what these neural networks are doing when they grok but also provided a new lens through which to examine their innards. The grokking setup is like a good model organism for understanding lots of different aspects of deep learning, said Eric Michaud of the Massachusetts Institute of Technology.