Pretraining Language Models via Neural Cellular Automata (hanseungwook.github.io)

A research post exploring whether neural cellular automata can help with language model pretraining.