Language Models are Illiterate

from blog matt.sh, | ↗ original
Here’s some initial results after a couple thousand hours thinking about how and why the language model AIs are acting so intelligently and what the missing pieces are to make them full world-ending machines. Let’s work through the setups and conclusions together here. Your Brain is Not A Neural Network Your brain isn’t a single fully connected neural soup. Your skull meat brain is technically three brains with hundreds of...