Reverse Engineering a Neural Network's Clever Solution to Binary Addition

from blog cprimozic.net Blog, | ↗ original
There's a ton of attention lately on massive neural networks with billions of parameters, and rightly so. By combining huge parameter counts with powerful architectures like transformers and diffusion, neural networks are capable of accomplishing astounding feats. However, even small networks can be surprisingly effective - especially when...