Ideas for CoT Models: A Geometric Perspective on Latent Space Reasoning
Disclaimer: These ideas are untested and only come from my intuition. I don’t have the resources to explore them any further. intro CoT and test time compute have been proven to be the future direction of language models for better or for worse. o1 and DeepSeek-R1 demonstrate a step function in model intelligence. Coconut also provides a way for...
What I Would Tell the Frontier Labs
This post is a critique of the direction of current AI models, particularly the path of scaling of current AI models. AI as collective intelligence Humanities intelligence and progress is really collective, everyone builds off the work of others. Take Tesla and Edison, each vehemently championed two sides of the same coin, AC and DC. Unlike a...
How AI Will Create the Future
My vision for how AI will create the future. AI won’t replace programmers, but rather make it easier for programmers to replace everyone else. — Naval (@naval) January 3, 2025 core belief Every company will become a tech company People said this during the web era, and they were partially right. Every company has a website, every business manages...
rohlang3: (an attempt at) a point-free, homoiconic, and dependently typed SK calculus
github: https://github.com/Ocean-Moist/rohlang3 I’ve long been obsessed with minimalistic languages that still manage to have expressive power. My usual approach: start with a bare-bones combinator calculus (like SK), then keep adding “one more extension” until it looks suspiciously like a full-blown typed language. rohlang3 is exactly that...
Evolution's Design Pattern
There’s something interesting and beautiful about evolution that is often overlooked: it works through emergence. No central planning, no intelligent design, just countless micro-interactions creating macro-level optimization that appears almost deliberately crafted. the diversity problem Think about what human society needs to function. We need...