Experience, Entropy and the Ephemeral - Part I

Disclaimer: These ideas are untested and only come from my intuition. I don’t have the resources to explore them any further. intro CoT and test time compute have been proven to be the future direction of language models for better or for worse. o1 and DeepSeek-R1 demonstrate a step function in model intelligence. Coconut also provides a way for...

This post is a critique of the direction of current AI models, particularly the path of scaling of current AI models. AI as collective intelligence Humanities intelligence and progress is really collective, everyone builds off the work of others. Take Tesla and Edison, each vehemently championed two sides of the same coin, AC and DC. Unlike a...

My vision for how AI will create the future. AI won’t replace programmers, but rather make it easier for programmers to replace everyone else. — Naval (@naval) January 3, 2025 core belief Every company will become a tech company People said this during the web era, and they were partially right. Every company has a website, every business manages...

github: https://github.com/Ocean-Moist/rohlang3 I’ve long been obsessed with minimalistic languages that still manage to have expressive power. My usual approach: start with a bare-bones combinator calculus (like SK), then keep adding “one more extension” until it looks suspiciously like a full-blown typed language. rohlang3 is exactly that...

I don’t mean this in the traditional sense of “perfect is the enemy of good”. I rarely held that idea to much credence anyways. What I mean is that perfection is an unimaginable idea that we have tricked ourselves into accepting as an ideal for various human endeavours. what does it mean for something to be perfect? Generally perfection is...