What is SwiGLU?

We often worry about resources we’re about to run out of: oil, helium, phosphates… but what about those we’ve already depleted? Throughout history, humanity has exhausted some natural resources and species, some with disruptive consequences and others with none at all. Most of these examples are thought to be depleted, since the world is a large...

'Tis the season! For the third year, I'm starting my advent of no-AI: uninstalling Copilot and logging out of Claude/ChatGPT/Gemini for a month. This helps me assess how dependent on it I've become, and how much rustier I am when stripped of my artificial thinking augments. Christmas is usually presented as a warm time to be with the people, and...

Recently my posts were getting a bit too techy and serious, so I want to make up for it. Last year, I was in charge of setting up and maintaining our 40+ camp bikes, trikes, e-bikes and scooters, so here is a list of advice I gathered for anyone who needs to do some maintenance on theirs. Do it camp-wise Being able to fix the main problems for...

Coding time-related stuff is complicated: timezones, concurrency, API quotas, multi-party synchronization, networking… everything that time touches becomes messy. In this post, I want to describe some typical time-related function wrappers that are useful during the dev experience, with a special focus on front-end examples. Throttle Throttling...

After so long, I still find basic stuff in Python that I didn't know about. Here are some of my most recent TILs. --> You can use underscores to separate digits in a number and they'll be ignored by the interpreter: >>> 1000000 # confusing 1000000 >>> 1e6 # not confusing but creates a float 1000000.0 >>> 1_000_000 # great! 1000000 The sum...