ChatGPT as a query engine on a giant corpus of text

A lot of new CS grads have been noting that is really hard to get a job. I’ve personally been contacted by a couple people, including outside of Twitter, about the difficulty of finding a job. I’m sure if you’re reading this that you’ve heard some stories, too. Here I will attempt to provide some … Continue reading Why does getting a job in tech...

March 4, 2024 update: This blog has been updated to reflect additions to uv as of 0.1.12, specifically the --system flag. See Addendum section for more information. When I heard that Charlie Marsh, the creator of Ruff, created a fast replacement for pip called uv, I dropped everything I was doing and added it to … Continue reading How to cut your...

The question Quantian1 on Twitter poses the following “junior data scientist” interview question: (You can check the replies for my answer!) This is a fun regression math / intuition question. In the spirit of appreciation for these types of interview questions, here are a few more. I leave solving these problems as an exercise to … Continue...

If you Google for an explainer on the differences and use cases for the arithmetic mean vs geometric mean vs harmonic mean, I feel like everything you’ll find is pretty bad and won’t properly explain the intuition of what’s going on and why you’d ever do one or the other. In fact, you sometimes will … Continue reading Intuitive Explanation of...

This is more of a personal post than something intended to be profound. If you are looking for a point, you will not find one here. Frankly I am not even sure who the target audience is for this (probably “data scientists who hate themselves”?). I had been a data scientist for the past few … Continue reading Goodbye, Data Science