A colleague at work asked me for some tips on learning German and her situation and goals were fairly common so I thought I'd write up some notes here. For the specific scenario under consideration, and to ground what follows: my colleague's mother tongue is not English, but she wants to learn German since she now lives there. She's interested in...
My niece reached out to me a few days back asking about tips for studying at school. She was specifically interested in any ideas I had about how to excel in her maths studies. I wrote up my thoughts for her and it occurred to me yesterday that there might be some benefit from putting these notes online as well. Without further ado, therefore…...
I love blogging and I've benefitted a lot from what it's done for me ever since I started my first Geocities page in the mid 1990s. I maintain a technical blog at mlops.systems and a somewhat less technical blog at alexstrick.com/blog, though hope at some point to merge these together. In the past I would have been content with ensuring that my...
Not by Vermeer. This generated by my friend Stable Diffusion. I visited the bumper Vermeer exhibition today in Amsterdam. I had previously seen many of the works separately in different galleries in the USA and here in the Netherlands, but there's certainly a raw power to bringing them all...
I read 75 books this year (over 22,000 pages), and a few days still remain. Looking back over the full list, I'm both surprised at how many were only of middling reward. I think the key is to take one's sweet time on the true gems and speed through the should-have-been-a-blog-post dross. Out of the gems, the following stand out: Sabine...
A common criticism of deep learning models is that they are 'black boxes'. You put data in one end as your inputs, the argument goes, and you get some predictions or results out the other end, but you have no idea why the model gave your those predictions. This has something to do with how neural networks work: you often have many layers that are...
[These are mainly notes for myself, based off Jeremy Howard’s ‘Lesson 0’ video that was recently posted. It doesn’t capture the entirety of what was said during the course, but it includes pieces that I felt are relevant to me now and that might be relevant to me in the future.] decide when you’re studying be precise about how much time you’re...
The use of neural networks / architectures is a powerful pattern, but it's worth remembering that this pattern is part of the broader category of machine learning. (You can think of 'deep learning' as a rebranding of neural networks or what was once more commonly referred to as connectionism). In a classic essay published in 1962, an IBM...
One of the main ways that using neural networks to train models is different from traditional (imperative) programming can be illustrated with a specific task: let's say you want to use a computer to tell you whether any particular photo you give it is a cat or a dog.An imperative approach might be to make a mega list of certain kinds of features...
[This is part of a series on getting out of a language-learning plateau at the intermediate-advanced level. Check out the other parts...
Graphics Processing Units or GPUs are what your computer uses to quickly display your screen. Most computers (desktop or laptop) have one of these, and they are used to good effect to keep the screen refreshed and display everything in effectively realtime speed. The world of gaming is also, perhaps unsurprisingly, quite dependent on fast GPU...
The field of deep learning seems to have had a rough journey into public consciousness and adoption. In particular, two theoretical misunderstandings lead to funding being pulled and energy and attention moving away from the field: Minsky/Papert's book Perceptrons showed how a neural network using only one layer was unable to learn some critical...
Parallel Distributed Processing: Explorations in the Microstructure of Cognition, a multi-volume publication by David Rumelhart, James McClelland and the PDP Research Group, was released in 1968 and is recognised as one of the most important works relating to neural networks. They lay out eight features necessary to perform what they called...
I've now read a little about Rosenblatt's Perceptron in two different places: in the Howard/Gugger Deep Learning book, and also in Cade Metz' Genius Makers. Built in 1958, it is usually described as the first machine which was based on the principle of the artificial neutron. It used a single layer in this initial configuration, and even in that...
Deep Learning is an incredibly powerful technology and there are a number of (focused / specific) areas where it already surpasses human-level abilities. Here are some examples: Translation: If you haven't been watching closely, the quality of Google Translate translations has really been improved in recent years. This 2016 story is a little...
I've been re-reading Jeremy Howard & Sylvain Gugger's Deep Learning for Coders with Fastai and PyTorch and I really appreciate the reminder that a lot of barriers to entry into the Deep Learning space can be productively put to one side. Gatekeepers make four big claims: You need lots of maths to use Deep Learning to solve problems You need lots...
jQuery and Handlebars are both external to the core functionality of JavaScript. Both are libraries that we can use and include when making websites. Doing so is very simple. We include s in the head of our HTML file, as in the following example: Hello, World Note that jQuery is now modular, so you may want to consider...
Handlebars is a simple templating language that you can use with your JavaScript code. It came somewhat late to the game; Python and Ruby and others had their own templating options for a while. The problem it is trying to solve is the case where you have a lot of HTML code that you need to create in your JavaScript files, but you don't want to...
Towards the end of the Launch School core syllabus, we start to work with API calls. These allow us to pass information between servers. It turns out, this is really useful to be able to do.Many if not most of the things you do online involve API calls. That little widget on the side of the web page that shows today's weather: an API call. Even...
As part of my studies for Launch School, last month I was introduced to the idea of 'events' and how we can use the DOM and JavaScript to cause things to happen without having to force a full reload of the page. This is sometimes known as AJAX requests, which stands for Asynchronous JavaScript And XML. In this mental model, we can think of the...