CLLMs - A Family of Efficient Parallel Decoders

Nope. I still own the original OP-1 and quite enjoy it, but this is quite a few Euro notches above the Field version and I think I’d rather build my music gadgets from here on out. Still, it’s one heck of a fashion statement. Can’t wait to see it on Bad Gear.

Yeah, I skipped a few weeks’ worth of notes, but the gist of things is that I moved to a new role, had a grueling first week (wasn’t able to leave the house for breaks), slept through most of Saturday and am still trying to figure out where all my free time went. The high point of the week is that I got a TerraMaster F4-424 MAX NAS in the post,...

After my review of the CM3588 running OpenMediaVault, I spent a little while trying to get it to run Proxmox with ZFS enabled. There still isn’t any official version of Proxmox for ARM64, so I stuck to Proxmox-Port, which has been working great for me on all the Rockchip devices I tested it on. Getting ZFS to work proved a bit challenging,...

I had a lot on my mind today (my recent change is taking a much bigger toll than anticipated), but this was, of course, inescapable, even for someone like me who abhors politics and never mentions it. To my US readership: I didn’t get a vote. And I understand that the US is a deeply divided country, and that at least half of you actually thought...

I think this both vindicates my year-long interest in running LLMs on industrial “edge” hardware and signals that it’s time to step back and re-assess how to address that space. 3.2 TOPS isn’t exactly stellar performance when compared to what you can (nominally) get out of a RK35xx’s built-in NPU and way below the target for things like Copilot...