Duarte O.Carmo

https://duarteocarmo.com/ (RSS)
visit blog
Upgrading this website's podcast with F5-TTS
11 Nov 2024 | original ↗

For the past year, this website's podcast companion has been running on a text-to-speech model called XTTS-v2. It's not horrible. And those who have heard my voice before might notice some similarities. But it's far from a pleasant listenning experience. But the world of text-to-speech (TTS) has been gradually moving …

What if ChatGPT's memory was a knowledge graph?
28 Oct 2024 | original ↗
Classification in the age of LLMs: The emoji problem
6 Oct 2024 | original ↗

For the past years Vitto and I have used Tricount to track our shared expenses. The app is actually pretty good, but there’s one small thing that annoys me quite a bit. Even though we spoke English to each other for the first month, we’ve since spoken a …

Around Iceland in 6 days
30 Aug 2024 | original ↗

For a short summer break, Vitto challenged me to visit Iceland with her. As someone that is used to going south for the summer - this sounded stupid at first, but I was incredibly surprised. For 6 days, we were pretty much in another planet. Here are some notes and tips …

Tanda Runner: A personalized running dashboard
22 Jul 2024 | original ↗

Tanda Runner is a web app that shows me the things I care most about when preparing my next marathon. I've also added a running coach/agent designed to give me actionable feedback about my training. Some of that feedback is probably hallucinatory - I'll get to it in a bit …

Do things that don't scale
6 Jun 2024 | original ↗

I'm lucky enough to work with some pretty talented folks. During a recent offsite, one of them gave a completely improvised talk. He had just gotten back home from holidays - so naturally, they didn't really have time to prepare anything. But what they said resonated. It was about improvisation. How …

How I self-host in 2024
28 Apr 2024 | original ↗

I'm a sucker for side projects. There's nothing quite like building something to learn about it. Over the last 5+ years I've accumulated a little over 15 small web apps and websites. Almost all of them are hosted on a small Hetzner server and deployed using a mix of ssh …

The best keyboard I've ever had
22 Apr 2024 | original ↗

There I was. Ready to click the big blue purchase button. 350 Euro, for a keyboard (!) Asking Vitto multiple times: is this really worth it? Should I go for it? I mean, that's a whole lot of dinners. After much hesitation, I did it. All black, with blank key caps …

An experiment with Gemma 2B and a Portuguese classic
10 Apr 2024 | original ↗
NewsHavn: Danish news, in English
26 Feb 2024 | original ↗

Conversas de café. Literally translated, means "coffee shop conversations". An upcoming election, the weather next week, a corruption scandal, a new policy. Just some examples of Conversas de café. As an expat living in Denmark for the past 7 years (without speaking the language), that's perhaps one of the things …

mistral-doc: Fine-tuning an LLM on my ChatGPT conversations
9 Feb 2024 | original ↗

Step-by-step instructions to do it yourself If you ever read this blog, you probably already know by now. For the past couple of months, I've been trying to create my very own Large Language Model. OpenAI's models have had a significant impact on my productivity. But something still bothers me …

What's in my NOW?
1 Feb 2024 | original ↗

issue #168 issue #168 Sign up...Sign up...

Self-hosting my personal LLM (but not quite)
21 Jan 2024 | original ↗

ChatGPT is now part of our daily lives. A quick question, an extra input, some quick feedback, I always reach for it. AGI or not AGI, I certainly can't deny the impact it has had on our lives. It's pretty incredible! But that small voice just won't go away. "Where …

Rebuilding /photos
2 Jan 2024 | original ↗

A couple of years ago, I decided to remove all my photos from Instagram. I wanted something for myself. Something that suited what I needed. The result was /photos. I wrote about it when I built it too. Here's a snippet from that post: [...] Uploading is by no means as …

You can now listen to this blog
8 Dec 2023 | original ↗

One of my favorite Portuguese columnists has this weird thing about his column. Maybe it's more common than I thought. For every piece he publishes, he also publishes a podcast version along with it. Now, either Publico has 27th century text-to-speech (TTS) technology, or he's actually reading them. I don't …

Should you go into management consulting? Maybe.
8 Nov 2023 | original ↗

A couple of days ago, someone shared this John Oliver video with me. In it, he shows all the ways McKinsey is a terrible organization. Not a minute in and I was already thinking about that management consulting blog post I always wanted to write. When I talk with people …

Changelog neural search
6 Oct 2023 | original ↗

Search is one of the most important breakthroughs of the internet. Some are saying a list of blue links is not enough - and that AI will overthrow search. I don't know if we're about to witness a revolution. But as with most things - there's only one way to know - to …

A poor man's guide to fine-tuning Llama 2
26 Sept 2023 | original ↗

Last Friday, Kostas and I found ourselves discussing AI over beers again. He was telling me how he thinks everyone else is decades away from OpenAI - and that they likely won't catch up soon. I disagreed. In fact, I think open source is quickly catching up, and getting closer by …

aicoverlettercreator.com
19 Jul 2023 | original ↗

Get rid of all applications that don't have a cover letter I remember it like it was yesterday. As I was leaving one of the first companies I've ever worked for, my manager asked me to hire my replacement. Drowning in hundreds of applications for the position, I still recall …

Supercharging my Telegram group with the help of ChatGPT
10 Jun 2023 | original ↗

While most people in Europe use WhatsApp, my group of friends and I use Telegram. For years now we've used things like Combot to see who's more silent than usual, and MissRose to give our monthly elected group admins moderation rights. Yeah, we take friendship that seriously. But now we …

Fine-tuning FLAN-T5 to replace my friends
24 May 2023 | original ↗

View Code They say that the best way to learn about something is to build it yourself. Everyone talks about OpenAI this, and OpenAI that. How about we fine tune a Large Language Model ourselves? If you heard about this models before, but are still curious about how all of …

Governo Sombra transcripts
19 Apr 2023 | original ↗

7 years. That's how long I've lived in Denmark for. I love it, but Portugal is still close to my heart. As an emigrant, it's always hard to stay connected to what's going on in Portugal. What are people talking about? What's in the news? What worries people? What is …

LLMs in production: lessons learned
26 Mar 2023 | original ↗

A couple of months ago nobody asked me about my work. Something related to computers and AI. Fast forward to today, even my uncle asks me about ChatGPT. The hype is real. Only time will tell if the hype will materialize. But while the world wonders, work goes on. In …

parlabot - ask the Portuguese parliament
27 Feb 2023 | original ↗

Large language models (LLM) are really dumb. I mean, how can you fail when the question is as simple as "What is 23 times 18"? Even though they're making most headlines, at the end of the day, these models are, predicting the next token based on the previous ones. If …

An opinionated Python boilerplate
17 Feb 2023 | original ↗

There's nothing quite like starting a new project. A greenfield, filled with possibilities. It's a privilege many don't come across. A lot of us, get thrown into projects with a lot of legacy code. But sometimes, we start from scratch. This is the time. The time to make all the …

On Rust
1 Jan 2023 | original ↗

It's that time of the year again. The family is getting together and celebrating. Grandma is cooking something amazing for dinner. I'm trying to solve Advent of Code puzzles. This year, I decided to do something different. Instead of solving the puzzles in Python, I decided that I would try …

Scaling Machine Learning microservices
17 Dec 2022 | original ↗

Machine learning is everywhere. The state-of-the art of the field is advancing at an astronomical pace. Machine learning is everywhere. The state-of-the art of the field is advancing at an astronomical pace. GPT-3GPT-3 can answer significantly complex questions, can answer significantly complex questions, Stable DiffusionStable Diffusion can generate incredible images from just words, and the list goes on. It’s nothing short of amazing. can generate incredible images from just words, and the list goes on. It’s nothing short of amazing. But while the state of the art is being pushed daily, the long tail...But while the state of the art is being pushed daily, the long tail...

Monitoring Machine Learning APIs
6 Dec 2022 | original ↗

Last Friday I presented at PyData Global. I talked about monitoring, but felt like there was more I should've said. So this article is just about that. Even though the number of models in the wild is growing, the field of monitoring is still green and full of unknowns. Almost …

Goodbye Apple Watch
29 Oct 2022 | original ↗

1768 days. That's how long I've used the Apple Watch. Just a little under 5 years, in case you're wondering. I really love it. I don't know about "future of computing" and all that, but it's definitely a device I've fallen in love with. Last week, for the first time …

infrequent.app - stay in touch with those who matter
23 Oct 2022 | original ↗

Some months ago, I built a small script to help me stay in touch with those who matter to me. The concept is fairly simple: I want to stay in touch with person p every t period of time. If t has passed, and you haven't talked to p, you …

Monitoring ML models with FastAPI and Evidently AI
17 Sept 2022 | original ↗

I've deployed a good amount of ML models to production. For many, deployment to production is the last step of the process. Once that's done, work is done. This is far from true. Once your model is out there, problems will start to arise. Some predictions will be wrong. Some …

Down from the Cloud
5 Aug 2022 | original ↗

I love the Cloud. For years, I've been deploying software to it. Azure, GCP, AWS, you name it. I've used most of them. To be honest, they're the same pig, but with different lipstick (like the Danes say). Package up your app, make some CI/CD magic, select your service …

A recipe recommendation system
26 Jun 2022 | original ↗

You arrive home and turn on Netflix. On the front page: hundreds of shows. They're not ordered randomly. Netflix has been perfecting the science of recommending shows for years now. Google has perfected the science of sorting search results. To this day, no one knows exactly how Google sorts their …

Serving models with FastAPI: It's not just about the speed
10 Jun 2022 | original ↗

Disclaimer: This post was originally published in the Amplemarket blog Serving and deploying Machine Learning models is a topic that can get complicated quite fast. At Amplemarket, my team and I, like to keep things simple. Let's talk about it. Simplicity is key At Amplemarket, we’re big fans of …

Mac apps you didn't know you needed
12 Apr 2022 | original ↗

I'm a bit of an iSheep. I didn't even know that term existed until a colleague used it on me a couple of years ago. But this is not an Apple vs. Windows (vs. Linux) post. I like my Mac, you might prefer your Windows or Linux machine - that's fine …

A simple system to stay in touch with people
21 Mar 2022 | original ↗

Someone once told me that my professional network is one of the most important things I'll build throughout my career. For years I've struggled to find a system that would help me stay in touch with my network. So I decided to build my own - let me show you how …

Visualizing every job in the world
10 Feb 2022 | original ↗

Imagine you have to classify every single job title in the world into 10 categories, how would you go about it? This is a fairly hard problem to solve. However, the European Union has actually taken it on. They named it: the ESCO project. (ESCO stands for European Skills, Competences …

Simple software
5 Jan 2022 | original ↗

In the summer of 2017 I wrote one of my very first programs: an algorithm that ranked leads. It would help our sales team to target the best potential customers in Boston and surrounding areas. We (me and my manager at the time) were making a short trip to the …

Os NFTs são estúpidos. Bora fazer uns
25 Dec 2021 | original ↗

English | Português As pessoas mais velhas não gostam de ideias novas. Os nossos pais e avós não percebem a maior parte das novidades de tecnologia que estão a nossa volta. Até o meu pai às vezes diz que não confia em shopping online. Cago-me a rir. A primeira vez que …

NFTs are dumb. Let's make some
25 Dec 2021 | original ↗

English | Português Old people don't like new ideas. We see it everywhere around us. Our parents still don't understand most of today's tech trends. Even my dad still doesn't trust online shopping. Which I find hilarious. The rise of NFTs is the first time I really felt old when talking …

How to work from home - revisited
20 Nov 2021 | original ↗

Revisiting Back in March last year, I wrote about how I was keeping sane while working from home. From then to now, a lot of things have changed. New house, new job, new habits. Not all has changed though. COVID is, and will be for some time, a reality. And …

Four years of Python
5 Oct 2021 | original ↗

The other day I realized: I've been programming in Python for about 4 years now. I do get paid to write code, but for some reason still don't consider myself a pro. I did learn some valuable lessons though. For those who just got started with Python, you'll hopefully take …

Self-hosting my Instagram profile
19 Sept 2021 | original ↗

After more than 5 years using Instagram, I decided it's time to move out. This "turning" point for me, is when I start loosing control and influence over the platform I'm using. This happens in a multitude of ways: Loosing control of what we consume/see (a) by means of …

The short tale of an online scam
23 Jun 2021 | original ↗

I'm moving places soon. I absolutely hate moving - but hey, it's like everything else in life: you push through. This time, there was a nice plot twist: someone tried to scam me online. This made things... interesting. Let's talk about it. When it sounds too good to be true it's …

Run every day
23 May 2021 | original ↗

Something fun happened the other day. While at dinner - I asked a co-worker if he did any sports. He answered, "Yeah, I run one mile every day, exactly the same route, around my building". The whole table started laughing. Thinking "here's Duarte running half marathons, he must think this guy …

How to build a newsletter using Python and FastAPI
10 Apr 2021 | original ↗

My favorite way of learning is by reading extensively about a topic. For this, nothing better then my Kindle. But I have been growing increasingly envious of the large bookshelves of scratched and highlighted books that I see in older generations. I mean, who doesn't dream about having their own …

Kindle highlights as a (free) service
20 Mar 2021 | original ↗

Transform your kindle highlights into a weekly newsletter that goes out every Friday. Get reminded of the most interesting things you've read about for Transform your kindle highlights into a weekly newsletter that goes out every Friday. Get reminded of the most interesting things you've read about for freefree.. InstructionsInstructions Plug your Kindle into your computerPlug your Kindle into your computer Find the Find the My Clippings.txtMy Clippings.txt file. (Should be somewhere in the "documents" folder of your Kindle) file. (Should be somewhere in the "documents" folder of your Kindle) Upload it: Upload it: ... ...

Hacking on my finances (Part 2: Beancount on Beanstalk)
14 Jan 2021 | original ↗

In part 1 of this series, I talked about the setup that I'm using to manage my finances and investments. In this part, I'll talk about how I migrated my accounting setup to the Cloud, and what I have learned in the process. The goal: Accessing my finances from anywhere …

Building a Telegram bot in Python to track your portfolio
22 Nov 2020 | original ↗

In the past months, I’ve been spending a lot of time researching about investing: building your portfolio, back testing it, tracking its performance, and acting accordingly. One of these endeavors (and my stubbornness to build my own tools) has led me to create a telegram bot, here’s a …

Hacking on my finances
17 Oct 2020 | original ↗

Currently, my job has taken a lot of my time. But who doesn't have time for side projects? At the end of the day - they keep us sane. So I’ve been currently hacking on a good way of managing my finances - and oh boy I’m having fun. Update …

Can I go home yet?
22 Jul 2020 | original ↗

On the 18th of June, Denmark announced new travel policies after the Coronavirus outbreak. From that date on, it allowed travel to all European countries except for Portugal and Sweden. Of course, this caused several news outlets to write on the issue (Local.dk, Politiken.dk, Reuters.com). But now …

The mini state of VIM 2019
19 Jul 2020 | original ↗

Why?Why?¶¶I like the Vim editor a lot.I like the Vim editor a lot. However, (at least for me), the Vim user base is still a mistery. Don't get me wrong, ressources such as the However, (at least for me), the Vim user base is still a mistery. Don't get me wrong, ressources such as the Vim SubredditVim Subreddit, and the , and the

NbHub: Share your jupyter notebooks with the world
21 Jun 2020 | original ↗

TL;DR: I created a small python package that allows you to share your jupyter notebooks right from the command line (like this one for example). To get started, visit nbhub.duarteocarmo.com. or pip install nbhub. Sharing jupyter notebooks is a pain We use jupyter notebooks for a wide …

Studying in Denmark as an international student
18 Jun 2020 | original ↗

It's now been almost 4 years since I first landed in Denmark to start my Master's degree at the Technical University of Denmark, here in Copenhagen. This is a small retrospective filled with tips, tricks, and memories from an international student. It serves no particular purpose other than possibly having …

VIM for Python development (and not only)
5 Jun 2020 | original ↗

tl;dr: This is a write up on how and why I use the famously hard-to-use VIM text editor. Skip to here if you already know VIM. Jump to the python specific section. See my .vimrc. Get my dotfiles. What the hell is VIM? We're all used to use our …

Neural Networks for Linear Regressions using Python
22 May 2020 | original ↗

Recently, I have been working on a project for Dataverz, the company of my ex-thesis supervisor (and regular collaborator) Pedro Parraguez. I was looking at ways of predicting the number of collaborations between COVID-19 researchers. Here's a small technique I learned during that work. Just take me to the code …

How to work from home
24 Mar 2020 | original ↗

Currently, the world is going through an epidemic crisis. Coronavirus has made most of us have to work from home, well, at least the ones who can. Foreseeably, for the next month, this will be the state of things. I have some experience working from home, although not extensive, most …

Rumps + Python: Coronavirus in your menu bar
18 Mar 2020 | original ↗

🦠 CoronaBar🦠 CoronaBar

Managing kindle highlights with Python and GitHub
24 Feb 2020 | original ↗

tl;dr: use this script to build a GitHub Repo like this one where you store all the highlights from your kindle books in an organized way. ⚠️ Update: Want to receive your kindle highlights as a newsletter? Well, I built something your will probably like! Kindle sucks, kindle is great …

↑ these items are from RSS. Visit the blog itself at https://duarteocarmo.com/ to find other articles and to appreciate the author's digital home.