25 May 2025

19 links · Sunday

LLM Inference Economics from First Principles

The main product LLM companies offer these days is access to their models via an API, and the key question that will determine the profitability they can enjoy is the inference cost structure.

Exploring z.sh 🕵️ Part 1 - Storing data

Learning shell scripting through code analyses of a real-world example, breaking the ‘z’ program line by line to understand what’s happening under the hood and hopefully become a better bash programmer -- Part 1.

Rich: Enrich your CSVs with new columns

This week a fellow B12er was performing an ad-hoc data analysis. They had a spreadsheet with some data, and wanted to classify the rows in the spreadsheet by a few different criteria along which they would look for trends. For an engineer, this would have been…

A SomewhatMaxSAT Solver

As you may recall from previous posts and elsewhere I have been busy writing a new solver for APT. Today I want to share some of the latest changes in how to approach solving. The idea for the solver was that manually installed packages are always protected fr…

Very fast vector sum without CUDA.

In my most recent blogpost I gave an introduction to the Mojo programming language. This blogpost will provide a workflow how to archive peak performance on...

Scaling Starts with Simplicity

In small to mid-sized engineering teams, unchecked diversity in backend technology stacks can lead to increased cognitive load, fragmented knowledge, and reduced team mobility. While each language or tool may offer individual advantages, the lack of alignment …

One Week of Full-Time Indie Game Development

Devlog video about "HomeGrown", the casual farming game I'm creating using my own engine. Support the channel on Patreon and get access to the game & code for Homegrown, the city-builder, and Equilinox: https://www.patreon.com/thinmatrix Play my previous gam…

System Card: Claude Opus 4 & Claude Sonnet 4

Direct link to a PDF on Anthropic's CDN because they don't appear to have a landing page anywhere for this document. Anthropic's system cards are always worth a look, and …

The Who Cares Era | dansinker.com

Earlier this week, it was discovered that the Chicago Sun-Times and the Philadelphia Inquirer had both published an externally-produced "special supplement" that contained facts, experts, and book titles entirely made up by an AI chatbot. There's been a lot wr…