Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many secti…
This post is part of a series – go here for the index. Two posts ago, I explained write combining and used a real-world example to show how badly it can go wrong if you’re not careful. …
Google Research just released MusicLM: Generating Music From Text. It’s a new generative AI model that takes a descriptive prompt and produces a “high-fidelity” music track. Here’s the paper (and …
The third episode of the .NET GC Internals series explaining a real in-depth knowledge how .NET GC works. This episode is about the Concurrent Mark phase, di...