18 August 2024

16 links · Sunday

When Numbers Are Bits: Distributed Representations for Sets

According to the superposition hypothesis, vectors of activations inside a neural network are best viewed as superpositions of "feature vectors"—directions in activation space with specific, interpretable meanings. This hypothesis is related to the classic con…

The sentinel toothpaste: a useful programming technique for everyday life

Here’s one programming technique that I found very useful in daily life: the sentinel value. I use it pretty much every day – to manage toothpaste. In programming, a sentinel value is a simple way to keep track of the end of a list of items. Lets say you have …

Hologrammata - Gravity, entropy, and life.

Cosmology, or at least basic cosmology, models the world as perfectly homogeneous and isotropic. Everything in the study of the evolution of the Universe actually works out fine if this is at least true at all times on the largest scales, and observations conf…