Exercises

afro trap r&b, accordion drill, koto alt-pop, doo-wop drumstep · 4:34

Listen on 93

Lyrics

[Verse 1]
Start with vectors high-dimensional space
Ten thousand bits to represent each place
Bind operation multiplies them clean
Bundle adds them up, a weighted scene
Unbind divides to find what's hiding there
Knowledge graphs encoded in the air
Entities become these dancing codes
Relationships flow down binary roads

[Chorus]
Bind and bundle, unbind the mystery
VSA holds our semantic history
Noise creeps in but patterns still survive
Sparse distributed memories come alive
Bind and bundle, query what you need
Neural mathematics plants the seed

[Verse 2]
Build a graph with people, places, things
Each node gets a vector that just sings
Paris bound to France through multiplication
Person bound to city, pure creation
Store the bundles in your memory bank
Query back the facts, give knowledge rank
Compositional structure breaks apart
When you unbind, you find each beating heart

[Chorus]
Bind and bundle, unbind the mystery
VSA holds our semantic history
Noise creeps in but patterns still survive
Sparse distributed memories come alive
Bind and bundle, query what you need
Neural mathematics plants the seed

[Verse 3]
Similarity measures guide the way
Cosine distance shows what vectors say
Threshold functions separate the wheat
From chaff that makes retrieval incomplete
Holographic properties emerge clear
Distributed pieces everywhere
Each fragment holds the whole inside
Mathematical magic cannot hide

[Bridge]
Now inject some noise into the stream
Gaussian chaos haunts your perfect dream
Measure how retrieval starts to fade
As corruption grows, what price you've paid
Forty percent noise might break the chain
But thirty keeps your knowledge flowing clean

[Verse 4]
Combine it now with sparse distributed store
Content-addressable, room for so much more
Kanerva's model meets hyperdimensional flight
Address patterns gleaming in the night
Interference patterns tell the tale
Of cortical columns that will never fail
Biology meets mathematics here
In computational circuits crystal clear

[Chorus]
Bind and bundle, unbind the mystery
VSA holds our semantic history
Noise creeps in but patterns still survive
Sparse distributed memories come alive
Bind and bundle, query what you need
Neural mathematics plants the seed

[Outro]
From brain to code and back again
The vectors dance in binary zen
Exercises done, the knowledge grows
How cortical computation flows

← Readings | Connection to neuroscience →