[Verse 1] Deep inside the cortex where the pyramids reside Six layers stacked precisely, computational pride Each column just a millimeter, packed with cells so tight Processing local patterns in their dendritic sight The soma fires signals when the threshold has been crossed Apical trees reaching up, no information lost Basal dendrites capturing what neighbors have to say While inhibition sculpts the noise, keeps chaos at bay [Chorus] Tiny units, local math, gradient descent in flesh Pyramidal cells align with algorithms fresh Many small computations, distributed and free Biology meets calculus in cortical harmony Constraint by anatomy, the math must find its way Through real neural circuits where the gradients play [Verse 2] Feedforward drives the message from layer four on up While feedback flows from six to one, filling up the cup Each minicolumn processes a feature sharp and clean While hypercolumns organize the broader visual scene The calcium cascades trigger plasticity's embrace Hebbian learning sculpting synapses in their place Error signals propagate through cortical terrain Teaching every pyramid to minimize the pain [Chorus] Tiny units, local math, gradient descent in flesh Pyramidal cells align with algorithms fresh Many small computations, distributed and free Biology meets calculus in cortical harmony Constraint by anatomy, the math must find its way Through real neural circuits where the gradients play [Bridge] No backprop through the soma, but the math still works somehow Local updates approximate what global rules allow Sparse coding in the columns, efficiency refined Temporal dynamics dancing with the gradient's design [Verse 3] Excitatory highways connect the distant zones While GABAergic gatekeepers protect their local homes The math emerges naturally from cellular constraints Each spike train carrying messages without complaints Ten billion tiny processors working in concert grand Proving that distributed systems follow math's command From molecules to networks, the equations come alive In cortical machinery where consciousness can thrive [Chorus] Tiny units, local math, gradient descent in flesh Pyramidal cells align with algorithms fresh Many small computations, distributed and free Biology meets calculus in cortical harmony Constraint by anatomy, the math must find its way Through real neural circuits where the gradients play [Outro] Where mathematics meets the meat, the models come together Cortical computations lasting through all kinds of weather
← Exercises | The seven conditions for gradient equivalence →