Day 8 - Computing Matter (Tobi Delbruck, Melika Payvand, Walter Senn)
Today felt like a shift in perspective. The discussions kept circling a deeper question: What is the (biological and artificial) substrate of computation and how much does it matter? Three speakers approached this from different angles: Tobi Delbruck → sparsity and physical limits Melika Payvand → richer neuron models and input-dependent dynamics Walter Senn → dendrites, gain modulation, and links to attention/transformers The morning discussions moved across levels: from hardware constraints (sparsity), to neural (gated) dynamics, to cognitive function (attention in dendrites), and back again to... how do we design intelligent systems? Sparsity dominates everything (?) Tobi started from a deceptively simple question: What is the actual operating regime of the brain? He sparked discussion on brain insights and shared numbers/observations to understand efficiency. ~10¹⁵ synapses Avg ~1–10 Hz firing rates (very low) ~10⁻¹⁴ J per synaptic event (energy per synaptic operati...