Current methods · NeurIPS 2025 and NeurIPS 2026 (oral)
Measuring what neural networks encode
Which inputs and features contribute to the information that a neural population represents?


Approach
Mutual information says how much a population encodes, not what. We derived, from explicit axioms, a decomposition of it across stimuli and features, then a multi-scale information geometry exactly related to it. Both are estimated with diffusion models, so they scale to natural images.
Result
Existing decompositions violate at least one axiom; ours satisfies them all. On macaque V1 and V4 recordings, the leading directions of the geometry were interpretable, differed between areas and agreed across encoding models, whereas those of Fisher information depended more on the model than on the data.
Why it matters for AI
The methods apply to any encoder, biological or artificial, and stay interpretable for high-performing deep networks.
My contribution
Co-first author of the NeurIPS 2025 paper, co-author of the NeurIPS 2026 oral, and developer of multigeom.

