· 2 min read
Archives

Codebases as neural networks

Uhh could we turn codebases into neural networks and then do verifiable interpretability on them?

A diagram illustrates a process where cars and dogs initially share a "pose" stage, then encounter a gate that allows cars to proceed to "car detectors" and diverts dogs to "dogs." Below the diagram, text describes how a sports car is processed through a large model, initially grouped with rectangular shapes, then separated from snakes and dogs, and finally distinguished from station wagons.

Just spitballing here, I haven’t deep-dived either of these yet but am I seeing something or am I goofin

Oh the above diagram from https://already-clean.goodfire.com/ if you haven’t seen yet it’s got some great viz to go with the findings

View original