#interpretability

The Cat-and-Car Neuron Was a V

One unit in an early image model fired for cat faces and car fronts, and it became the standing proof that a network short of room jams unrelated ideas into the same neuron. The researcher who published it spent a few seconds wondering what one thing the unit was actually for, and stopped seeing cats.