Curve detectors in CNNs
Nick Cammarata et al. published a new article on curve detectors in Distill’s Circuits thread (see DT #35, #37). It’s a deep dive into the 3b:379 neuron of the InceptionV1 network, and—as usual—it’s an exceptionally well-written and well-illustrated post. I also really like the idea of a CNN learning how to do e.g. curve detection (which hasn’t been solved classically!), and then teaching us how to implement it by hand. Goes to show the power of the Circuits hypothesis.