How Can I Know What You Think ? : Assessing Representational Similarity in Neural Systems
How do my mental states compare to yours? We suggest that, while we may not be able to compare experiences, we can compare neural representations, and that the correct wa y to compare neural representations is through analysis of th e distances between them. In this paper, we present a technique for measuring the similarities between representati ons at various layers of neural networks. We then use the measure to demonstrate empirically that different artificial neura l networks trained by backpropagation on the same categorizatio n task, even with different representational encodings of th e input patterns and different numbers of hidden units, reach st ate in which representations at the hidden units are similar.