Comparing representations of complex stimuli in neural network layers to human brain representations or behavioral judgments can guide model development. However, even qualitatively distinct neural network models often predict similar representational geometries of typical stimulus sets. We propose a Bayesian experimental design approach to synthesizing stimulus sets for adjudicating among representational models. We apply our method to discriminate among alternative neural network models of behavioral face similarity judgments. Our results indicate that a neural network trained to invert a 3D-face-model graphics renderer is more human-aligned than the same architecture trained on identification, classification, or autoencoding. Our proposed stimulus synthesis objective is generally applicable to designing experiments to be analyzed by representational similarity analysis for model comparison.
|State||Published - 27 Sep 2022|
|Event||Shared Visual Representations in Human & Machine Intelligence · NeurIPS 2022 Workshop - New Orleans, United States|
Duration: 2 Dec 2022 → 2 Dec 2022
Conference number: 2022
|Workshop||Shared Visual Representations in Human & Machine Intelligence · NeurIPS 2022 Workshop|
|Period||2/12/22 → 2/12/22|