fMRI shows that semantic representations in left fusiform bias visual memory toward false recognition, whereas perceptual representations in right fusiform support true recognition and reduce false memory. Distinct hippocampal pathways push memory toward generalization or detail.