Sign and speech share partially overlapping conceptual representations

Evans, S., Price, C.J., Diedrichsen, J., Gutierrez-Sigut, E. and MacSweeney, M. Sign and speech share partially overlapping conceptual representations. Current Biology.

TitleSign and speech share partially overlapping conceptual representations
TypeJournal article
AuthorsEvans, S., Price, C.J., Diedrichsen, J., Gutierrez-Sigut, E. and MacSweeney, M.
Abstract

Conceptual knowledge is fundamental to human cognition. Yet the extent to which it is influenced by language is unclear. Studies of semantic processing show that similar neural patterns are evoked by the same concepts presented in different modalities (e.g. spoken words and pictures or text) [1–3]. This suggests that conceptual representations are ‘modality independent’. However, an alternative possibility is that the similarity reflects retrieval of common spoken language representations. Indeed, in hearing spoken language users, text and spoken language are co-dependent [4,5] and pictures are encoded via visual and verbal routes [6]. A parallel approach investigating semantic cognition, shows that bilinguals activate similar patterns for the same words in their different languages [7,8]. This suggests that conceptual representations are ‘language independent’. However, this has only been tested in spoken language bilinguals. If different languages evoke different conceptual representations, this should be most apparent comparing languages that differ greatly in structure. Hearing people with signing deaf parents are bilingual in sign and speech: languages conveyed in different modalities. Here we test the influence of modality and bilingualism on conceptual representation by comparing semantic representations elicited by spoken British English and British Sign Language in hearing early, sign-speech bilinguals. We show that representations of semantic categories are shared for sign and speech, but not for individual spoken words and signs. This provides evidence for partially shared representations for sign and speech, and shows that language acts as a subtle filter through which we understand and interact with the world.

JournalCurrent Biology
ISSN0960-9822
PublisherElsevier

Related outputs

Language experience impacts brain activation for spoken and signed language in infancy: Insights from unimodal and bimodal bilinguals
Mercure, E., Evans, S., Pirazzoli, L., Goldberg, L., Bowden-Howl, H., Coulson-Thaker, K., Beedie, I., Lloyd-Fox, S., Johnson, M.H. and MacSweeney, M. 2020. Language experience impacts brain activation for spoken and signed language in infancy: Insights from unimodal and bimodal bilinguals. Neurobiology of Language.

Beatboxers and guitarists engage sensorimotor regions selectively when listening to the instruments they can play
Krishnan, S., Lima, C., Evans, S., Chen, S., Guldner, S., Yeff, H., Manly, T. and Scott, S. 2018. Beatboxers and guitarists engage sensorimotor regions selectively when listening to the instruments they can play. Cerebral Cortex. 28 (11), pp. 4063-4079. doi:10.1093/cercor/bhy208

How auditory experience differentially influences the function of left and right superior temporal cortices
Twomey, T., Waters, D., Price, C.J., Evans, S. and MacSweeney, M. 2017. How auditory experience differentially influences the function of left and right superior temporal cortices. Journal of Neuroscience. 37 (9), pp. 9564-9573. doi:10.1523/JNEUROSCI.0846-17.2017

Distinct Processing of Ambiguous Speech in People with Non-Clinical Auditory Verbal Hallucinations
Alderson-Day, B., Lima, C., Evans, S., Krishnan, S., Shanmugalingam, P., Fernyhough, C. and Scott, S.K. 2017. Distinct Processing of Ambiguous Speech in People with Non-Clinical Auditory Verbal Hallucinations. Brain. 140 (9), pp. 2475-2489. doi:10.1093/brain/awx206

Comprehending auditory speech: previous and potential contributions of functional MRI
Evans, S. and McGettigan, C. 2017. Comprehending auditory speech: previous and potential contributions of functional MRI. Language, Cognition and Neuroscience. 32 (7), pp. 829-846. doi:10.1080/23273798.2016.1272703

What has replication ever done for us? Insights from neuroimaging of speech perception
Evans, S. 2017. What has replication ever done for us? Insights from neuroimaging of speech perception. Frontiers in Human Neuroscience. 11 (41), pp. 1-5. doi:10.3389/fnhum.2017.00041

Getting the Cocktail Party Started: Masking Effects in Speech Perception
Evans, S., McGettigan, C., Agnew, Z.K., Rosen, S. and Scott, S.K. 2016. Getting the Cocktail Party Started: Masking Effects in Speech Perception. Journal of Cognitive Neuroscience. 28 (3), pp. 483-500. doi:10.1162/jocn_a_00913

Visual Speech Perception in Children With Language Learning Impairments
Knowland, V.C.P., Evans, S., Snell, C. and Rosen, S. 2016. Visual Speech Perception in Children With Language Learning Impairments. Journal of Speech, Language, and Hearing Research. 59, pp. 1-14. doi:10.1044/2015_JSLHR-S-14-0269

Distinct neural systems recruited when speech production is modulated by different masking sounds
Meekings, S., Evans, S., Lavan, N., Boebinger, D., Krieger-Redwood, K., Cooke, M. and Scott, S.K. 2016. Distinct neural systems recruited when speech production is modulated by different masking sounds. Journal of the Acoustical Society of America. 140 (1), pp. 8-19. doi:10.1121/1.4948587

Do We Know What We’re Saying? The Roles of Attention and Sensory Information During Speech Production
Meekings, S., Boebinger, D., Evans, S., Lima, C.F., Chen, S., Ostarek, M. and Scott, S.K. 2015. Do We Know What We’re Saying? The Roles of Attention and Sensory Information During Speech Production . Psychological Science. 26 (12), pp. 1975-1977. doi:10.1177/0956797614563766

Feel the noise: Relating individual differences in auditory imagery to the structure and function of sensorimotor systems
Lima, C.F., Lavan, N., Evans, S., Agnew, Z., Halper, A.R., Shanmugalingam, P., Meekings, S., Boebinger, D., Ostarek, M., McGettigan, C., Warren, J.E. and Scott, S.K. 2015. Feel the noise: Relating individual differences in auditory imagery to the structure and function of sensorimotor systems. Cerebral Cortex. 25 (11), pp. 4638-4650. doi:10.1093/cercor/bhv134

Hierarchical organization of auditory and motor representations in speech perception: Evidence from searchlight similarity analysis
Evans, S. and Davis, M.H. 2015. Hierarchical organization of auditory and motor representations in speech perception: Evidence from searchlight similarity analysis. Cerebral Cortex. 25 (12), pp. 4772-4788. doi:10.1093/cercor/bhv136

Musicians and non-musicians are equally adept at perceiving masked speech
Boebinger, D., Evans, S., Rosen, S., Lima, C.F., Manly, T. and Scott, S.K. 2015. Musicians and non-musicians are equally adept at perceiving masked speech. Journal of the Acoustical Society of America. 137 (1), pp. 378-387. doi:10.1121/1.4904537

Changes of right-hemispheric activation after constraint-induced, intensive language action therapy in chronic aphasia: fMRI evidence from auditory semantic processing
Mohr, B., Difrancesco, S., Harrington, K., Evans, S. and Pulvermüller, F. 2014. Changes of right-hemispheric activation after constraint-induced, intensive language action therapy in chronic aphasia: fMRI evidence from auditory semantic processing. Frontiers in Human Neuroscience. 8, p. Article 919. doi:10.3389/fnhum.2014.00919

Does musical enrichment enhance the neural coding of syllables? Neuroscientific interventions and the importance of behavioral data
Evans, S., Meekings, S., Nuttall, H.E., Jasmin, K.M., Boebinger, D., Adank, P. and Scott, S.K. 2014. Does musical enrichment enhance the neural coding of syllables? Neuroscientific interventions and the importance of behavioral data. Frontiers in Human Neuroscience. 8, p. Article 964. doi:10.3389/fnhum.2014.00964

The Pathways for Intelligible Speech: Multivariate and Univariate Perspectives
Evans, S., Kyong, J.S., Rosen, S., Golestani, N., Warren, J.E., McGettigan, C., Mourão-Miranda, J., Wise, R.J.S. and Scott, S.K. 2014. The Pathways for Intelligible Speech: Multivariate and Univariate Perspectives . Cereb Cortex. 24 (9). doi:10.1093/cercor/bht083

An application of univariate and multivariate approaches in FMRI to quantifying the hemispheric lateralization of acoustic and linguistic processes
McGettigan, C., Evans, S., Rosen, S., Agnew, Z.K., Shah, P. and Scott, S.K. 2012. An application of univariate and multivariate approaches in FMRI to quantifying the hemispheric lateralization of acoustic and linguistic processes. Journal of Cognitive Neuroscience. 24 (3), pp. 636-652. doi:10.1162/jocn_a_00161

Categorizing Speech
Scott, S.K. and Evans, S. 2010. Categorizing Speech. Nature Neuroscience. 13 (11), pp. 1304-1306. doi:10.1038/nn1110-1304

Permalink - https://westminsterresearch.westminster.ac.uk/item/qwyvy/sign-and-speech-share-partially-overlapping-conceptual-representations


Restricted files

Accepted author manuscript
Under embargo until 09 Sep 2020

Share this
Tweet
Email