Neurophysiology of Multisensory Integration

Summary

Principal Investigator: John Foxe
Abstract: That the different senses sample unique aspects of physical objects should provide the brain with both a richer description of objects, and converging evidence concerning their position, identity and movement. Although there has been a detailed explication of multi sensory processing in the superior colliculus of cats and a number of multi sensory brain regions have been detailed in non-human primates, we have only a rudimentary understanding of how information from different sensory systems is combined in the human neo-cortex. The purpose of this proposal is to further our understanding of human cortical multi sensory integration through the combined use of event-related potential (ERP) recordings and functional imaging (fMRI). High-density mapping of ERPs recorded from 128 scalp electrodes, co-registration of these maps with individual subject MRI-derived anatomy, and source analysis of the surface recorded data will allow us to assess the brain regions involved in such integrations. Parallel fMRI experiments will allow us to precisely define the brain regions involved in a given multi sensory operation. Integration of ERP source-analyses and fMRI data will provide the spatio-temporal dynamics of multi sensory integration. Critically, the precise temporal resolution of the ERP will allow us to assess the time-course of multi sensory integration effects relative to the time-course of ongoing unisensory processing. We propose to determine: 1) the temporal separation parameters between the unisensory constituents of a bi-sensory audio-visual stimulus that result in modifications of the ERP interactions associated with bi-sensory stimulation, 2) whether spatial separation of bi-sensory stimuli modifies the early ERP interactions associated with bi-sensory stimulation, 3) whether top-down influences (attention) can effect the earliest multi-sensory interactions to bi-sensory stimulation, 4) to assess the effects of simultaneous stimulation in an entirely task-irrelevant sensory modality (vision) upon the ERP interactions with a second task-relevant sensory modality (somesthesis). Specifically, we wish to assess the effects of the irrelevant modality when it either contradicts or confirms task-relevant spatial information, 5) whether illusory changes in the perception of visual apparent motion, which are induced by presentation of simultaneous auditory stimuli, are the result of auditorily driven processing changes in visual motion processing areas. Through these studies, we will begin to explore the neural mechanisms underlying the process of "binding," related inputs across the separate sensory modalities.
Funding Period: 2003-06-01 - 2009-03-31
more information: NIH RePORT

Top Publications

  1. ncbi Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness
    Daniel Senkowski
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road Orangeburg, NY 10962, USA
    Neuroimage 56:2200-8. 2011
  2. pmc Generation of the VESPA response to rapid contrast fluctuations is dominated by striate cortex: evidence from retinotopic mapping
    E C Lalor
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA ie
    Neuroscience 218:226-34. 2012
  3. pmc Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter?
    Ian C Fiebelkorn
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, New York, NY 10031, USA
    Cereb Cortex 20:109-20. 2010
  4. ncbi The neurophysiology of human biological motion processing: a high-density electrical mapping study
    Aaron I Krakowski
    Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, Orangeburg, NY 10962, USA
    Neuroimage 56:373-83. 2011
  5. pmc The N1 auditory evoked potential component as an endophenotype for schizophrenia: high-density electrical mapping in clinically unaffected first-degree relatives, first-episode, and chronic schizophrenia patients
    John J Foxe
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, Orangeburg, NY 10962, USA
    Eur Arch Psychiatry Clin Neurosci 261:331-9. 2011
  6. pmc Cognitive control in late-life depression: response inhibition deficits and dysfunction of the anterior cingulate cortex
    Richard Katz
    Nathan S Kline Institute for Psychiatric Research, Orangeburg, NY, USA
    Am J Geriatr Psychiatry 18:1017-25. 2010
  7. ncbi Staying within the lines: the formation of visuospatial boundaries influences multisensory feature integration
    Ian C Fiebelkorn
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, 138th Street and Convent Avenue, New York, NY 10031, USA
    Eur J Neurosci 31:1737-43. 2010
  8. pmc A human intracranial study of long-range oscillatory coherence across a frontal-occipital-hippocampal brain network during visual object processing
    Pejman Sehatpour
    Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan S Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Proc Natl Acad Sci U S A 105:4399-404. 2008
  9. ncbi Changes in effective connectivity of human superior parietal lobule under multisensory and unisensory stimulation
    R J Moran
    The School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Dublin, Ireland
    Eur J Neurosci 27:2303-12. 2008
  10. pmc Are auditory-evoked frequency and duration mismatch negativity deficits endophenotypic for schizophrenia? High-density electrical mapping in clinically unaffected first-degree relatives and first-episode and chronic schizophrenia
    Elena Magno
    The Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Dublin, Ireland
    Biol Psychiatry 64:385-91. 2008

Scientific Experts

Detail Information

Publications69

  1. ncbi Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness
    Daniel Senkowski
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road Orangeburg, NY 10962, USA
    Neuroimage 56:2200-8. 2011
    ..Our findings demonstrate that the IE principle is applicable to early multisensory processing in humans...
  2. pmc Generation of the VESPA response to rapid contrast fluctuations is dominated by striate cortex: evidence from retinotopic mapping
    E C Lalor
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA ie
    Neuroscience 218:226-34. 2012
    ..We discuss the implications of this finding for previous and future research using the VESPA...
  3. pmc Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter?
    Ian C Fiebelkorn
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, New York, NY 10031, USA
    Cereb Cortex 20:109-20. 2010
    ..When a semantically congruent, task-irrelevant sound is simultaneously presented with a well-known visual target, the combined spread of attention through both mechanisms appears additive...
  4. ncbi The neurophysiology of human biological motion processing: a high-density electrical mapping study
    Aaron I Krakowski
    Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, Orangeburg, NY 10962, USA
    Neuroimage 56:373-83. 2011
    ..These results point to very early sensory registration of biological motion, and highlight the interactive role of the posterior STS in analyzing the movements of other living organisms...
  5. pmc The N1 auditory evoked potential component as an endophenotype for schizophrenia: high-density electrical mapping in clinically unaffected first-degree relatives, first-episode, and chronic schizophrenia patients
    John J Foxe
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, Orangeburg, NY 10962, USA
    Eur Arch Psychiatry Clin Neurosci 261:331-9. 2011
    ..In light of recent studies, these results point to the N1 deficit as an endophenotypic marker for schizophrenia. The potential future utility of this metric as one element of a multivariate endophenotype is discussed...
  6. pmc Cognitive control in late-life depression: response inhibition deficits and dysfunction of the anterior cingulate cortex
    Richard Katz
    Nathan S Kline Institute for Psychiatric Research, Orangeburg, NY, USA
    Am J Geriatr Psychiatry 18:1017-25. 2010
    ....
  7. ncbi Staying within the lines: the formation of visuospatial boundaries influences multisensory feature integration
    Ian C Fiebelkorn
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, 138th Street and Convent Avenue, New York, NY 10031, USA
    Eur J Neurosci 31:1737-43. 2010
    ....
  8. pmc A human intracranial study of long-range oscillatory coherence across a frontal-occipital-hippocampal brain network during visual object processing
    Pejman Sehatpour
    Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan S Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Proc Natl Acad Sci U S A 105:4399-404. 2008
    ..The results indicate that transient beta-band oscillatory coupling between these three distributed cortical regions may reflect a mechanism for effective communication during visual object processing...
  9. ncbi Changes in effective connectivity of human superior parietal lobule under multisensory and unisensory stimulation
    R J Moran
    The School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Dublin, Ireland
    Eur J Neurosci 27:2303-12. 2008
    ....
  10. pmc Are auditory-evoked frequency and duration mismatch negativity deficits endophenotypic for schizophrenia? High-density electrical mapping in clinically unaffected first-degree relatives and first-episode and chronic schizophrenia
    Elena Magno
    The Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Dublin, Ireland
    Biol Psychiatry 64:385-91. 2008
    ..The aim of this study was to investigate the extent to which dysfunction in MMN generation might represent an endophenotypic marker for schizophrenia...
  11. ncbi Distinct neurophysiological mechanisms mediate mixing costs and switch costs
    Glenn R Wylie
    Kessler Medical Rehabilitation Research and Education Center, West Orange, NJ 07052, USA
    J Cogn Neurosci 21:105-18. 2009
    ..By separating differences in ERP topography from differences in response strength, these results suggest that a reappraisal of previous research is appropriate...
  12. doi Visual sensory processing deficits in first-episode patients with Schizophrenia
    Sherlyn Yeap
    Schizophr Res 102:340-3. 2008
  13. ncbi Parvocellular and magnocellular contributions to the initial generators of the visual evoked potential: high-density electrical mapping of the "C1" component
    John J Foxe
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, New York, NY 10031, USA
    Brain Topogr 21:11-21. 2008
    ..For example, it is plausible that spatial attention mechanisms could operate primarily through the M system and that as such C1 may not always represent an adequate dependent measure in such studies...
  14. pmc Spatial attention modulates initial afferent activity in human primary visual cortex
    Simon P Kelly
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Cereb Cortex 18:2629-36. 2008
    ..This finding demonstrates that at the very moment that visual information first arrives in cortex, it is already being shaped by the brain's attentional biases...
  15. ncbi Dissecting the cellular contributions to early visual sensory processing deficits in schizophrenia using the VESPA evoked response
    Edmund C Lalor
    The Cognitive Neurophysiology Laboratory, St Vincent s Hospital Fairview, and School of Mechanical, Electrical and Electronic Engineering, University College Dublin, Dublin, Ireland
    Schizophr Res 98:256-64. 2008
    ....
  16. ncbi A spectrum of colors: investigating the temporal frequency characteristics of the human visual system using a system identification approach
    Edmund C Lalor
    Sch of Electr, Electron and Mech Eng, Univ Coll Dublin
    Conf Proc IEEE Eng Med Biol Soc 1:3720-3. 2006
    ..We show that noise signals with frequency content greater than 15 Hz are more effective at evoking these responses than those with little or no power at high frequencies...
  17. ncbi Early visual processing deficits in dysbindin-associated schizophrenia
    Gary Donohoe
    Neuropsychiatric Genetics Group, Institute of Molecular Medicine, Trinity College Dublin, St James Hospital, Dublin, Ireland
    Biol Psychiatry 63:484-9. 2008
    ..We investigated P1 performance, a component of early visual processing on which both patients and their relatives show deficits, in carriers and noncarriers of a known dysbindin risk haplotype...
  18. ncbi Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions
    Lars A Ross
    Program in Cognitive Neuroscience, Department of Psychology, The City College of City University of New York, 138th St and Convent Avenue, New York, New York 10031, USA
    Schizophr Res 97:173-83. 2007
    ..Our objective was to determine to what extent they experience benefit from visual articulation and to detail under what listening conditions they might show the greatest impairments...
  19. pmc Auditory processing in schizophrenia during the middle latency period (10-50 ms): high-density electrical mapping and source analysis reveal subcortical antecedents to early cortical deficits
    Victoria M Leavitt
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, Orangeburg, NY 10962, USA
    J Psychiatry Neurosci 32:339-53. 2007
    ....
  20. pmc Hemispheric asymmetry and callosal integration of visuospatial attention in schizophrenia: a tachistoscopic line bisection study
    Mark E McCourt
    Center for Visual Neuroscience, Department of Psychology, North Dakota State University, Fargo, North Dakota, 58105, USA
    Schizophr Res 102:189-96. 2008
    ..Numerous studies of patients with schizophrenia have implicated global deficits of either right or left hemisphere function, as well as compromised integrity of the corpus callosum...
  21. ncbi Visual sensory processing deficits in Schizophrenia and their relationship to disease state
    Sherlyn Yeap
    The Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Richmond Road, Fairview, Dublin 3, Ireland
    Eur Arch Psychiatry Clin Neurosci 258:305-16. 2008
    ....
  22. ncbi Crossmodal binding through neural coherence: implications for multisensory processing
    Daniel Senkowski
    Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg Eppendorf, Hamburg, Germany
    Trends Neurosci 31:401-9. 2008
    ..These results argue for a new view on multisensory processing which considers the dynamic interplay of neural populations as a key to crossmodal integration...
  23. pmc Visual sensory processing deficits in patients with bipolar disorder revealed through high-density electrical mapping
    Sherlyn Yeap
    The Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Richmond Road, Fairview, Dublin, Republic of Ireland
    J Psychiatry Neurosci 34:459-64. 2009
    ..Since the P1 deficit has already been established as an endophenotype in schizophrenia, a finding of commonality between disorders would raise the possibility that it represents a measure of common genetic liability...
  24. pmc Early processing in the human lateral occipital complex is highly responsive to illusory contours but not to salient regions
    Marina Shpaner
    Department of Psychology, The City College of the City University of New York, New York, NY 10031, USA
    Eur J Neurosci 30:2018-28. 2009
    ....
  25. ncbi Executive function and error detection: The effect of motivation on cingulate and ventral striatum activity
    Cristina Simões-Franklin
    Trinity College Dublin, Ireland
    Hum Brain Mapp 31:458-69. 2010
    ..This study suggests that there is a motivational influence on cognitive processes in the ACC and nucleus accumbens and hints at a dissociation between tonic proactive activity and phasic reactive error-related activity...
  26. ncbi Abnormal timing of visual feedback processing in young adults with schizophrenia
    Chantal Kemner
    Rudolf Magnus Institute of Neuroscience, Utrecht, The Netherlands
    Neuropsychologia 47:3105-10. 2009
    ..However, there is little knowledge on the role of feedbackward processing in this group. This question is of importance, as recent studies indicate that feedback processing is critical in stimulus integration...
  27. ncbi Preserved executive function in high-performing elderly is driven by large-scale recruitment of prefrontal cortical mechanisms
    Pierfilippo De Sanctis
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, Orangeburg, New York, USA
    Hum Brain Mapp 30:4198-214. 2009
    ..On this basis, we propose that preserved executive function in HP-elderly is driven by large-scale recruitment and enhancement of prefrontal cortical mechanisms...
  28. ncbi The neural correlates of deficient error awareness in attention-deficit hyperactivity disorder (ADHD)
    Redmond G O'Connell
    Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    Neuropsychologia 47:1149-59. 2009
    ..Our data provide evidence that neuropsychological deficits associated with ADHD can be exacerbated by error processing abnormalities. Error awareness may represent an important cognitive and physiological phenotype for ADHD...
  29. pmc Prefrontal and midline interactions mediating behavioural control
    Catherine Fassbender
    School of Psychology and Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    Eur J Neurosci 29:181-7. 2009
    ..These results suggest that prefrontal and midline regions work together to implement cognitive control and reveal that intra-subject variability is reflected in these lateral and midline interactions...
  30. ncbi Visual evoked spread spectrum analysis (VESPA) responses to stimuli biased towards magnocellular and parvocellular pathways
    Edmund C Lalor
    Trinity College Institute of Neuroscience, Department of Electrical and Electronic Engineering, Trinity College Dublin, Dublin, Ireland
    Vision Res 49:127-33. 2009
    ..Topographic distributions for both responses are compared and the findings are considered in terms of the response characteristics of the magnocellular and parvocellular visual pathways and the VESPA method itself...
  31. ncbi Differences in early sensory-perceptual processing in synesthesia: a visual evoked potential study
    Kylie J Barnett
    Institute of Neuroscience TCIN, Lloyd Building, Trinity College Dublin, Dublin 2, Ireland
    Neuroimage 43:605-13. 2008
    ..We discuss our results with reference to widespread connectivity differences as a broader phenotype of synesthesia...
  32. pmc Look who's talking: the deployment of visuo-spatial attention during multisensory speech processing under noisy environmental conditions
    Daniel Senkowski
    The Cognitive Neurophysiology Laboratory, Program in Cognitive, Neuroscience and Schizophrenia, Nathan S Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
    Neuroimage 43:379-87. 2008
    ..The present study provides neurophysiologic evidence that the deployment of visuo-spatial attention to flanking speakers interferes with the recognition of multisensory speech signals under noisy environmental conditions...
  33. ncbi Object-based attention is multisensory: co-activation of an object's representations in ignored sensory modalities
    Sophie Molholm
    The Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Eur J Neurosci 26:499-509. 2007
    ..These data are discussed in terms of 'priming' vs. 'spreading' accounts of attentional transfer...
  34. ncbi Forgetting as an active process: an FMRI investigation of item-method-directed forgetting
    Glenn R Wylie
    Department of Physical Medicine and Rehabilitation Kessler Medical Rehabilitation Research and Education Center, West Orange, NJ 07052, USA
    Cereb Cortex 18:670-82. 2008
    ..These results challenge the standard selective rehearsal account of item-method directed forgetting and suggest that frontal control processes may be critical for directed forgetting...
  35. ncbi Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study
    Daniel Senkowski
    The Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan S Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
    Neuroimage 36:877-88. 2007
    ..As such, there were clear differences in the cortical networks activated by multisensory motion stimuli as a consequence of the semantic relatedness (or lack thereof) of the constituent sensory elements...
  36. ncbi Spatiotemporal dynamics of human object recognition processing: an integrated high-density electrical mapping and functional imaging study of "closure" processes
    Pejman Sehatpour
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Neuroimage 29:605-18. 2006
    ....
  37. ncbi Biasing the brain's attentional set: I. cue driven deployments of intersensory selective attention
    John J Foxe
    Department of Psychology, Program in Cognitive Neuroscience, The City College of the City University of New York, North Academic Complex, 138th Street and Convent Avenue, NY 10031, USA
    Exp Brain Res 166:370-92. 2005
    ....
  38. ncbi Biasing the brain's attentional set: II. effects of selective intersensory attentional deployments on subsequent sensory processing
    John J Foxe
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, North Academic Complex, 138th Street and Convent Avenue, NY 10031, USA
    Exp Brain Res 166:393-401. 2005
    ..Rather, attentional biasing can operate through a higher-order process whereby parieto-occipital cortices influence the subsequent flow of visual processing in the ventral stream...
  39. ncbi Neural mechanisms involved in error processing: a comparison of errors made with and without awareness
    Robert Hester
    Department of Psychology and Trinity College Institute of Neuroscience, Trinity College, Dublin, Ireland
    Neuroimage 27:602-8. 2005
    ..Instead, it appears, irrespective of awareness, to detect information about stimuli/responses that requires interpretation in other brain regions for strategic implementation of post-error adjustments of behaviour...
  40. ncbi Neurophysiological markers of alert responding during goal-directed behavior: a high-density electrical mapping study
    Paul M Dockree
    Department of Psychology and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    Neuroimage 27:587-601. 2005
    ..The results are discussed in terms of models of sustained attention involving frontal and parietal cortices...
  41. ncbi Multisensory processes
    Salvador Soto-Faraco
    Cognitive Neuroscience Group, Departament de Psicologia Pàsica, Universitat de Barcelona, Pg Vall d Hebron, 171, 08035, Barcelona, Spain
    Exp Brain Res 166:287-8. 2005
  42. ncbi Multisensory contributions to low-level, 'unisensory' processing
    Charles E Schroeder
    Cognitive Neuroscience and Schizophrenia Program, The Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Rd, Orangeburg, NY 10962, USA
    Curr Opin Neurobiol 15:454-8. 2005
    ..In addition to enriching current models of multisensory processing and perceptual functions, these new findings require a revision in our thinking about unisensory processing in low level cortical areas...
  43. ncbi Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication
    Simon P Kelly
    Department of Electronic and Electrical Engineering, University College Dublin, Dublin 4, Ireland
    IEEE Trans Neural Syst Rehabil Eng 13:172-8. 2005
    ..Further, combining SSVEP features with attention-dependent parieto-occipital alpha band modulations resulted in an average accuracy of 79% (highest 87%)...
  44. ncbi Sensory contributions to impaired prosodic processing in schizophrenia
    David I Leitman
    Program in Cognitive Neuroscience and Schizophrenia, Nathan S Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
    Biol Psychiatry 58:56-61. 2005
    ..Within the auditory domain, patients show difficulty in interpreting vocal emotional cues based on intonation (prosody). The relationship of these symptoms to deficits in basic sensory processing has not been previously evaluated...
  45. ncbi The brain uses single-trial multisensory memories to discriminate without awareness
    Micah M Murray
    The Functional Electrical Neuroimaging Laboratory, Neuropsychology Division and Radiology Service, Centre Hospitalier Universitaire Vaudois, Hôpital Nestlé, 5 Avenue Pierre Decker, 1011 Lausanne, Switzerland
    Neuroimage 27:473-8. 2005
    ..Multisensory experiences are registered by the brain even when of no immediate behavioral relevance and can be used to categorize memories. These data reveal the functional efficacy of multisensory processing...
  46. ncbi Filling-in in schizophrenia: a high-density electrical mapping and source-analysis investigation of illusory contour processing
    John J Foxe
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, North Academic Complex NAC 138th St and Convent Avenue, New York, NY 10031, USA
    Cereb Cortex 15:1914-27. 2005
    ....
  47. ncbi The case for feedforward multisensory convergence during early cortical processing
    John J Foxe
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, New York, NY 10031, USA
    Neuroreport 16:419-23. 2005
    ....
  48. ncbi Kanizsa subjective figures capture visual spatial attention: evidence from electrophysiological and behavioral data
    Daniel Senkowski
    Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
    Neuropsychologia 43:872-86. 2005
    ..We conclude that KFs automatically capture spatial attention when used as visual cues...
  49. ncbi Look 'hear', primary auditory cortex is active during lip-reading
    Sophie Molholm
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Neuroreport 16:123-4. 2005
  50. ncbi Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment
    Micah M Murray
    The Cognitive Neurophysiology Lab, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Cereb Cortex 15:963-74. 2005
    ..Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory...
  51. ncbi Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study
    Daniel Senkowski
    The Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience, Nathan S Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
    Cereb Cortex 16:1556-65. 2006
    ..We conclude that the association between oscillatory beta activity and integrative multisensory processing is directly linked to multisensory RT facilitation effects...
  52. ncbi Flexible cognitive control: effects of individual differences and brief practice on a complex cognitive task
    A M Kelly
    School of Psychology and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    Neuroimage 31:866-86. 2006
    ..These results raise the possibility that a fundamental human ability, reflexive cognitive control, is amenable to practice...
  53. ncbi Enhanced and bilateralized visual sensory processing in the ventral stream may be a feature of normal aging
    Pierfilippo De Sanctis
    The Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Neurobiol Aging 29:1576-86. 2008
    ..Our results suggest that such compensatory mechanisms are not restricted to later higher-order cognitive processes but may also be a feature of early sensory-perceptual processes...
  54. ncbi The role of cingulate cortex in the detection of errors with and without awareness: a high-density electrical mapping study
    Redmond G O'Connell
    Department of Psychology and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    Eur J Neurosci 25:2571-9. 2007
    ..These findings may be particularly important in the context of clinical studies in which a proper understanding of self-monitoring deficits requires an explicit measurement of error awareness...
  55. ncbi Optimal sustained attention is linked to the spectral content of background EEG activity: greater ongoing tonic alpha (approximately 10 Hz) power supports successful phasic goal activation
    Paul M Dockree
    Department of Psychology and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    Eur J Neurosci 25:900-7. 2007
    ..The results are discussed in terms of increased alpha synchrony facilitating goal-directed behaviour...
  56. ncbi Patterns of normal human brain plasticity after practice and their implications for neurorehabilitation
    Clare Kelly
    School of Psychology and Trinity College Institute of Neuroscience, Trinity College, Dublin, Ireland
    Arch Phys Med Rehabil 87:S20-9. 2006
    ....
  57. ncbi Boundary completion is automatic and dissociable from shape discrimination
    Micah M Murray
    Functional Electrical Neuroimaging Laboratory, Neuropsychology Division and Radiology Service, Centre Hospitalier Universitaire Vaudois, Lausanne 1011, Switzerland
    J Neurosci 26:12043-54. 2006
    ..Collectively, these data provide further support for a multistage model of object processing under degraded viewing conditions...
  58. ncbi Early visual sensory deficits as endophenotypes for schizophrenia: high-density electrical mapping in clinically unaffected first-degree relatives
    Sherlyn Yeap
    Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Fairview, and Trinity College Institute of Neuroscience, Department of Psychology, Dublin, Ireland
    Arch Gen Psychiatry 63:1180-8. 2006
    ..Electrophysiological markers of sensory processing, observable in human event-related potentials, hold great promise in this regard, lying closer to underlying physiology than descriptive clinical diagnostic tests...
  59. pmc Visual white matter integrity in schizophrenia
    Pamela D Butler
    Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Rd, Orangeburg NY, 10962, USA
    Am J Psychiatry 163:2011-3. 2006
    ..Patients with schizophrenia have visual-processing deficits. This study examines visual white matter integrity as a potential mechanism for these deficits...
  60. pmc Subcortical visual dysfunction in schizophrenia drives secondary cortical impairments
    Pamela D Butler
    Nathan Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA
    Brain 130:417-30. 2007
    ....
  61. ncbi The VESPA: a method for the rapid estimation of a visual evoked potential
    Edmund C Lalor
    School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, and Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Fairview, Dublin, Ireland
    Neuroimage 32:1549-61. 2006
    ..The new method appears to provide a useful alternative to standard VEP methods, and to have potential application both in clinical practice and to the study of sensory and perceptual functions...
  62. ncbi Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments
    Lars A Ross
    Program in Cognitive Neuroscience, Department of Psychology, The City College of the City University of New York, New York, NY 10031, USA
    Cereb Cortex 17:1147-53. 2007
    ..At these intermediate levels, the extent of multisensory enhancement of speech recognition is considerable, amounting to more than a 3-fold performance improvement relative to an auditory-alone condition...
  63. pmc Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion
    Dave Saint-Amour
    Cognitive Neurophysiology Laboratory, Nathan S Kline Institute for Psychiatric Research, Program in Cognitive Neuroscience and Schizophrenia, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Neuropsychologia 45:587-97. 2007
    ..These findings support the notion that visually driven multisensory illusory phonetic percepts produce an auditory-MMN cortical response and that left hemisphere temporal cortex plays a crucial role in this process...
  64. ncbi Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings
    Sophie Molholm
    Cognitive Neurophysiology Lab, Program in Cognitive Neuroscience and Schizophrenia, Nathan S Kline Inst for Psychiatric Research, 140 Old Orangeburg Rd, Orangeburg, NY 10962, USA
    J Neurophysiol 96:721-9. 2006
    ..These results are discussed in the context of the role of SPL in supramodal spatial attention and sensory-motor transformations...
  65. ncbi The anterior cingulate and error avoidance
    Elena Magno
    Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin 2, Ireland
    J Neurosci 26:4769-73. 2006
    ..These results reveal that the functional role of the cingulate is not particular to errors but instead is related to an evaluative function concerned with on-line behavioral adjustment in the service of avoiding losses...
  66. ncbi Increases in alpha oscillatory power reflect an active retinotopic mechanism for distracter suppression during sustained visuospatial attention
    Simon P Kelly
    The Cognitive Neurophysiology Laboratory, St Vincent s Hospital, Fairview, Ireland
    J Neurophysiol 95:3844-51. 2006
    ..82), measured from the attention x hemisphere interaction. This strongly suggests that alpha synchronization reflects an active attentional suppression mechanism, rather than a passive one reflecting "idling" circuits...
  67. ncbi Mapping the functional anatomy of task preparation: priming task-appropriate brain networks
    Catherine Fassbender
    Department of Psychology and Institute of Neuroscience, Trinity College, Dublin, Ireland
    Hum Brain Mapp 27:819-27. 2006
    ..These results suggest that cue periods allow participants to prime task-relevant areas within the brain and highlight the importance of left DLPFC in top-down control...
  68. ncbi The neural circuitry of pre-attentive auditory change-detection: an fMRI study of pitch and duration mismatch negativity generators
    Sophie Molholm
    The Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA
    Cereb Cortex 15:545-51. 2005
    ..We also detail regions of the frontal and parietal cortices activated by change-detection processes. These regions also show feature dependence and we hypothesize that they reflect recruitment of attention-switching mechanisms...