JOHN P O'DOHERTY

Summary

Affiliation: California Institute of Technology
Country: USA

Publications

  1. pmc Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain
    Hackjin Kim
    PLoS Biol 4:e233. 2006
  2. ncbi request reprint Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum
    JOHN P O'DOHERTY
    Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK
    Neuron 49:157-66. 2006
  3. ncbi request reprint Model-based fMRI and its application to reward learning and decision making
    JOHN P O'DOHERTY
    Computational and Neural Systems Program, California Institute of Technology, Pasadena, CA 91125, USA
    Ann N Y Acad Sci 1104:35-53. 2007
  4. ncbi request reprint Reward representations and reward-related learning in the human brain: insights from neuroimaging
    JOHN P O'DOHERTY
    Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK
    Curr Opin Neurobiol 14:769-76. 2004
  5. pmc Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making
    Jan Gläscher
    Division of Humanities and Social Sciences, California Institute of Technology, MC 114 96, 1200 E California Boulevard, Pasadena, CA 91125, USA
    Cereb Cortex 19:483-95. 2009
  6. pmc Neural correlates of the divergence of instrumental probability distributions
    Mimi Liljeholm
    Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 33:12519-27. 2013
  7. pmc Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus
    Seung Lark Lim
    Department of Psychology, University of Missouri Kansas City, Kansas City, Missouri 64110, USA
    J Neurosci 33:8729-41. 2013
  8. pmc Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends
    Christopher K Kovach
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 32:8434-42. 2012
  9. pmc Neural computations underlying action-based decision making in the human brain
    Klaus Wunderlich
    Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA, USA
    Proc Natl Acad Sci U S A 106:17199-204. 2009
  10. pmc Calculating consequences: brain systems that encode the causal effects of actions
    Saori C Tanaka
    Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 28:6750-5. 2008

Detail Information

Publications47

  1. pmc Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain
    Hackjin Kim
    PLoS Biol 4:e233. 2006
    ..This neural signal may itself act as an intrinsic reward, thereby serving to reinforce actions during instrumental avoidance...
  2. ncbi request reprint Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum
    JOHN P O'DOHERTY
    Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK
    Neuron 49:157-66. 2006
    ..These results provide insight into the neural mechanisms underlying human preference behavior...
  3. ncbi request reprint Model-based fMRI and its application to reward learning and decision making
    JOHN P O'DOHERTY
    Computational and Neural Systems Program, California Institute of Technology, Pasadena, CA 91125, USA
    Ann N Y Acad Sci 1104:35-53. 2007
    ..Finally, some of the limitations of this approach will be discussed...
  4. ncbi request reprint Reward representations and reward-related learning in the human brain: insights from neuroimaging
    JOHN P O'DOHERTY
    Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1N 3BG, UK
    Curr Opin Neurobiol 14:769-76. 2004
    ..Such representations can be used to guide action selection for reward, a process that depends, at least in part, on orbital and medial prefrontal cortex as well as dorsal striatum...
  5. pmc Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making
    Jan Gläscher
    Division of Humanities and Social Sciences, California Institute of Technology, MC 114 96, 1200 E California Boulevard, Pasadena, CA 91125, USA
    Cereb Cortex 19:483-95. 2009
    ..These findings suggest that ventromedial prefrontal cortex may play a role in encoding the value of chosen actions irrespective of whether those actions denote physical motor responses or more abstract decision options...
  6. pmc Neural correlates of the divergence of instrumental probability distributions
    Mimi Liljeholm
    Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 33:12519-27. 2013
    ....
  7. pmc Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus
    Seung Lark Lim
    Department of Psychology, University of Missouri Kansas City, Kansas City, Missouri 64110, USA
    J Neurosci 33:8729-41. 2013
    ....
  8. pmc Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends
    Christopher K Kovach
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 32:8434-42. 2012
    ....
  9. pmc Neural computations underlying action-based decision making in the human brain
    Klaus Wunderlich
    Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA, USA
    Proc Natl Acad Sci U S A 106:17199-204. 2009
    ..Furthermore, we also found signals in the dorsomedial frontal cortex that resemble the output of a decision comparator, which implicates this region in the computation of the decision itself...
  10. pmc Calculating consequences: brain systems that encode the causal effects of actions
    Saori C Tanaka
    Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 28:6750-5. 2008
    ..These results reveal the involvement of distinct brain regions in the computational processes that establish the causal efficacy of actions, providing insight into the neural mechanisms underlying the adaptive control of behavior...
  11. doi request reprint Human medial orbitofrontal cortex is recruited during experience of imagined and real rewards
    Signe Bray
    Computation and Neural Systems, California Institute of Technology, Pasadena, California, USA
    J Neurophysiol 103:2506-12. 2010
    ..These findings support a critical role for mOFC in the representation of rewarding goal states, even if hypothetical...
  12. ncbi request reprint The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans
    Alan N Hampton
    Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 26:8360-7. 2006
    ..These results suggest that brain regions, such as the vmPFC, use an abstract model of task structure to guide behavioral choice, computations that may underlie the human capacity for complex social interactions and abstract strategizing...
  13. pmc Contributions of the striatum to learning, motivation, and performance: an associative account
    Mimi Liljeholm
    Division of the Humanities and Social Sciences, and Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA 91125, USA
    Trends Cogn Sci 16:467-75. 2012
    ....
  14. doi request reprint Contributions of the ventromedial prefrontal cortex to goal-directed action selection
    JOHN P O'DOHERTY
    Computation and Neural Systems, California Institute of Technology, Pasadena, CA 91125, USA
    Ann N Y Acad Sci 1239:118-29. 2011
    ....
  15. doi request reprint The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention
    Seung Lark Lim
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 31:13214-23. 2011
    ..These attention-modulated relative value signals might serve as the input of a comparator system that is used to make a choice...
  16. doi request reprint The neural mechanisms underlying the influence of pavlovian cues on human decision making
    Signe Bray
    Computation and Neural Systems, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 28:5861-6. 2008
    ..The results of this study are relevant for understanding how marketing actions can affect consumer choice behavior as well as for how environmental cues can influence drug-seeking behavior in addiction...
  17. doi request reprint Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain
    Vivian V Valentin
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California, USA
    J Neurophysiol 102:3384-91. 2009
    ....
  18. ncbi request reprint Anxiety reduction through detachment: subjective, physiological, and neural effects
    Raffael Kalisch
    University College London, UK
    J Cogn Neurosci 17:874-83. 2005
    ..Using functional magnetic resonance imaging, we locate the potential site and source of this modulation of anticipatory anxiety in the medial prefrontal/anterior cingulate and anterolateral prefrontal cortex, respectively...
  19. pmc Neural Computations Underlying Arbitration between Model-Based and Model-free Learning
    Sang Wan Lee
    Computation and Neural Systems, MC228 77, California Institute of Technology, Pasadena, CA 91125, USA Behavioral and Social Neuroscience, MC228 77, California Institute of Technology, Pasadena, CA 91125, USA Division of Humanities and Social Sciences, MC228 77, California Institute of Technology, Pasadena, CA 91125, USA Electronic address
    Neuron 81:687-99. 2014
    ....
  20. pmc In the mind of the market: theory of mind biases value computation during financial bubbles
    Benedetto De Martino
    Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA Department of Psychology, Royal Holloway University, London TW20 0EX, UK Electronic address
    Neuron 79:1222-31. 2013
    ..Our results suggest that incorporating inferences about the intentions of others when making value judgments in a complex financial market could lead to the formation of market bubbles. ..
  21. pmc Neural mechanisms underlying paradoxical performance for monetary incentives are driven by loss aversion
    Vikram S Chib
    Division of Biology, California Institute of Technology, Pasadena, CA 91125, USA
    Neuron 74:582-94. 2012
    ..These results suggest that incentives associated with successful task performance are initially encoded as a potential gain; however, when actually performing a task, individuals encode the potential loss that would arise from failure...
  22. doi request reprint Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex
    Hackjin Kim
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA
    Cereb Cortex 21:769-76. 2011
    ..These results indicate that vmPFC and anterior insula contain overlapping representations of anticipatory value, consistent with the existence of a common currency for the value of expected outcomes in these regions...
  23. ncbi request reprint Temporal difference models describe higher-order learning in humans
    Ben Seymour
    Wellcome Department of Imaging Neuroscience, 12 Queen Square, London WC1N 3BG, UK
    Nature 429:664-7. 2004
    ..Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour...
  24. ncbi request reprint Temporal difference models and reward-related learning in the human brain
    JOHN P O'DOHERTY
    Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, WC1N 3BG, London, United Kingdom
    Neuron 38:329-37. 2003
    ....
  25. ncbi request reprint Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
    Ben Seymour
    Wellcome Department of Imaging Neuroscience, 12 Queen Square, London WC1N 3BG, UK
    Nat Neurosci 8:1234-40. 2005
    ..This dual coding has parallels to 'opponent process' theories in psychology and promotes a formal account of prediction and expectation during pain...
  26. pmc The human prefrontal cortex mediates integration of potential causes behind observed outcomes
    Klaus Wunderlich
    Computation and Neural Systems Program, California Institute of Technology, Pasadena, California, USA
    J Neurophysiol 106:1558-69. 2011
    ..Our results demonstrate that, at the point of choice, the human brain and the prefrontal cortex in particular are capable of a weighted integration of information across multiple evidences...
  27. pmc Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction
    Mimi Liljeholm
    Division of the Humanities and Social Sciences, Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 31:2474-80. 2011
    ....
  28. ncbi request reprint Contingency awareness in human aversive conditioning involves the middle frontal gyrus
    Ronald McKell Carter
    MC216 76 Division of Biology, California Institute of Technology, Pasadena, CA 91125, USA
    Neuroimage 29:1007-12. 2006
    ..These results demonstrate that brain regions known to be involved in other aspects of learning and memory also play a specific role, reflecting on each trial the acquisition and representation of contingency awareness...
  29. pmc Empathic neural responses are modulated by the perceived fairness of others
    Tania Singer
    Wellcome Department of Imaging Neuroscience, University College of London, London WC1N 3AR, UK
    Nature 439:466-9. 2006
    ....
  30. pmc The behavioral and neural mechanisms underlying the tracking of expertise
    Erie D Boorman
    Department of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA Computation and Neural Systems, California Institute of Technology, Pasadena, CA 91125, USA Centre for Functional Magnetic Resonance Imaging of the Brain, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK Electronic address
    Neuron 80:1558-71. 2013
    ..Moreover, activity in lateral orbitofrontal and medial prefrontal cortex reflected behavioral differences in learning about people and algorithms. These findings provide basic insights into the neural basis of social learning. ..
  31. pmc Insights from the application of computational neuroimaging to social neuroscience
    Simon Dunne
    California Institute of Technology, Pasadena, CA 91125, USA
    Curr Opin Neurobiol 23:387-92. 2013
    ..These three systems appear to map onto distinct neuroanatomical substrates, and depend on unique computational signals...
  32. doi request reprint Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex
    Vikram S Chib
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 29:12315-20. 2009
    ..Our results provide evidence that the brain encodes a "common currency" that allows for a shared valuation for different categories of goods...
  33. pmc States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning
    Jan Gläscher
    Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91101, USA
    Neuron 66:585-95. 2010
    ..This finding supports the existence of two unique forms of learning signal in humans, which may form the basis of distinct computational strategies for guiding behavior...
  34. pmc Anything you can do, you can do better: neural substrates of incentive-based performance enhancement
    Mimi Liljeholm
    Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California, United States of America
    PLoS Biol 10:e1001272. 2012
    ..In particular, it is still an open question how brain areas that encode expectations about reward are able to translate incentives into improved performance across fundamentally different cognitive and physical task requirements...
  35. ncbi request reprint Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices
    JOHN P O'DOHERTY
    Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA 91125, USA
    Ann N Y Acad Sci 1121:254-72. 2007
    ..Finally, some of the outstanding questions for future neuroimaging research of orbitofrontal cortex function will be highlighted...
  36. ncbi request reprint Neural responses during anticipation of a primary taste reward
    JOHN P O'DOHERTY
    Wellcome Department of Imaging Neuroscience, Institute of Neurology, 12 Queen Square, WC1 3BG, London, United Kingdom
    Neuron 33:815-26. 2002
    ..Apart from OFC, these regions were not activated by reward receipt. The findings indicate that when rewards are predictable, brain regions recruited during expectation are, in part, dissociable from areas responding to reward receipt...
  37. doi request reprint Choosing for me or choosing for you: value in medial prefrontal cortex
    Simon Dunne
    California Institute of Technology, Pasadena, CA 91125, USA
    Neuron 75:942-4. 2012
    ....
  38. pmc Transformation of stimulus value signals into motor commands during simple choice
    Todd A Hare
    Computation and Neural Systems Division, California Institute of Technology, Pasadena, CA 91125, USA
    Proc Natl Acad Sci U S A 108:18120-5. 2011
    ..These results describe the network through which stimulus values are transformed into actions during a simple choice task...
  39. pmc Neural correlates of mentalizing-related computations during strategic interactions in humans
    Alan N Hampton
    Computation and Neural Systems Program and Division of Humanities and Social Sciences, California Institute of Technology, 1200 East California Boulevard, M C 228 77, Pasadena, CA 91125, USA
    Proc Natl Acad Sci U S A 105:6741-6. 2008
    ..These results suggest dissociable contributions of different parts of the mentalizing network to the computations underlying higher-order strategizing in humans...
  40. doi request reprint The neural representation of unexpected uncertainty during value-based decision making
    Elise Payzan-LeNestour
    Australian School of Business, School of Banking and Finance, The University of New South Wales UNSW, Sydney, NSW 2052, Australia
    Neuron 79:191-201. 2013
    ..Collectively, these findings support theoretical models in which several formally separable uncertainty computations determine the speed of learning...
  41. pmc Evidence for model-based computations in the human amygdala during Pavlovian conditioning
    Charlotte Prévost
    Trinity College Institute of Neuroscience and School of Psychology, Dublin, Ireland
    PLoS Comput Biol 9:e1002918. 2013
    ..These findings support an important role for model-based algorithms in describing the processes underpinning Pavlovian conditioning, as well as providing evidence of a role for the human amygdala in model-based inference...
  42. pmc Temporal isolation of neural processes underlying face preference decisions
    Hackjin Kim
    Divisions of Humanities and Social Sciences and Biology, California Institute of Technology, Pasadena, CA 91125, USA corrected
    Proc Natl Acad Sci U S A 104:18253-8. 2007
    ..The findings support a model in which rapid, automatic engagement of the NAC conveys a preference signal to the OFC, which in turn is used to guide choice...
  43. doi request reprint Neural correlates of specific and general Pavlovian-to-Instrumental Transfer within human amygdalar subregions: a high-resolution fMRI study
    Charlotte Prévost
    Division of Humanities and Social Sciences, Computation and Neural Systems Program, and Division of Biology, California Institute of Technology, Pasadena, California 91125, USA
    J Neurosci 32:8383-90. 2012
    ..These results add to a burgeoning literature indicating different functional contributions for these different amygdalar subregions in reward-processing and motivation...
  44. pmc Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex
    Daniel McNamee
    Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin
    Nat Neurosci 16:479-85. 2013
    ..These results implicate the medial prefrontal cortex in the implementation of a common currency and suggest a ventral versus dorsal topographical organization of value signals in the vmPFC...
  45. pmc Dorsomedial prefrontal cortex mediates rapid evaluations predicting the outcome of romantic interactions
    Jeffrey C Cooper
    Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin 2, Ireland
    J Neurosci 32:15647-56. 2012
    ..Even a first glance, then, can accurately predict romantic desire, but that glance involves a mix of physical and psychological judgments that depend on specific regions of DMPFC...
  46. pmc Dissociable brain systems mediate vicarious learning of stimulus-response and action-outcome contingencies
    Mimi Liljeholm
    Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
    J Neurosci 32:9878-86. 2012
    ....
  47. doi request reprint Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
    Yael Niv
    Psychology Department and Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey 08540, USA
    J Neurosci 32:551-62. 2012
    ..This suggests that risk sensitivity is integral to human learning, illuminating economic models of choice, neuroscientific models of affective learning, and the workings of the underlying neural mechanisms...