Dopamine is probably the most studied neurotransmitter, and yet the neuroscience literature contains a huge variety of perspectives on its functional role. This post summarizes a systems-level perspective on the function of dopamine that has motivated several successful drug studies and informed the construction of artificial neural network models. The details of this perspective are maddeningly complex (at least for me), which is why I thought it would be useful to summarize it here, in the simplest terms possible.
There are at least two ways to talk about dopamine release. We can talk about the average amount of dopamine available over a relatively long period of time (known as "tonic dopamine levels"), or we can talk about how much is being released in a given burst of neuronal firing (known as "phasic release"). Phasic release of dopamine is often thought to encode "reward prediction error" - some very compelling experiments show that dopamine is released in bursts when animals underestimate the reward of an event, but sharply dips in activity when animals overestimate or do not receive an expected reward from a given event.
But it's also important to distinguish between phasic and tonic dopamine because they are often argued to have different (and even contradictory) effects. For example, some argue that increases in tonic dopamine cause inappropriately frequent updating of working memory, leading to distractibility. In contrast, increases in phasic dopamine may cause more effective updating of task-relevant information, leading to improved working memory.
So, how exactly do tonic and phasic dopamine interact? At first blush, tonic dopamine seems like the temporal derivative of phasic dopamine: as more dopamine is released in a given burst, the tonic level of dopamine increases. But there are very important nuances here. For example, This 2002 article by Cohen Braver & Brown argues that higher tonic dopamine levels are likely to be associated with relatively lower effects of phasic release, perhaps due to a kind of nonlinear "saturation" effect: if more dopamine is already available in the synaptic cleft, then the additional phasic release of DA is likely to have a smaller effect.
More recent analysis by Frank & O'Reilly gives a better idea of how complex the effects of dopamine may truly be. This model extends earlier work by specifying exactly how two distinct dopaminergic pathways may control working memory and learning.
Here's the cartoon version of this model: imagine "working memory" as a loop in prefrontal cortex through which information will cycle indefinitely. When dopamine is phasically released this loop is temporarily opened, to allow different information to be cycled within working memory. Since phasic dopamine release is related to rewards, this ensures that working memory will be filled with the information that is most relevant for the organism to encounter rewards in the environment.
But clearly there is a balance that must be achieved here: if the loop is opened too frequently, it leads to distraction and "hyperactive updating" of memory. In contrast, if the loop is not opened up frequently enough, working memory maintenance is good but there is a flexibility cost: memory is not often updated when it should be. This tradeoff is known as the stability-flexibility dilemma, and is closely related to the exploration-exploitation dilemma reviewed earlier this week.
More technically speaking, this model portrays prefrontal cortex as basically a "storage space" for information that needs to be actively maintained. Entry to this storage space is provided by bursting activation within the "Go" pathway of the striatum (a part of the basal ganglia), which has the end result of updating working memory by gating information currently in the thalamus into prefrontal cortex. However, this "go" pathway directly competes with a default "NoGo" pathway, which itself has the opposite effect - in other words, the NoGo pathway suppresses information in the thalamus and thereby allows the prefrontal "storage space" to continue to maintain its current information.
These two pathways are both affected by dopamine, but in opposite directions: the striatal Go pathway predominantly contains excitatory D1 receptors, whereas the striatal NoGo pathway predominantly contains inhibitory D2 receptors.
Therefore, responses may be more likely when the efficacy of D2 receptors is increased over the long term (through D2 agonists): this inhibits the No-Go pathway, and ultimately disinhibits the thalamus. The opposite effect could be expected of D2 antagonists, which would increase response thresholds by disinhibiting No-Go neurons and therefore ultimately inhibiting the thalamus.
Importantly, these effects are caused by how these drugs act on postsynaptic D2 receptors - in other words, how they affect the neurons that are receiving the dopamine. These drugs act even more strongly on the neurons that are sending dopamine, because those neurons have presynaptic D2 receptors. Presynaptic receptors seem to act as a kind of negative feedback signal: if they become active, it's likely that too much dopamine was released, and so phasic responses are then curtailed.
So, if you increase the efficacy of D2 receptors, you may increase tonic levels of dopamine (by upregulating the efficacy of dopamine on postsynaptic receptors) but you will also decrease phasic levels of dopamine (by upregulating the efficacy of dopamine on presynaptic receptors, which then tells the sending neurons to release less or stop releasing dopamine).
Thus the overall picture is that D2 agonists increase tonic dopamine levels (lowering response thresholds) but decrease phasic dopamine release (decreasing positive feedback learning which requires the "Go" pathway, and also limiting the amount of task-relevant updating of working memory). In contrast, D2 antagonists decrease tonic dopamine levels (raising response thresholds) but increase phasic dopamine release (increasing positive feedback learning whichi is reliant on the "Go" pathway, and increasing the task-relevant updating of working memory).
This theory becomes even more complicated in practice, where individuals differ in terms of working memory (and thus, presumably, dopamine). In fact, certain genes have been associated with working memory via their effects on dopamine: individuals with the met allele of the COMT gene have higher levels of tonic dopamine, which means it is harder to update working memory; they also show the expected deficits in task switching. Dopamine agonists decrease the working memory performance of individuals with this version of COMT, but often help those with the val allele of COMT (reviewed previously).
Consistent with the idea that drugs targeting the dopamine system may have different effects depending on subject's working memory capacity, Frank & O'Reilly found that low working memory span subjects experienced greater effects of D2 drugs.
So far we have discussed only D2 receptors, which are much less prevalent in PFC than D1 receptors. Unfortunately it can be difficult to disentangle the roles of D1 and D2 activity. Nonetheless, it appears that D1 receptors are important for recurrent connectivity in prefrontal cortex - D1 activity seems to uphold the "stability" half of the stability-flexibility dilemma.
is "tonic dopamine" released by the same neurons as "phasic dopamine" (let's say dopaminergic neurons originating in the VTA or substantia nigra)? or by other dopaminergic pathways that converge in the striatum?
an if it is release by the same neurons, is it released alternatively? (because if phasic release would imply stopping the release from time to time..and tonic means constant release)..
another question is if tonic release is extrasynaptic (are the the autoreceptors in the synapse or outside, on the cellular body)?
Tonight I was just trying to come up with a simplified way to explain the DA system to my students (and was getting anxious because it's so late and I have to go to work early in the morning...)...
I found your site thanks a Google search. You have done a fine work. And it's really nice to read you. I'll definitely be back! :)
there is a good believing that god create universe with a kind of system that system is laying on dualism like black and white,good and bad.0 and 1 as you seen there system need two things to execute
dopamine system is the more complex and head of data processing of human brain.i think this system needs to differentiate signals to compute it well; lots of summery saying about dopamine is the lead brain chemical which is much more responsible from reinforcement Systems of brain. i thing all of the brain working system is so much about differentiating mechanism esp in pre-frontal cortex is vital for that kind of it
i am dealing with negative schizophrenia about 7 years i really know how bad the hypo-frontality is lots of time taking dopaminergic drugs and abnormal things happening to me some take of drugs esp the time circuit of my brain is under-effecting of drugs is just like time is fasting everything is happening much more fast than the other times i thing how brain works to much brain slows to
Einstein was right The time is relative for the observer:|
Very informative! Thanks, Chris.
Really excellent write up, as are all your related posts. It added a lot to the knowledge I had on the subject.
Actually, this post inspired me to attempt to make the subject of dopamine even more assessable "for dummies" with a post of my own. Check it out if you have a chance and let me know if I misrepresented any of the research.
Thanks Colin! Your post is hilarious and yet informative!
I will edit this entry to include a link to your summary. And I hope you don't mind if I show it around; I know a bunch of people out here who will get a kick out of it.
Thanks for your comments and of course you're welcome to show it around -- not that I'd have much control over it anyway since it's up posted live in the wilds of the internet.
Since you're in Colorado talking about modeling and dopamine, I would guess that you know Michael Frank. I haven't thought about DA much since I last heard Michael talk about his model when he joined the department where I was wrapping up my dissertation.
Tonight I was just trying to come up with a simplified way to explain the DA system to my students (and was getting anxious because it's so late and I have to go to work early in the morning...). Your post completely restored my memory of Michael's elegant model of the DA system and working memory (and everything else)!
Thanks so much!!