Shifting Rewards Are Encoded Using Special Neuronal Patterns

Summary: Dopamine neurons in the midbrain become active in a previously undetected way when an animal considers a reward that is changing in value.

Source: University of Tsukuba

Animals must make predictions about future rewards when making decisions during daily life. Specific reward-related patterns of neuronal activity are known to underlie such decisions. But now, researchers from Japan have found a new pattern of neural activity that occurs when responding to rewards that are changing over time.

In a study published this month in eLife, researchers from the University of Tsukuba have revealed that dopamine neurons, which process information about rewards, are activated in a previously undetected way when an animal considers a reward that is changing in value.

Previous studies have highlighted the importance of a specific pattern of activity in dopamine neurons, called phasic firing, in processing reward information. Such information has important implications for understanding how organisms successfully regulate reward-seeking behavior.

However, this type of activity may not explain all types of rewards–for instance, those that change on a moment-to-moment basis, such as when a customer watches as a bartender pours their drink. The researchers at the University of Tsukuba aimed to investigate this possibility.

“Midbrain dopamine neurons are thought to respond to rewards and reward-predicting cues with phasic activity,” says first author of the study Yawei Wang.

“However, it seems unlikely that phasic dopamine activity, which is sporadic and has a short duration, can explain continuous monitoring of a shifting reward.”

To address this, the researchers trained macaque monkeys to complete a Pavlovian task in which they made judgments about rewards that gradually increased or decreased. While the monkeys completed the task, the researchers recorded the activity in dopamine neurons that process information about the rewards.

“The results were surprising,” explains Professor Masayuki Matsumoto, senior author. “Instead of phasic activity, the dopamine neurons fired in a tonic pattern that varied according to the moment-to-moment changes in the reward values.”

This tonic firing pattern, which was a more sustained neuronal response compared with phasic firing, was caused by a different type of neuronal activation than that associated with phasic dopamine neuron activity during reward processing.

This shows a diagram from the study
Researchers from the University of Tsukuba have found that that during the processing of rewards that change in value over time, dopamine neurons exhibit a pattern of neuronal activity that is distinct from previously established neuronal firing related to reward prediction. This work opens the door for future research regarding the way in which rewards are processed, and more broadly, the way that dopamine neurons process information in real-time. Credit: University of Tsukuba

“Our findings add to the current understanding of how dopamine neurons are involved in rewards by highlighting the existence of multiple neuronal firing modes that signal reward values in specific situations,” says Yawei Wang.

Given that dopamine is a powerful neurotransmitter involved in many brain functions, understanding how dopamine neurons process and transmit information is critical to understanding the mechanisms of cognition. This research opens the door to new investigations of the role of the tonic activity of dopamine neurons in reward processing.

About this neuroscience research news

Source: University of Tsukuba
Contact: Naoko Yamashina – University of Tsukuba
Image: The image is credited to University of Tsukuba

Original Research: Open access.
Tonic firing mode of midbrain dopamine neurons continuously tracks reward values changing moment-by-moment” by Yawei Wang, Osamu Toyoshima, Jun Kunimatsu, Hiroshi Yamada, Masayuki Matsumoto. eLife



Animal behavior is regulated based on the values of future rewards. The phasic activity of midbrain dopamine neurons signals these values. Because reward values often change over time, even on a subsecond-by-subsecond basis, appropriate behavioral regulation requires continuous value monitoring. However, the phasic dopamine activity, which is sporadic and has a short duration, likely fails continuous monitoring.

Here, we demonstrate a tonic firing mode of dopamine neurons that effectively tracks changing reward values. We recorded dopamine neuron activity in monkeys during a Pavlovian procedure in which the value of a cued reward gradually increased or decreased.

Dopamine neurons tonically increased and decreased their activity as the reward value changed. This tonic activity was evoked more strongly by non-burst spikes than burst spikes producing a conventional phasic activity.

Our findings suggest that dopamine neurons change their firing mode to effectively signal reward values in a given situation.

Join our Newsletter