Next Article in Journal
“Breastfeeding at Night Is Awesome” Mothers’ Intentions of Continuation of Breastfeeding Extreme and Very Preterm Babies upon Discharge from a Kangaroo Mother Care Unit of a Tertiary Hospital in South Africa
Previous Article in Journal
Effects of Visual Communication Design Accessibility (VCDA) Guidelines for Low Vision on Public and Open Government Health Data
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Healthcare
Volume 11
Issue 7
10.3390/healthcare11071046
healthcare-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Pharmacological Modulation of Temporal Discounting: A Systematic Review

by
Luis Felipe Sarmiento
1,*,
Jorge Alexander Ríos-Flórez
2,3,
Hector Andres Paez-Ardila
1,4,
Pêssi Socorro Lima de Sousa
1,
Antonio Olivera-La Rosa
5,6,
Anderson Manoel Herculano Oliveira da Silva
7 and
Amauri Gouveia, Jr.
1
1
Laboratory of Neuroscience and Behavior, Federal University from Pará, Belém 66050-160, Brazil
2
Neuroanatomy Laboratory, Department of Morphology, Federal University of Rio Grande do Norte, Natal 59078-970, Brazil
3
Department of Psychology, Politécnico Grancolombiano University Institution, Medellín 745220, Colombia
4
Department of Psychology, Universidad Manuela Beltran, Bucaramanga 680004, Colombia
5
Department of Psychological and Social Sciences, Universidad Católica Luis Amigó, Medellín 050034, Colombia
6
Human Evolution and Cognition Group, University of the Balearic Islands, 07122 Palma de Mallorca, Spain
7
Laboratory of Experimental Neuropharmacology, Federal University from Pará, Belém 66050-160, Brazil
*
Author to whom correspondence should be addressed.
Healthcare 2023, 11(7), 1046; https://doi.org/10.3390/healthcare11071046
Submission received: 12 January 2023 / Revised: 25 February 2023 / Accepted: 28 February 2023 / Published: 6 April 2023
Browse Figures
Review Reports Versions Notes

Abstract

:
Temporal discounting is a phenomenon where a reward loses its value as a function of time (e.g., a reward is more valuable immediately than when it delays in time). This is a type of intertemporal decision-making that has an association with impulsivity and self-control. Many pathologies exhibit higher discounting rates, meaning they discount more the values of rewards, such as addictive behaviors, bipolar disorder, attention-deficit/hyperactivity disorders, social anxiety disorders, and major depressive disorder, among others; thus, many studies look for the mechanism and neuromodulators of these decisions. This systematic review aims to investigate the association between pharmacological administration and changes in temporal discounting. A search was conducted in PubMed, Scopus, Web of Science, Science Direct and Cochrane. We used the PICO strategy: healthy humans (P-Participants) that received a pharmacological administration (I-Intervention) and the absence of a pharmacological administration or placebo (C-Comparison) to analyze the relationship between the pharmacological administration and the temporal discounting (O-outcome). Nineteen studies fulfilled the inclusion criteria. The most important findings were the involvement of dopamine modulation in a U-shape for choosing the delayed outcome (metoclopradime, haloperidol, and amisulpride). Furthermore, administration of tolcapone and high doses of d-amphetamine produced a preference for the delayed option. There was a time-dependent hydrocortisone effect in the preference for the immediate reward. Thus, it can be concluded that dopamine is a crucial modulator for temporal discounting, especially the D2 receptor, and cortisol also has an important time-dependent role in this type of decision. One of the limitations of this systematic review is the heterogeneity of the drugs used to assess the effect of temporal discounting.

1. Introduction

Intertemporal decision-making is choosing between different outcomes at different times [1]. A reward or outcome will lose value while time passes; this phenomenon is known as ‘temporal discounting’ or ‘delayed discounting’ [2]. As the value of the delayed in-time outcome is discounted, there is a higher bias for the sooner choice [3]. This decision is prevalent in daily life, specifically in the areas of health, education, investment, and even clinical conditions [4].
Temporal discounting is measured with tasks in which participants have to choose between a smaller amount of money delivered immediately or after a short amount of time and a large amount of cash given in the future. e.g., ‘Would you prefer 40 dollars today or 100 dollars in three months?’. A person has a higher discount rate when his or her preference goes towards the smaller and more immediate reward. On the other hand, the person has a lower discount rate when he has a stronger preference for the delayed and bigger reward [5].
Thus, the preference for the small, immediate reward over the higher, delayed one is considered an impulsive decision. The preference for the higher, delayed reward over the smaller, immediate reward is a self-controlled decision [6]. Non-human animals prefer impulsive decisions, such as monkeys, rats, mice, and pigeons [1]. The discounting is best described by a hyperbolic curve that shows how the reward loses value with the passage of time (Figure 1). Furthermore, the tasks that measure temporal discounting have a variable known as the k-value. It is a free parameter that measures the sensitivity to the delay. When the k value is low, it means the individual discount is lower with the delay in time, and when the k-value is high, the individual is susceptible to the delay [7].
This type of decision has higher discount rates in many pathologies such as addictive behavior [8], heroin addiction [9], cocaine addiction [10], alcohol addiction [11], opioid-dependents [12], smokers [13], bipolar disorder [14], attention-deficit/hyperactivity disorder [15], antisocial personality disorder, social anxiety disorder [16], borderline personality disorder [17], major depressive disorder [18], schizophrenia and schizoaffective disorders [19], pathological gambling, and orbitofrontal cortex lesions [20].

2. Methods

This systematic review followed the PRISMA guidelines [21]—[see Supplementary Material]. Moreover, it was registered in the PROSPERO database (https://www.crd.york.ac.uk/PROSPERO/ (accessed on 28 April 2020)), with the registration number CRD42020161785.

2.1. Eligibility Criteria and Search Strategy

The PICO strategy was used to identify relevant studies in the question being investigated. PICO is an acronym for Population (P), intervention (I), Comparison (C), and Outcome (O). This systematic review used Healthy Humans (P), Pharmacological administration (I), and Intertemporal decisions (O). The exclusion criteria considered review articles, study cases, book chapters, research in animals, letters to the editor, editorials, protocols, pilot studies, and studies without the information required in the question.
The guide question for this review was the following: Is temporal discounting affected by pharmacological interventions? The search was completed in various databases, including PubMed, Scopus, Web of Science, Cochrane, Science Direct, and Google Scholar. The Mesh terms, keywords, and search strategies were organized according to each database and are included in the Supplementary materials.
As of the start of the research, we had programmed an alert for new articles in each database. There were no time or language restrictions in the search for articles. Two reviewers performed the search and selection of the studies, the extraction of the data, and the risk of bias analyses as a double-blind evaluation. The references were uploaded into the citation manager (EndNote®, version X9, Thomson Reuters, Philadelphia, PA, USA, EUA).

2.2. Data Extraction

The EndNote® removed the duplicate references first automatically, followed by the authors conducting it manually. The studies were screened by title and abstract. The remaining ones went through a full-text review, and the articles that did not fulfill the inclusion criteria were removed. From the selected studies, we extracted: authors, country, publication year, type of study design, participant characteristics (sample size), age, mean, intertemporal decision task, pharmacological kind of intervention/dose, and results (Table 1).

2.3. Data Analysis

We chose Rob 2.0—a revised Cochrane risk of bias tool for randomized trials—to evaluate the risk of bias. It is a reviewed tool used and adapted to assess different types of study interventions. The Rob 2.0 proposes a series of questions based on five domains of bias and an overall evaluation. The domains are deviation from intended intervention, missing outcome data, measurement of the outcome, selection of the reported result, and overall. Each domain presents some questions related to the trial design, conduction, and reporting of the results. The question is answered as Yes, Probably Yes, No, or Probably No. These responses stratify the domains as High Risk if there are significant problems, ‘Some concerns’ if there are minor problems, or ‘Low Risk’ if there are no problems.

3. Results

3.1. Selection of the Studies

The database search identified 2065 references, of which 477 were duplicate references. The remaining 1588 references were analyzed by title and abstract. Twenty-three articles fulfilled the inclusion criteria and went to full-text analysis.
From the twenty-three articles assessed by full-text analysis, eight were excluded, seven of them because they did not have a pharmacological intervention and one because it used rats as subjects. Finally, nineteen studies fulfilled the inclusion criteria and went through the quality review. Each step of the review was performed independently by two reviewers, and a third reviewer reviewed the included articles. The steps are described in the PRISMA flowchart (Figure 2).

3.2. Characteristics of the Studies

The study samples were healthy volunteers; participants were men and women aged between 18 and 45 years. The experimental designs of the studies were within-subject and placebo-controlled for eleven studies [13,22,25,28,29,31,32,33,35,36,42] and eight studies used between-subject placebo-controlled designs [2,26,27,30,34,38,39,41].
Temporal discounting was measured by different types of tasks, such as the Delay Discounting Task [13,22,25,28,29,33,42] developed by Richard et al. [23], The Monetary Choice Questionnaire [30,34,39] by Kirby et al. [9], The Probability Discounting Task developed by Madden et al. [4]; Wu et al. [41] used an Intertemporal Choice Task adapted from Shen et al. [43], and, other studies designed their types of temporal discounting tasks [2,26,27,31,32,35,38].
The studies used the following pharmacological administrations (Table 2): diazepam 5 mg and 10 mg [13] and 20 mg in the Acheson et al. study [22]. Pramipexole (0.25 mg and 0.50 mg) [29]; yohimbine (20 mg) [30]; bupropion (75 mg and 100 mg), D- amphetamine, (5 mg, 10 mg, and 20 mg) [25,28]. Tolcapone (200 mg) [31]; propranolol (80 mg) [32]. Hydrocortisone (10 mg) [2,27]. Metoclopramide (10 mg) [26]; testosterone (150 mg and 50 mg) [34,41]. Oxycodone (5 mg, 10 mg, and 20 mg) [42] and L-dopa (187.5 mg and 150 mg) [35,36]. Amisulpride (400 mg), naltrexone (50 mg) [39], and haloperidol (2 mg and 1.5 mg) [38].
The administration of tolcapone [31], high (20 mg) doses of d-amphetamine [29], metoclopramide [26], haloperidol [38], amisulpride [39], and metoclopramide [26] promoted preference for the delayed reward. Hydrocortisone [2,27], testosterone [41], and L-dopa [36] generated preference for the immediate reward.
On the other hand, administration of diazepam, pramipexole, yohimbine, bupropion, d-amphetamine, marinols, oxycodone, testosterone, and naltrexone did not produce any effect in the intertemporal decisions [13,22,29,30,33,34,39,42].

3.3. Risk of Bias

The risk of bias tool was an adapted version of Rob 2.0 that evaluated five domains of the studies: randomization process, deviation from the intended intentions, missing outcome data, measurements of the outcome, and selection of the reported results. Most of the studies presented a low risk of bias in all the domains. However, one of the studies showed some concerns in one of the domains (Figure 3).
Thus, eighteen of the studies were evaluated as having low Risk of bias in all domains Acheson et al. [22], Acheson and de Wit [25], Arrondo et al. [26], Cornelisse et al. [27], de Wit et al. [28], Hamidovic et al. [29], Herman et al. [30], Kayser et al. [31], Lempert et al. [32], Riis-Vestergaard et al. [2], Ortner et al. [34], Petzold et al. [35], Pine et al. [36], Reynolds et al. [13], Wu et al. [41], Weber et al. [39], Wagner et al. [38], and Zacny and de Wit [42]. Nevertheless, McDonald et al. [33] reported some concerns of bias in the domain of missing outcome data because the data for all the participants regarding the temporal discounting task were not available for analysis.

4. Discussion

This systematic review aimed to understand the association between the administration of some drugs and temporal discounting (see Table 3). Thus, nineteen studies fulfilled the inclusion criteria of the systematic review, of which eighteen presented a low risk of bias. Five studies that administered d-amphetamine (20 mg) [28], tolcapone (200 mg) [31], metoclopramide (10 mg) [26], haloperidol (2 mg) [38], and amisulpride (400 mg) [39] reported an increment at choosing the delayed reward. Four studies with drugs administered, such as hydrocortisone 10 mg [2,32], androgel 150 mg [41], and l-dopa 150 mg [36], found an increase in the preference for the more immediate reward. The administration of haloperidol 1.5 mg [36], pramipexole 0.25 mg and 0.50 mg [29], L-dopa 187.5 mg [35], d-amphetamine 5 mg [25], 10 mg [28], bupropion 75 mg and 100 mg [35], Yohimbine 20 mg [30], Propranolol 80 mg [32], testogel 50 mg [34], Oxycodone 5 mg, 10 mg and 20 mg [42], naltrexone [39], Marniols 7.5 mg and 15 mg [33], and Diazepam 5 mg and 10 mg [13], 20 mg [22] had no effect.
A systematic review is a set of scientific strategies applied to synthesize and analyze the best evidence on a specific topic. It summarizes and compiles the scientific evidence and decreases the risk of bias in the studies [44]. To achieve this, a quality assessment using a specific tool according to the types of studies included in the review was performed [45]. The systematic review gives a clear view of a topic, helps make decisions related to health and research, establishes new policies, and plans future research [44].

4.1. Dopaminergic System

Dopamine is a crucial neurotransmitter for animals that have been involved in a variety of functions and behaviors. This neuromodulator has been strongly associated with impulsivity and clinical disorders involving impulsive behaviors. Preclinical and human studies suggest a crucial role for dopaminergic function in temporal discounting. Parkinson’s disease patients, a disease known for dopamine deficiency, have shown altered temporal discounting compared with healthy volunteers [46]. Some of the drugs that act in the dopaminergic system, such as Tolcapone and L-dopa from the included studies are employed in the treatment of Parkinson’s disease.
There is a consistent finding within the studies. The dopamine receptor D2 modulation is involved in choosing the later reward over the sooner reward [26,38,39]. Three drugs act on the D2 receptor: amisulpride [39], haloperidol [38], and metoclopramide [26]. This D2 receptor has been associated with impulsive behavior.
In mice, the absence of the D2 receptor increased impulsive behavior, while restoration of the expression of the D2 receptor decreased impulsivity [47]. Another study knocked down these receptors in rats and found that these knockdown rats had a higher preference for the smaller and immediate reward than the control rats in a delay-discounting task [48]. Furthermore, lower ventral striatal D2 density is associated with impulsivity and greater temporal discounting, i.e., preference for the sooner option [49].
Following this reasoning, a study with methamphetamine-dependent subjects found they had lower striatal dopamine D2/D3 receptor availability than healthy controls, and higher impulsiveness was related to it [50]. Furthermore, another study found that methamphetamine-dependent subjects with lower striatal D2/D3 receptors have steeper temporal discounting [51].
A meta-analysis confirmed that Parkinson‘s disease patients have a steeper discount than healthy controls [52], emphasizing the crucial role of dopamine in this type of decision. Additionally, a study found that Parkinson’s disease patients treated with dopaminergic drugs exhibited greater farsightedness in their choices than Parkinson’s disease patients not on medication [53].
Wagner et al. [38] and Pine et al. [36] used the same drug, Haloperidol, where Pine et al. [36] found no effect of the drug. It should be noted that this difference could be due to the differences between the doses used in both studies: 2 mg [38] and 1.5 mg [36]. It is possible that lower doses of this dopamine antagonist produce a different result and that the effect of the drug would be dependent on dopaminergic baseline levels. It is hypothesized that dopamine has an inverted U-shape function between dopamine and impulsivity, where both extremes are associated with the worst decision-making performance [54]. It is consistent with results from the Castrellon et al. [55] meta-analysis, which found the same results in rats.
Hamidovic et al. [29] administered Pramipexole, a dopamine D3 receptor agonist, and found the drug had no effect. This result suggests D3 is not related to temporal discounting, but, as the author noted, it remains to be seen if multiple doses over a long period of time or higher doses present a different effect. Interestingly, Parkinson´s disease patients treated with Pramipexole have shown a proportion of impulse-control disorder related to the D3 receptors [56]. This has been seen even in rats where the D3 receptor is related to preferring the larger and delayed reward [57].

4.2. D-Amphetamine

D-Amphetamine is a drug known to have a high potential for abuse but is also used in the treatment of adults with Attention-Deficit Hyperactivity Disorder ADHD [58]. It can produce a feeling of well-being and euphoria and has helpful behavioral effects on ADHD patients. It increases dopamine in the synapses by binding to the dopamine transporter DAT, reversing DAT function in the medial prefrontal cortex, and inhibiting dopamine uptake [59]. Bupropion is commonly used to decrease impulsivity [60]. Bupropion is a drug that improves impulse control and attention in some patient populations, including those with ADHD [61]. Bupropion is a norepinephrine/dopamine-reuptake inhibitor. The administration of Bupropion had no effect on temporal discounting [25], the same as the administration of d-Amphetamine [25] and a low dose (10 mg) of d-Amphetamine [28]. However, administration of a higher dose (20 mg) in the same sample produced a preference for the later reward [28]. The higher dose by de Wit et al. [28] and the dose used by Acheson et al. [25] were the same (20 mg). However, the results differ, making the relationship between the acute pharmacological relationship and the task unclear. This is highlighted even more with the decrease in impulsivity (e.g., Go/No-Go task, Stop Task) found as other impulsivity measures were applied [28]. This could be explained by the dopamine U-shape action, as has been observed in mice and rats after d-amphetamine administration, where the shifted their response toward the sooner choice [62,63].
Another possible hypothesis Maguire et al. [64] found was that the effects of amphetamine differ depending on the manner in which the delayed reward is presented. This suggests that the changes in the results of the studies and the diverse performance were in part due to the sensitivity to the reward delay.

4.3. Levodopa (L-Dopa)

L-dopa is a dopamine precursor that passes the blood-brain barrier and converts it into dopamine. Dopamine is not able to pass the blood-brain barrier. This drug is often used in the treatment of Parkinson´s disease. The results of this review showed that Pine et al. [36] found that L-dopa had an effect on preference for a sooner reward, whereas Petzold et al. [35] did not find any effect.
A secondary result from Petzold et al. [35] analyzed that low-impulsive individuals exhibit a preference for the sooner reward, converging with Pine et al. [36] results, but more impulsive individuals showed the opposite effect. These could be explained by the dopamine baseline levels, because, as mentioned, before dopamine behaves in a U-shape. Another possible hypothesis to explain this different result could be the difference in sample size between the two studies; Petzold et al. [35] had a sample size of 87 participants, while Pine et al. [36] had 14 participants. Animal studies have found that L-dopa leads to impulsive-like behaviors [65] and increases impulsivity in Parkinson´s disease even when improving some cognitive tasks [66].

4.4. Tolcapone

Tolcapone is a drug that inhibits the enzyme catechol-O-methyl transferase (COMT). This drug is used in the treatment of Parkinson´s disease. By inhibiting COMT, the degradation of L-dopa is prevented, permitting higher concentrations to cross the blood-brain barrier, and become dopamine [67]. After the administration of Tolcapone, Kayser et al. [31] found an increased preference for the later reward.
Congruently with this result, the genotype for the enzyme COTM predicts impulsive choice behavior. Specifically, subjects carrying enzymatically fewer active alleles encoding the COMT gene show a decrease in choosing the immediate reward [68,69]. Tolcapone increases dopamine tone prefernetially in the frontal cortex, and COMT is mainly in charge of degrading dopamine in the frontal cortex. Thus, low dopamine levels in the frontal cortex may predispose to higher impulsivity.

4.5. Hypothalamic-Pituitary-Adrenal Axis (HPA-Axis)

The HPA axis is a major neuroendocrine system that aims to maintain physiological homeostasis and modulates many important processes such as the stress response, metabolism, fertility, and immunity. The hypothalamus secretes the corticotropin-releasing hormone (CRH), which releases the Adrenocorticotropic hormone (ACTH) from the pituitary gland. This stimulates the production of corticosteroids from the adrenal gland. Cortisol is the main corticosteroid and a stress biomarker. Cornelisse et al. [27] and Riis-Vestergaard et al. [2] administered hydrocortisone and found that after 15 min there was a change in the preference for the sooner reward but not the later. These results suggest a link between HPA axis activation and the mentioned acute stress-induced studies [3,32], where similar results were found. Administration of exogenous cortisol and increasing levels of endogenous cortisol produce the same response in intertemporal decisions. It should be noted that this response is time-dependent, as measures taken 185 min later did not reveal the results.

4.6. Sympathetic-Adreno-Medullar System (SAM-System)

Herman et al. [30] and Lempert et al. [32] administered drugs that modulate the SAM system. The former used yohimbine to stimulate the system, and the latter used propranol to suppress it. Both found no effect. The Sympathetic-Adreno-Medullar System is part of the sympathetic nervous system. It gives a quick physiological response to face the challenge of outside stimuli. This reaction is mediated by catecholamines, especially epinephrine and norepinephrine, and leads to an increase in the heart rate and blood pressure. It is also one of the major systems involved in the stress response, along with the Hyphotalamic-Pituitary-Adrenal axis. Some studies administering protocols that produce acute stress have found that stressed individuals prefer the earlier option over the delayed option [3,70]. These pharmacological results could suggest that the SAM-system is not the main reason for the choice selected, but the HPA-axis should be further investigated.

4.7. Testosterone

Testosterone is a major sex hormone in men and women [71]. The two studies that looked for the effects of testosterone in temporal discounting found different results. While Wu et al. [41] found a preference for the smaller reward, Ortner et al. [34] found no effect. These differences could be dose-dependent; Wu et al. [41] administered 150 mg of testosterone, whereas Ortner et al. [34] used 50 mg. A meta-analysis reported a positive association between circulating testosterone and impulsivity [72]. This relationship could be possible due to the effects of testosterone in the dopaminergic system, as testosterone receptors are in dopaminergic neurons that project to the ventral striatum [73].

4.8. Opioids and Endocannabinoids

Opioidergic and cannabinoid systems involved receptors located throughout the brain and body. The opioid system is involved in affective processing, pain, pleasure, and reward [74]. The endocannabinoid system is involved in regulating physiological and cognitive processes, appetite, pain sensation, mood, and the pharmacological effects of cannabis [75]. Two studies administered drugs that act in the opioid system [39,42], and one in the endocannabinoid system [33]. All these studies were looking for the effects of these systems that have been implicated in drug addiction. None of the studies found any effect of the drugs used in participants.
These findings in the opioid system differ from preclinical studies in rats where the opioid receptor agonist, morphine, increased impulsive behavior in a temporal discounting task [76,77]. This difference could be explained by considering the differences between the tasks measured in the clinical and preclinical models. In the rats’ studies, the rats performed the task when the animal was in a drugged state, whereas in humans, the measure could be after the drug’s effects have dissipated. Furthermore, it is possible the temporal discounting is unaffected by drug effects, even when they affect other types of impulsivity. Some other acute administrations of drugs have failed to affect temporal discounting, for example, alcohol [78] and benzodiazepines [13].
McDonald et al. [33] also found no effect after the administration of THC. It was thought that THC would have a relationship with impulsivity modulated by the activity of dopaminergic neurons. THC and other cannabinoids increase the activity of dopaminergic neurons [79]. Moreover, earlier research found that marijuana alters the perception of time [80]. The null findings in the McDonald et al. [33] study may be due to the participants being required to decide on a reward that will be obtained after the effect of the drug has dissipated, as with opioid drugs.

4.9. Diazepam

Diazepam is a benzodiazepine that increases the inhibitory effects of gamma-aminobutyric acid (GABA). Some of the GABA functions are sleep induction, memory, anxiety, and epilepsy. Diazepam, as well as other benzodiazepines, are used for the treatment of anxiety, as a muscle relaxant, as an anticonvulsant, and sometimes are abused [40]. Acheson et al. [22] and Reynolds et al. [13] found no effect of diazepam in temporal discounting.
These results are divergent from the literature that suggests Diazepam affects impulsive behavior in human and non-human models [13,81]. Deakin et al. [82] found in healthy volunteers that after administration of 29 mg of diazepam there were disinhibitory cognitive effects. There are reports that benzodiazepines produce disinhibition and increase aggression [83], and even benzodiazepines such as flunitrazepam, increase impulsivity and aggression [84]. Interestingly, it appears that Diazepam just increases some specific types of impulsive behavior but not others. Acheson et al. [22] found that Diazepam affects the performance of impulsive behavior in the stop task and go/no-go task but not the temporal discounting task.
All the studies in this systematic review went through a risk of bias analysis. Eleven studies were within the design interventions, and eight studies were placebo-controlled interventions. That makes Rob 2.0 an effective tool for the evaluation of the risk of bias and methodological assessment. All the studies presented a low risk of bias, except McDonald et al. [33], which had some concerns about missing outcome data.

5. Limitations

The findings of this study have to be seen in light of some limitations. While this systematic review followed a pre-registry strategy, recommended guidelines, and used a theory-based interpretation of the results, there are some limitations and considerations in this study that could be addressed in future research. First, the drugs administered to assess the effect on temporal discounting were extensively different, both in type of drug and dosage. This led us to decide against conducting a quantitative assessment of the evidence (meta-analysis), which in turn poses a limitation to the confidence of our conclusions.
Furthermore, the small sample size of the studies included and the use of a k-value for the analysis should be taken into consideration. A potential methodological issue may be present when using the k-value on temporal discounting as it may affect the results, as seen in McDonald et al. [33], where the sample strongly decreases due to not fitting the k values.

6. Conclusions

This systematic review allowed us to observe the effect of different types of drugs on Temporal Discounting. It showed that some drugs could influence the intertemporal decision outcomes in humans, either by lowering or by augmenting them. There is also evidence for possible clinical pathways to prevent or treat impulsiveness. This review points out that drugs involved with the dopaminergic systems exhibited changes in behavior. Especially, receptors D2 and D3 are related to the choice of the later reward. Furthermore, drugs that involve hormonal systems such as testosterone and cortisol impact temporal discounting, leading to more impulsive choices. It’s also important to keep in mind that cortisol’s impact on temporal discounting is time-dependent. Further research will continue to help understand the underlying physiological and neurological mechanism of temporal discounting and how this can be affected by the intake of drugs that lead the subject to be more impulsive or self-controlled.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare11071046/s1, Table S1: Checklist.

Author Contributions

L.F.S. and J.A.R.-F. performed the conceptualization of this research and the analysis of the results. L.F.S. established the methodology. H.A.P.-A., L.F.S. and P.S.L.d.S. executed the PICO methodology and elaborated the tables and figures. A.O.-L.R. and P.S.L.d.S. gave methodological support, and A.M.H.O.d.S. gave support to the analyses of the results. A.G.J. managed the development of the research, as well as gave support to the analysis of the results. J.A.R.-F. formatted the paper and made style corrections. L.F.S. and J.A.R.-F. wrote the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This study was financed in part by the Coordination for the Improvement of Higher Education Personnel—Brazil (CAPES—Financing Code 001). This manuscript was also supported by PROPESP/UFPA (PAPQ).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors have no conflict of interest to declare.

References

  1. Kalenscher, T.; Pennartz, C.M. Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog. Neurobiol. 2008, 84, 284–315. [Google Scholar] [CrossRef]
  2. Riis-Vestergaard, M.I.; van Ast, V.; Cornelisse, S.; Joëls, M.; Haushofer, J. The effect of hydrocortisone administration on intertemporal choice. Psychoneuroendocrinology 2018, 88, 173–182. [Google Scholar] [CrossRef]
  3. Haushofer, J.; Jain, P.; Musau, A.; Ndetei, D. Stress May Increase Choice of Sooner Outcomes, But Not Temporal Discounting. J. Econ. Behav. Organ. 2021, 183, 377–396. [Google Scholar] [CrossRef]
  4. Madden, G.J.; Petry, N.M.; Johnson, P.S. Pathological gamblers discount probabilistic rewards less steeply than matched controls. Exp. Clin. Psychopharmacol. 2009, 17, 283–290. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Scheres, A.; Tontsch, C.; Thoeny, A.L.; Kaczkurkin, A. Temporal reward discounting in attention-deficit/hyperactivity disorder: The contribution of symptom domains, reward magnitude, and session length. Biol. Psychiatry 2010, 67, 641–648. [Google Scholar] [CrossRef]
  6. Kalenscher, T.; Ohmann, T.; Güntürkün, O. The neuroscience of impulsive and self-controlled decisions. Int. J. Psychophysiol. 2006, 62, 203–211. [Google Scholar] [CrossRef] [PubMed]
  7. Basile, A.G.; Toplak, M.E. Four converging measures of temporal discounting and their relationships with intelligence, executive functions, thinking dispositions, and behavioral outcomes. Front. Psychol. 2015, 6, 728. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Amlung, M.; Vedelago, L.; Acker, J.; Balodis, I.; MacKillop, J. Steep delay discounting and addictive behavior: A meta-analysis of continuous associations. Addiction 2017, 112, 51–62. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Kirby, K.N.; Petry, N.M.; Bickel, W.K. Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. J. Exp. Psychol. Gen. 1999, 128, 78–87. [Google Scholar] [CrossRef]
  10. Coffey, S.F.; Gudleski, G.D.; Saladin, M.E.; Brady, K.T. Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Exp. Clin. Psychopharmacol. 2003, 11, 18–25. [Google Scholar] [CrossRef] [PubMed]
  11. Petry, N.M. Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology 2001, 154, 243–250. [Google Scholar] [CrossRef]
  12. Karakula, S.L.; Weiss, R.D.; Griffin, M.L.; Borges, A.M.; Bailey, A.J.; McHugh, R.K. Delay discounting in opioid use disorder: Differences between heroin and prescription opioid users. Drug Alcohol Depend. 2016, 169, 68–72. [Google Scholar] [CrossRef] [Green Version]
  13. Reynolds, B.; Richards, J.B.; Horn, K.; Karraker, K. Delay discounting and probability discounting as related to cigarette smoking status in adults. Behav. Process. 2004, 65, 35–42. [Google Scholar] [CrossRef]
  14. Mason, L.; O’Sullivan, N.; Blackburn, M.; Bentall, R.; El-Deredy, W. I want it now! Neural correlates of hypersensitivity to immediate reward in hypomania. Biol. Psychiatry 2012, 71, 530–537. [Google Scholar] [CrossRef]
  15. Jackson, J.N.; MacKillop, J. Attention-deficit/hyperactivity disorder and monetary delay discounting: A meta-analysis of case-control studies. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 2016, 1, 316–325. [Google Scholar] [CrossRef] [Green Version]
  16. Hurlemann, R.; Scheele, D.; Kinfe, T.M.; Berger, R.; Philipsen, A.; Voncken, M.J.; Kuypers, K.P.; Schruers, K. Increased temporal discounting in social anxiety disorder normalizes after oxytocin treatment. Psychother. Psychosom. 2019, 88, 55–57. [Google Scholar] [CrossRef]
  17. Berlin, H.A.; Rolls, E.T. Time perception, impulsivity, emotionality, and personality in self-harming borderline personality disorder patients. J. Pers. Disord. 2004, 18, 358–378. [Google Scholar] [CrossRef]
  18. Pulcu, E.; Trotter, P.D.; Thomas, E.J.; McFarquhar, M.; Juhász, G.; Sahakian, B.J.; Deakin, J.F.; Zahn, R.; Anderson, I.M.; Elliott, R. Temporal discounting in major depressive disorder. Psychol. Med. 2014, 44, 1825–1834. [Google Scholar] [CrossRef] [Green Version]
  19. Brown, H.E.; Hart, K.L.; Snapper, L.A.; Roffman, J.L.; Perlis, R.H. Impairment in delay discounting in schizophrenia and schizoaffective disorder but not primary mood disorders. NPJ Schizophr. 2018, 4, 9. [Google Scholar] [CrossRef]
  20. Sellitto, M.; Ciaramelli, E.; di Pellegrino, G. Myopic discounting of future rewards after medial orbitofrontal damage in humans. J. Neurosci. 2010, 30, 16429–16436. [Google Scholar] [CrossRef] [Green Version]
  21. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Prisma Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef] [Green Version]
  22. Acheson, A.; Reynolds, B.; Richards, J.B.; de Wit, H. Diazepam impairs behavioral inhibition but not delay discounting or risk-taking in healthy adults. Exp. Clin. Psychopharmacol. 2006, 14, 190–198. [Google Scholar] [CrossRef]
  23. Richards, J.B.; Zhang, L.; Mitchell, S.H.; de Wit, H. Delay or probability discounting in a model of impulsive behavior: Effect of alcohol. J. Exp. Anal. Behav. 1999, 71, 121–143. [Google Scholar] [CrossRef] [Green Version]
  24. Reynolds, B.; Schiffbauer, R. Measuring state changes in human delay discounting: An experiential discounting task. Behav. Process. 2004, 67, 343–356. [Google Scholar] [CrossRef]
  25. Acheson, A.; de Wit, H. Bupropion improves attention but does not affect impulsive behavior in healthy young adults. Exp. Clin. Psychopharmacol. 2008, 16, 113–123. [Google Scholar] [CrossRef] [Green Version]
  26. Arrondo, G.; Aznárez-Sanado, M.; Fernández-Seara, M.A.; Goñi, J.; Loayza, F.R.; Salamon-Klobu, T.E.; Heukamp, F.H.; Pastor, M.A. Dopaminergic modulation of the trade-off between probability and time in economic decision-making. Eur. Neuropsychopharmacol. 2015, 25, 817–827. [Google Scholar] [CrossRef]
  27. Cornelisse, S.; van Ast, V.; Haushofer, J.; Seinstra, M.; Joels, M. Time-dependent effect of hydrocortisone administration on intertemporal choice. SSRN 2013, 1–22. [Google Scholar] [CrossRef] [Green Version]
  28. de Wit, H.; Enggasser, J.L.; Richards, J.B. Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology 2002, 27, 813–825. [Google Scholar] [CrossRef] [Green Version]
  29. Hamidovic, A.; Kang, U.J.; de Wit, H. Effects of low to moderate acute doses of pramipexole on impulsivity and cognition in healthy volunteers. J. Clin. Psychopharmacol. 2008, 28, 45–51. [Google Scholar] [CrossRef]
  30. Herman, A.M.; Critchley, H.D.; Duka, T. The impact of Yohimbine-induced arousal on facets of behavioral impulsivity. Psychopharmacology 2019, 236, 1783–1795. [Google Scholar] [CrossRef] [Green Version]
  31. Kayser, A.S.; Allen, D.C.; Navarro-Cebrian, A.; Mitchell, J.M.; Fields, H.L. Dopamine, corticostriatal connectivity, and intertemporal choice. J. Cogn. Neurosci. 2012, 32, 9402–9409. [Google Scholar] [CrossRef] [PubMed]
  32. Lempert, K.M.; Lackovic, S.F.; Tobe, R.H.; Glimcher, P.W.; Phelps, E.A. Propranolol reduces reference-dependence in intertemporal choice. Soc. Cogn. Affect. Neurosci. 2017, 12, 1394–1401. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. McDonald, J.; Schleifer, L.; Richards, J.B.; de Wit, H. Effects of THC on behavioral measures of impulsivity in humans. Neuropsychopharmacology 2003, 28, 1356–1365. [Google Scholar] [CrossRef] [Green Version]
  34. Ortner, G.R.; Wibral, M.; Becker, A.; Dohmen, T.; Klingmüller, D.; Falk, A.; Weber, B. No evidence for an effect of testosterone administration on delay discounting in male university students. Psychoneuroendocrinology 2013, 38, 1814–1818. [Google Scholar] [CrossRef] [PubMed]
  35. Petzold, J.; Lee, Y.; Pooseh, S.; Oehme, L.; Beuthien-Baumann, B.; London, E.D.; Goschke, T.; Smolka, M.N. Presynaptic dopamine function measured with [18 F] fluorodopa and L-DOPA effects on impulsive choice. Sci. Rep. 2019, 9, 17927. [Google Scholar] [CrossRef] [Green Version]
  36. Pine, A.; Shiner, T.; Seymour, B.; Dolan, R.J. Dopamine, time, and impulsivity in humans. J. Neurosci. 2010, 30, 8888–8896. [Google Scholar] [CrossRef]
  37. Pine, A.; Seymour, B.; Roiser, J.P.; Bossaerts, P.; Friston, K.J.; Curran, H.V.; Dolan, R.J. Encoding of marginal utility across time in the human brain. J. Neurosci. 2009, 29, 9575–9581. [Google Scholar] [CrossRef] [Green Version]
  38. Wagner, B.; Clos, M.; Sommer, T.; Peters, J. Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol. J. Neurosci. 2020, 40, 7936–7948. [Google Scholar] [CrossRef]
  39. Weber, S.C.; Beck-Schimmer, B.; Kajdi, M.E.; Müller, D.; Tobler, P.N.; Quednow, B.B. Dopamine D2/3-and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans. Transl. Psychiatry 2016, 6, e850. [Google Scholar] [CrossRef] [Green Version]
  40. Gelkopf, M.; Bleich, A.; Hayward, R.; Bodner, G.; Adelson, M. Characteristics of benzodiazepine abuse in methadone maintenance treatment patients: A 1-year prospective study in an Israeli clinic. Drug Alcohol Depend. 1999, 55, 63–68. [Google Scholar] [CrossRef]
  41. Wu, Y.; Shen, B.; Liao, J.; Li, Y.; Zilioli, S.; Li, H. Single dose testosterone administration increases impulsivity in the intertemporal choice task among healthy males. Horm. Behav. 2020, 118, 104634. [Google Scholar] [CrossRef] [PubMed]
  42. Zacny, J.P.; de Wit, H. The prescription opioid, oxycodone, does not alter behavioral measures of impulsivity in healthy volunteers. Pharmacol. Biochem. Behav. 2009, 94, 108–113. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Shen, B.; Yin, Y.; Wang, J.; Zhou, X.; McClure, S.M.; Li, J. High-definition tDCS alters impulsivity in a baseline-dependent manner. Neuroimage 2016, 143, 343–352. [Google Scholar] [CrossRef] [Green Version]
  44. Cook, D.J.; Mulrow, C.D.; Haynes, R.B. Systematic reviews: Synthesis of best evidence for clinical decisions. Ann. Intern. Med. 1997, 126, 376–380. [Google Scholar] [CrossRef]
  45. Sanderson, S.; Tatt, I.D.; Higgins, J. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: A systematic review and annotated bibliography. Int. J. Epidemiol. 2007, 36, 666–676. [Google Scholar] [CrossRef] [Green Version]
  46. Milenkova, M.; Mohammadi, B.; Kollewe, K.; Schrader, C.; Fellbrich, A.; Wittfoth, M.; Dengler, R.; Münte, T.F. Intertemporal choice in Parkinson’s disease. Mov. Disord. 2011, 26, 2004–2010. [Google Scholar] [CrossRef] [PubMed]
  47. Kim, B.; Yoon, S.; Nakajima, R.; Lee, H.J.; Lim, H.J.; Lee, Y.K.; Choi, J.S.; Yoon, B.J.; Augustine, G.J.; Baik, J.H. Dopamine D2 receptor-mediated circuit from the central amygdala to the bed nucleus of the stria terminalis regulates impulsive behavior. Proc. Natl. Acad. Sci. USA 2018, 115, E10730–E10739. [Google Scholar] [CrossRef] [Green Version]
  48. Bernosky-Smith, K.A.; Qiu, Y.Y.; Feja, M.; Lee, Y.B.; Loughlin, B.; Li, J.X.; Bass, C.E. Ventral tegmental area D2 receptor knockdown enhances choice impulsivity in a delay-discounting task in rats. Behav. Brain Res. 2018, 341, 129–134. [Google Scholar] [CrossRef]
  49. Dalley, J.W.; Fryer, T.D.; Brichard, L.; Robinson, E.S.; Theobald, D.E.; Lääne, K.; Peña, Y.; Murphy, E.R.; Shah, Y.; Probst, K.; et al. Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science 2007, 315, 1267–1270. [Google Scholar] [CrossRef] [Green Version]
  50. Lee, B.; London, E.D.; Poldrack, R.A.; Farahi, J.; Nacca, A.; Monterosso, J.R.; Mumford, J.A.; Bokarius, A.V.; Dahlbom, M.; Mukherjee, J.; et al. Striatal dopamine D2/D3 receptor availability is reduced in methamphetamine dependence and is linked to impulsivity. J. Neurosci. 2009, 29, 14734–14740. [Google Scholar] [CrossRef] [Green Version]
  51. Ballard, M.E.; Mandelkern, M.A.; Monterosso, J.R.; Hsu, E.; Robertson, C.L.; Ishibashi, K.; Dean, A.C.; London, E.D. Low dopamine D2/D3 receptor availability is associated with steep discounting of delayed rewards in methamphetamine dependence. Int. J. Neuropsychopharmacol. 2015, 18, pyu119. [Google Scholar] [CrossRef] [Green Version]
  52. Pennisi, P.; Salehinejad, M.A.; Corso, A.M.; Merlo, E.M.; Avenanti, A.; Vicario, C.M. Delay discounting in Parkinson’s disease: A systematic review and meta-analysis. Behav. Brain Res. 2022, 346, 114101. [Google Scholar] [CrossRef]
  53. Foerde, K.; Figner, B.; Doll, B.B.; Woyke, I.C.; Braun, E.K.; Weber, E.U.; Shohamy, D. Dopamine modulation of intertemporal decision-making: Evidence from Parkinson disease. J. Cogn. Neurosci. 2016, 28, 657–667. [Google Scholar] [CrossRef] [Green Version]
  54. Cools, R.; Barker, R.A.; Sahakian, B.J.; Robbins, T.W. L-Dopa medication remediates cognitive inflexibility but increases impulsivity in patients with Parkinson’s disease. Neuropsychology 2003, 41, 1431–1441. [Google Scholar] [CrossRef]
  55. Castrellon, J.J.; Meade, J.; Greenwald, L.; Hurst, K.; Samanez-Larkin, G.R. Dopaminergic modulation of reward discounting in healthy rats: A systematic review and meta-analysis. Psychopharmacology 2020, 238, 711–723. [Google Scholar] [CrossRef]
  56. Seeman, P. Parkinson’s disease treatment may cause impulse–control disorder via dopamine D3 receptors. Synapse 2015, 69, 183–189. [Google Scholar] [CrossRef]
  57. Onge, J.R.; Floresco, S.B. Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 2009, 34, 681–697. [Google Scholar] [CrossRef] [Green Version]
  58. Castells, X.; Blanco-Silvente, L.; Cunill, R. Amphetamines for attention deficit hyperactivity disorder (ADHD) in adults. Cochrane Database Syst. Rev. 2018, 8, CD007813. [Google Scholar] [CrossRef]
  59. Perry, J.L.; Stairs, D.J.; Bardo, M.T. Impulsive choice and environmental enrichment: Effects of d-amphetamine and methylphenidate. Behav. Brain Res. 2008, 193, 48–54. [Google Scholar] [CrossRef] [Green Version]
  60. Song, J.; Park, J.H.; Han, D.H.; Roh, S.; Son, J.H.; Choi, T.Y.; Lee, H.; Kim, T.H.; Lee, Y.S. Comparative study of the effects of bupropion and escitalopram on Internet gaming disorder. Psychiatry Clin. Neurosci. 2016, 70, 527–535. [Google Scholar] [CrossRef]
  61. Verbeeck, W.; Bekkering, G.E.; van den Noortgate, W.; Kramers, C. Bupropion for attention deficit hyperactivity disorder (ADHD) in adults. Cochrane Database Syst. Rev. 2017, 10, CD0095. [Google Scholar] [CrossRef] [PubMed]
  62. Cardinal, R.N.; Robbins, T.W.; Everitt, B.J. The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology 2000, 152, 362–375. [Google Scholar] [CrossRef] [PubMed]
  63. Helms, C.M.; Reeves, J.M.; Mitchell, S.H. Impact of strain and D-amphetamine on impulsivity (delay discounting) in inbred mice. Psychopharmacology 2006, 188, 144–151. [Google Scholar] [CrossRef]
  64. Maguire, D.R.; Henson, C.; France, C.P. Effects of amphetamine on delay discounting in rats depend upon the manner in which delay is varied. Neuropharmacology 2014, 87, 173–179. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Carvalho, M.M.; Campos, F.L.; Marques, M.; Soares-Cunha, C.; Kokras, N.; Dalla, C.; Leite-Almeida, H.; Sousa, N.; Salgado, A.J. Effect of levodopa on reward and impulsivity in a rat model of Parkinson’s disease. Front. Behav. Neurosci. 2017, 11, 145. [Google Scholar] [CrossRef] [Green Version]
  66. Cools, R.; D’Esposito, M. Inverted-U–shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 2011, 69, e113–e125. [Google Scholar] [CrossRef] [Green Version]
  67. Rivest, J.; Barclay, C.L.; Suchowersky, O. COMT Inhibitors in Parkinson’s Disease. Can. J. Neurol. Sci. 1999, 2, S34–S38. [Google Scholar] [CrossRef]
  68. Boettiger, C.A.; Mitchell, J.M.; Tavares, V.C.; Robertson, M.; Joslyn, G.; D’Esposito, M.; Fields, H.L. Immediate reward bias in humans: Front-parietal networks and a role for the catechol-O-methyltransferase 158Val/Val genotype. J. Neurosci. 2007, 27, 14383–14391. [Google Scholar] [CrossRef] [Green Version]
  69. Paloyelis, Y.; Asherson, P.; Mehta, M.A.; Faraone, S.V.; Kuntsi, J. DAT1 and COMT effects on delay discounting and trait impulsivity in male adolescents with attention deficit/hyperactivity disorder and healthy controls. Neuropsychopharmacology 2010, 35, 2414–2426. [Google Scholar] [CrossRef] [Green Version]
  70. Lempert, K.M.; Porcelli, A.J.; Delgado, M.R.; Tricomi, E. Individual differences in delay discounting under acute stress: The role of trait perceived stress. Front. Psychol. 2012, 3, 251. [Google Scholar] [CrossRef] [Green Version]
  71. Eisenegger, C.; Haushofer, J.; Fehr, E. The role of testosterone in social interaction. Trends Cogn. Sci. 2011, 15, 263–271. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  72. Kurath, J.; Mata, R. Individual differences in Risk-taking and endogenous levels of testosterone, estradiol, and cortisol: A systematic literature search and three independent meta-analyses. Neurosci. Biobehav. Rev. 2018, 90, 428–446. [Google Scholar] [CrossRef] [PubMed]
  73. Creutz, L.M.; Kritzer, M.F. Mesostriatal and mesolimbic projections of midbrain neurons immunoreactive for estrogen receptor beta or androgen receptors in rats. J. Comp. Neurol. 2004, 476, 348–362. [Google Scholar] [CrossRef]
  74. van Steenbergen, H.; Eikemo, M.; Leknes, S. The role of the opioid system in decision making and cognitive control: A review. Cogn. Affect. Behav. Neurosci. 2019, 19, 435–458. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  75. Aizpurua-Olaizola, O.; Elezgarai, I.; Rico-Barrio, I.; Zarandona, I.; Etxebarria, N.; Usobiaga, A. Targeting the endocannabinoid system: Future therapeutic strategies. Drug Discov. Today 2017, 22, 105–110. [Google Scholar] [CrossRef]
  76. Kieres, A.K.; Hausknecht, K.A.; Farrar, A.M.; Acheson, A.; de Wit, H.; Richards, J.B. Effects of morphine and naltrexone on impulsive decision making in rats. Psychopharmacology 2004, 173, 167–174. [Google Scholar] [CrossRef]
  77. Pattij, T.; Schetters, D.; Janssen, M.C.; Wiskerke, J.; Schoffelmeer, A.N. Acute effects of morphine on distinct forms of impulsive behavior in rats. Psychopharmacology 2009, 205, 489–502. [Google Scholar] [CrossRef] [Green Version]
  78. de Wit, H.; Crean, J.; Richards, J.B. Effects of d-amphetamine and ethanol on a measure of behavioral inhibition in humans. Behav. Neurosci. 2000, 114, 830–837. [Google Scholar] [CrossRef]
  79. Ameri, A. The effects of cannabinoids on the brain. Prog. Neurobiol. 1999, 58, 315–348. [Google Scholar] [CrossRef]
  80. Chait, L.D.; Pierri, J. Effects of Smoked Marijuana on Human Performance: A Critical Review; Marijuana/Cannabinoids; CRC Press: Boca Raton, FL, USA, 1992. [Google Scholar]
  81. Evenden, J.; Ko, T. The psychopharmacology of impulsive behavior in rats VIII: Effects of amphetamine, methylphenidate, and other drugs on responding maintained by a fixed consecutive number avoidance schedule. Psychopharmacology 2005, 180, 294–305. [Google Scholar] [CrossRef]
  82. Deakin, J.B.; Aitken, M.R.; Dowson, J.H.; Robbins, T.W.; Sahakian, B.J. Diazepam produces disinhibitory cognitive effects in male volunteers. Psychopharmacology 2004, 173, 88–97. [Google Scholar] [CrossRef] [PubMed]
  83. Fava, M. Psychopharmacologic treatment of pathologic aggression. Psychiatr. Clin. N. Am. 1997, 20, 427–451. [Google Scholar] [CrossRef] [PubMed]
  84. Dåderman, A.M.; Fredriksson, B.; Kristiansson, M.; Nilsson, L.H.; Lidberg, L. Violent behavior, impulsive decision-making, and anterograde amnesia while intoxicated with flunitrazepam and alcohol or other drugs: A case study in forensic psychiatric patients. J. Am. Acad. Psychiatry Law 2002, 30, 238–251. Available online: https://pubmed.ncbi.nlm.nih.gov/12108561/ (accessed on 13 December 2022). [PubMed]
Healthcare 11 01046 g001 550
Figure 1. Hyperbolic Discounting. Note. The discounting of the outcome has a hyperbolic shape in function of time. The continuous line represents the hyperbolic function, and the dotted line an exponential function.
Figure 1. Hyperbolic Discounting. Note. The discounting of the outcome has a hyperbolic shape in function of time. The continuous line represents the hyperbolic function, and the dotted line an exponential function.
Healthcare 11 01046 g001
Healthcare 11 01046 g002 550
Figure 2. Prisma Flowchart. Note. Adapted PRISMA flow diagram of the study selection.
Figure 2. Prisma Flowchart. Note. Adapted PRISMA flow diagram of the study selection.
Healthcare 11 01046 g002
Healthcare 11 01046 g003 550
Figure 3. Analysis of Risk of bias. Note. Risk of bias using the Rob 2.0 tool for the 19 selected studies [2,13,22,25,26,27,28,29,30,31,32,33,34,35,36,38,39,41,42] (Risk +, ?, −), and the domains evaluated.
Figure 3. Analysis of Risk of bias. Note. Risk of bias using the Rob 2.0 tool for the 19 selected studies [2,13,22,25,26,27,28,29,30,31,32,33,34,35,36,38,39,41,42] (Risk +, ?, −), and the domains evaluated.
Healthcare 11 01046 g003
Table
Table 1. Summary of characteristics and results of included studies.
Table 1. Summary of characteristics and results of included studies.
Author/Year/Study DesignSampleAge
(Mean ± SD), in Years		Intervention TypeIntertemporal Decision-Making TaskResults
SourceSize
Acheson et al. [22].
-United States
-Randomized, within subject-design.		Males and females18 participants
-9 Male
-9 Female		Aged: 18–45
Mean: 20.9 ± 2.5		Diazepam (Valium 20 mg).
Placebo		Delay and probability discounting task [23].
Experiential discounting task [24].		Diazepam did not affect Delay and probability discounting task neither Experiential discounting task, p <0.05.
Acheson & de Wit [25].
-United States
-Randomized, within-subject design.		Male and female33 participants
-Men:18
-Women:15		Aged: 18–45
Mean: 23.45 ± 4.6		Bupropion hydrochloride BH (75 mg)
BH (100 mg)
D-amphetamine sulfate (5 mg)
Placebo		Delay and Probability Discounting Task [23].Neither bupropion nor amphetamine affected discounting of hypothetical delayed or probabilistic rewards on the DPD, p <0.05.
Arrondo et al. [26].
-Spain
-Randomized, between-subject design.		Males and Females29 participants
Intervention: 15
-Men:9
-Women:6
Placebo: 14
-Men:4
-Women:10		Aged intervention group: 24.0 ± 3.4 years

Age placebo group: 23 ±1.9 years		Metoclopramide (10 mg) (Primperan)
Placebo		Decision-making task.Intervention group was more willing to wait to increase the probability of the reward, p = 0.007.
Cornelisse et al. [27].
- Germany
- Randomized, between subject design.		Males79 ParticipantsAged
18 to 35		Hydrocortisone (10 mg).
Placebo (albochin)		Temporal discounting task [27].Hydrocortisone administration increased preference for immediate rewards after administration, but not three hours later.
-p < 0.10
-p < 0.01
-p < 0.05
de Wit et al. [28]
-United States
-Randomized, within subject-subject design.		Males and females36 participants
-18 Male
-18 Female		Aged
18–44
Mean: 24 ± 6.5		D-amphetamine (10 & 20 mg).
Placebo		Delay Discounting [23].
Delay of Gratification.
Time perception.
Only high d-Amphetamine significantly decreased the discounting, p < 0.05.
Hamidovic et al. [29].
-United States
-Randomized, within design.		Males and females10 ParticipantsAged
18–28		Pramipexole (0.25 & 0.50 mg Mirapex)
Placebo.		Delay Discounting task.Pramipexole did not significantly affect either delay or probability discounting, p <0.05.
Herman et al. [30].
-UK
-Randomized, between subject design.		Male and female42 Participants
Exposed: 21
-12 females
-9 male
Controls: 21
-11 females
-10 Male		Aged
18–40
Exposed:21.29
Control:
23.19		Yohimbine (20 mg).
Placebo		Probability Discounting Task (PD [4]).
Monetary Choice Questionnaire (MCQ [4]).		There were no group differences in performance on neither MCQ, PD.
Kayser et al. [31].
-United States
-Randomized, within-subject design.		Males and females23 participants
-13 females
-10 males		Aged
19–41		Tolcapone (200 mg).
Placebo		Delay Discounting Task.Tolcapone (200 mg) increased the choosing of the delayed reward ∆ICR = −0.04 p = 0.025.
Lempert et al. [32].
-United States
-Randomized, within-subject design.		Male and female37 participantsAged
27.8 ± 6.6		 Propranolol (80 mg)
Placebo		Intertemporal choice task.Propranolol did not reduce temporal discounting overall, p < 0.05.
McDonald et al. [33].
-United States
-Randomized, within-subjects design.		Males and females37 participants
-Men:18
-Women:19		Aged
18–45
Mean 23 ± 4.48		Marinols
7.5 mg
Marinols
15 mg
Placebo		The Delay discounting task [23].THC did not significantly affect either delay or probability discounting, p < 0.05.
Ortner et al. [34].
-Germany
-Randomized, between subject design.		Males91 participants
- Experimental group: 46
Placebo group: 45.		Aged
24.3 SD: 2.73		Testogel ® 50 mg
Placebo 50 mg		Monetary choice questionnaire [9].Testosterone does not have a significant effect on delay discounting in male university students, p = 0.538.
Petzold et al. [35].
-Germany
-Randomized, within-subject design.		Males and females87 participants
-65 males
-22 females
44
Low-weight subjects
-25 males
-19 females		Aged:
20–40
Mean: 35.91 ± 3.8		Madopar 187.5 mg
L-dopa
Booster 93.75 mg
Placebo		Value-based decision-making test battery.No significant differences between placebo and L-DOPA conditions for delay discounting, risk-seeking for gains and losses, p < 0.05.
Pine et al. [36].
-London
-Randomized, within-subject design.		Males and females14 participants
-Men: 6
-Women: 8		Aged
18–30
Mean 21		Haloperidol
1.5 mg
Madopar
(L-Dopa 150 mg)
Placebo		Temporal discounting task [37].L-dopa 150 mg increased the number of sooner options chosen relative to the placebo condition.
There was no significant difference between haloperidol and placebo conditions on this disposition, p < 0.05.
Reynolds et al. [13].
-United States
-Randomized, within-subject design.		Male and female35 participants
-Men 19
-Women 16		Aged
18–45		Diazepam (Valium, 5 mg)
Diazepam
10 mg
Placebo		Delay discounting task [23].Diazepam (5 mg & 10 mg) did not affect performance on any of the behavioral task measures of impulsivity, including k values on the discounting task.
p < 0.05.
Riis-Vestergaard et al. [2].
-Netherlands
-Randomized, between-subject design.		Males79 participantsAged
18–35		Hydrocortisone (10 mg; rapid and slow cort)
Placebo		Intertemporal choice task.
Hydrocortisone administration increased preference for immediate rewards after administration, but not three hours later, p < 0.05.
Wagner et al. [38].
- Germany
-Randomized, between subject design		Males54 participants:
27
for each group.		Placebo Group: 24.4. SD: 3.4
-
Experimental group: 23.3 SD: 2.5		Haloperidol 2 mg
Placebo		Temporal discounting task.The D2-receptor antagonist haloperidol attenuated temporal discounting and substantially shortened nondecision times.
Weber et al. [39].
- Switzerland
- Randomized, between subject design		Male and Female121 participants
- Experimental group: 81
Placebo group: 40		Placebo group: 22.15
Amilsupride group: 21.46
Naltrexone group: 21.65		Amisulpride 400 mg
Naltrexone
50 mg
Placebo		Monetary Choice Questionnaire [9].Amisulpride group chose the smaller immediate
rewards significantly less often than the placebo group (t [40] = 2.58, p < 0.01).
The difference between the naltrexone and the placebo groups did not reach significance (t [40] = 1.70. p = 0.09).
Wu et al. [41].
-China
-Between subjects, placebo-controlled, double-blind intervention.		Males111 participantsAged
18–27
Mean: 21.7 ± 1.9		Androgel (150 mg) ®.
Testosterone
Placebo		Intertemporal choice (ITC) task.Testosterone group (k value: M = 0.10, SD = 0.21) showed increased impulsivity than those in the placebo group (k value: M = 0.022, SD = 0.030), p = 0.001.
Zacny & de Wit [42].
-United States
-Randomized, within-subject design.		Males and Females12 participants
-6 Men
-6 Women		Aged
21–39
Mean: 25.3 ± 3.6		Oxycodone (5 mg, 10 mg & 20 mg).
Placebo		Delay and probability discounting task (DPD [9]).There were no discernible trends of an effect of oxycodone on the DPD.
Table
Table 2. Used Drugs.
Table 2. Used Drugs.
DrugPropertiesUses
AmisulprideAmisulpride is a dopamine D2 receptor antagonist.
At low doses Amisulpride blocks presynaptic dopamine D2 and D3 receptors, increasing dopaminergic levels in the synaptic cleft. 		Used in schizophrenia, and to prevent and treat postoperative nausea and vomiting in adults
PramipexolePramipexole is a non-ergot dopamine agonist. It shows specific and strong activity in D2 and D3 receptors. Used to treat symptoms of Parkinson’s disease and Restless Legs Syndrome
HaloperidolHaloperidol binds to dopamine D2 receptor. Blocking approximately 60–80% of D2 receptors in the brain. But it also has activity at a number of receptors in the brain. Used to treat schizophrenia. Also, symptoms of agitation, irritability and delirium
MetoclopramideMetoclopramide is a dopamine D2 antagonist. It inhibits dopamine D2 and serotonin 5-HT3 receptors in the chemoreceptor trigger zone located in the area postrema of the brain. Used to treat gastroesophageal reflux disease, and prevention of nausea and vomiting
LevadopaLevadopa is a dopamine precursor. While dopamine cannot cross the blood brain barrier, Levadopa is able to. After crossing the barrier Levadopa is converted to dopamine Used in the treatment of Parkinson disease
BupropionBupropion is a norepinephrine/dopamine reuptake inhibitor (NDRI). It inhibits the enzymes involved in reuptaking norepinephrine and dopamine prolonging their action. Specifically, bupropion binds to the norepinephrine transporter (NET) and the dopamine transporter (DAT)Used in the treatment of major depressive disorder and seasonal affective disorder
TolcaponeTolcapone is a selective and reversible inhibitor of catechol-O-methyltransferase (COMT) -COMT is an enzyme responsible for the degradation of catecholamines-. Used as adjunct therapy in the symptomatic management of idiopathic Parkinson’s disease.
D-amphetamineD-amphetamine is a noncatecholamine, sympathomimetic amine that acts as Central Nervous System stimulant. Used in the treatment of attention deficit hyperactivity disorder and narcolepsy.
YohimbineYohimbine is a pre-synaptic alpha 2-adrenergic blocking agent. It increases norepinephrine release Yohimbine is found in supplements.
PropranololPropranolol is a non-selective beta-adrenergic receptor antagonist. Means that it does not have preference for Beta receptors. It inhibits sympathetic stimulation of the heart. It reduces resting heart rate, cardiac output, blood pressure.Used to treat hypertension, angina, atrial fibrillation, myocardial infarction, migraine, essential tremor, hypertrophic subaortic stenosis, and pheochromocytoma.
HydrocortisoneHydrocortisone, or cortisol, is a glucocorticoid secreted by the adrenal cortex. It is essential for life and supports many important cardiovascular, metabolic, immunologic, and homeostatic functionsUsed to treat corticosteroid-responsive dermatoses, endocrine disorders, immune conditions, and allergic disorders.
TestosteroneTestosterone is a steroid sex hormoneUsed to treat hypogonadism or breast carcinoma in women,
Marinols (Dronabinold)Marinol (Dronabinol) is a cannabinoid. It’s a synthetic form of THC, which is an ingredient found in marijuana.Treatment of anorexia and weight loss in people with acquired immunodeficiency syndrome. Also is used in treatment of nausea and vomiting from chemotherapy
DiazepamDiazepam is a benzodiazepine that binds to receptors in the brain and spinal cord. This binding increases the inhibitory effects of GABA (gamma-aminobutyric acid). GABA is involved in sleep induction, memory, anxiety, epilepsy and neuronal excitability. Used to treat panic disorders, severe anxiety, and seizures.
OxycodoneOxycodone is an opioid. It binds to the mu opioid receptor, and to the kappa and delta opioid receptor. Used in the treatment of pain.
NaltrexoneNaltrexone is a opiate antagonist. It may block the effects of endogenous opioids. Used in opioid overdose.
Note. Pharmacodynamics of each drug used, and the use related to medical condition.
Table
Table 3. Drug’s mechanism of action.
Table 3. Drug’s mechanism of action.
DrugMechanismStudy
AmisulprideDopamine D2 receptor antagonist.Weber et al. [39]
HaloperidolDopamine antagonist.Wagner et al. [38]
Pine et al. [36]
MetoclopramideDopamine D2 receptor antagonist.Arrondo et al. [26]
PramipexoleDopamine agonist.Hamidovic et al. [29]
LevodopaDopamine agonist.Pine et al. [36]
Petzold et al. [35]
D-amphetamineIndirect agonist of dopamine and norepinephrine.Acheson et al. [25]
de Wit et al. [28]
de Wit et al. [28]
BupropionNorepinephrine/dopamine-reuptake inhibitor.Acheson et al. [25]
TolcaponeInhibitor of catechol-O-methyltransferase (Enzyme responsible for the degradation of catecholamines).Kayser et al. [31]
HydrocortisoneGlucocorticoid (Cortisol).Cornelisse et al. [27]
Riis-Verstergaard et al. [2]
YohimbineAlpha 2-adrenergic blocking agent.Herman et al. [30]
PropranololNonselective β-adrenergic receptor antagonist.Lempert et al. [32]
TestosteroneActs on Androgen receptor.Wu et al. [41]
Ortner et al. [34]
OxycodoneOpioid agonists.Zacny et al. [42]
NaltrexoneOpioid antagonist.Weber et al. [39]
Marinols(THC).McDonald et al. [33]
DiazepamBenzodiazepine. Increases the inhibitory effects of gamma-aminobutyric acid (GABA).Reynolds et al. [13]
Acheson et al. [22]
Acheson et al. [22]
Note. The table presents the effect of the drug according to the study conducted. The colors represent the intensity of the effect in the temporal discounting: Later reward (blue), Sooner reward (yellow) and No effect (green).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sarmiento, L.F.; Ríos-Flórez, J.A.; Paez-Ardila, H.A.; Lima de Sousa, P.S.; Olivera-La Rosa, A.; Oliveira da Silva, A.M.H.; Gouveia, A., Jr. Pharmacological Modulation of Temporal Discounting: A Systematic Review. Healthcare 2023, 11, 1046. https://doi.org/10.3390/healthcare11071046

AMA Style

Sarmiento LF, Ríos-Flórez JA, Paez-Ardila HA, Lima de Sousa PS, Olivera-La Rosa A, Oliveira da Silva AMH, Gouveia A Jr. Pharmacological Modulation of Temporal Discounting: A Systematic Review. Healthcare. 2023; 11(7):1046. https://doi.org/10.3390/healthcare11071046

Chicago/Turabian Style

Sarmiento, Luis Felipe, Jorge Alexander Ríos-Flórez, Hector Andres Paez-Ardila, Pêssi Socorro Lima de Sousa, Antonio Olivera-La Rosa, Anderson Manoel Herculano Oliveira da Silva, and Amauri Gouveia, Jr. 2023. "Pharmacological Modulation of Temporal Discounting: A Systematic Review" Healthcare 11, no. 7: 1046. https://doi.org/10.3390/healthcare11071046

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop