Next Article in Journal
High-Altitude Exposure and Time Interval Perception of Chinese Migrants in Tibet
Previous Article in Journal
Algorithm-Based Hearing and Speech Therapy Rehabilitation after Cochlear Implantation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Cost of Imagined Actions in a Reward-Valuation Task

1
Centre for Studies and Research in Cognitive Neuroscience, Department of Psychology, University of Bologna, 40126 Bologna, Italy
2
School of Psychology, Bangor University, Bangor LL57 2AS, UK
3
Department of Decision Neuroscience and Nutrition, German Institute of Human Nutrition (DIfE), 14558 Potsdam-Rehbrücke, Germany
4
Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin Institute of Health, Neuroscience Research Center, 10117 Berlin, Germany
*
Authors to whom correspondence should be addressed.
Brain Sci. 2022, 12(5), 582; https://doi.org/10.3390/brainsci12050582
Submission received: 15 April 2022 / Revised: 26 April 2022 / Accepted: 27 April 2022 / Published: 29 April 2022

Abstract

:
Growing evidence suggests that humans and other animals assign value to a stimulus based not only on its inherent rewarding properties, but also on the costs of the action required to obtain it, such as the cost of time. Here, we examined whether such cost also occurs for mentally simulated actions. Healthy volunteers indicated their subjective value for snack foods while the time to imagine performing the action to obtain the different stimuli was manipulated. In each trial, the picture of one food item and a home position connected through a path were displayed on a computer screen. The path could be either large or thin. Participants first rated the stimulus, and then imagined moving the mouse cursor along the path from the starting position to the food location. They reported the onset and offset of the imagined movements with a button press. Two main results emerged. First, imagery times were significantly longer for the thin than the large path. Second, participants liked significantly less the snack foods associated with the thin path (i.e., with longer imagery time), possibly because the passage of time strictly associated with action imagery discounts the value of the reward. Importantly, such effects were absent in a control group of participants who performed an identical valuation task, except that no action imagery was required. Our findings hint at the idea that imagined actions, like real actions, carry a cost that affects deeply how people assign value to the stimuli in their environment.

1. Introduction

What is the relation between the value that the brain assigns to a rewarding stimulus and the cost of the action required to obtain it? The value an agent gives to a reward is well known to be determined by its immediate sensory characteristics (e.g., the amount of a food product or its taste), as well as by individual preferences and experiences. However, among the majority of animals, the decision to forage often implies the computation of benefits against predictable costs, including the effort required to obtain the reward [1,2,3,4]. Recent behavioural and neuroeconomic studies have suggested that the value assigned to a reward stands in inverse relation to the amount of effort required to obtain it [5,6,7,8]. In other words, people give more value to those rewards that can be achieved with less effort [9,10,11]. Such effort can be physical but also cognitive (e.g., by manipulating visuospatial task demands) [12]. Therefore, it is plausible to expect that value computation can be influenced by the degree of cognitive effort as well [13,14].
Similar to effort, another cost that is often incurred during decision-making is the delay that one has to endure before receiving a reward. This phenomenon is known as temporal discounting (TD) and reflects the decrease in the subjective value of a reward [15,16,17,18,19]. Recently, TD has been deemed to affect the motor commands responsible for the movements of the human body necessary to reach a stimulus [20,21,22]. When a stimulus is associated with a future reward, lower dopaminergic neurons firing is observed, as well as slower saccades for the visual reaching of the stimulus are recorded [23,24]. In addition, when a stimulus is associated with an immediate reward, higher dopaminergic neuron firing usually precedes faster movements [25,26]. Therefore, the kinematics of movements seem to reflect the processes with which the brain temporally discounts rewards, suggesting a link between motor and valuation processes [20,27,28]. Movements and time share a well-known relation as well: according to Fitts’ law [29], the time needed by an individual to move between a starting point and a target point within a given space increases linearly with the difficulty to execute the movement. In addition, the time for mentally simulating movements (motor imagery, MI) [30,31,32,33,34,35] is highly correlated with the time to actually make such movements. Thus, mental movements closely mimic real movements in their temporal organization, involve the same planning programs [36] and rely on similar neural processes [37,38,39]. Furthermore, Fitts’ law accounts equally well for imagined and executed movements [40,41,42,43].
A substantial body of neurophysiological and neuroimaging studies suggests that there are brain areas and neural populations responsible for both the decisional process and the selection of an action [44,45,46,47]. These areas represent a common substrate for the different kinds of decision-making processes. In particular, the orbitofrontal cortex (OFC) has a critical role in representing the subjective value of a reward, thus employing such value to condition the choice among different options [5,48,49,50]. In addition to the OFC, value is represented in other regions, including those related to motor preparation and execution [51,52,53,54,55,56]. In line with these studies, decisions based on value would affect the competition between representations of actions and the movement itself before the decision-making processes are completed [57,58]. Moreover, action representation has also been observed to influence the value of an item during the decision-making processes. Such influence could be interpreted as a sort of value signal from the motor and pre-motor regions [44,55,59,60,61]. Based on this evidence, it can be argued that the mechanisms underlying the computation of reward value are extremely sensitive to the cost of an action needed to obtain such reward. Importantly, the preference for an action is inversely proportional to its effort, even in terms of time. This can, in turn, influence the preference of a reward such that when the action is more difficult and requires more time to be executed, the reward may be perceived as less valuable.
In the present study, we investigated, for the first time, whether imagined movements, like real ones [23,62], would carry a cost that affects how people assign value to food items. These processes are currently unexplored, and they can be useful in better understanding diseases such as apathy, which is characterized by an alteration of abilities to anticipate the effort or difficulty. To this end, via a novel experimental procedure, participants performed an experimental task in which the pictures of food and drink item were associated with two different path widths (large or thin) that were really and imaginarily navigated via a mouse cursor. After navigation, participants rated how much they liked and wanted those items on a Likert scale. We expected participants to assign a higher value score (i.e., wanting and liking) to food items that required a shorter time (lower cost) to be reached (large path), relative to those items requiring a longer time (higher cost, thin path). Thus, thin path was expected to take more time, incurring a higher cost, while large path was expected to require less time and hence lower cost.

2. Materials and Methods

2.1. Participants

A power analysis based on previously published studies [63,64,65,66] indicated that a sample size of ~20 participants was necessary to achieve a statistical power of >95% (2-tailed = 0.05). Thus, a total of 40 young adult right-handed volunteers (22 female) with a mean age of 23.6 years (sd = 2.76) and mean education of 16.87 years (sd = 2.16) were recruited from the student population of the University of Bologna for a single-session experiment (see Table 1 for further demographic information). Participants were randomly assigned either to the experimental group or to the control group. Body Mass Index (BMI) was calculated for each participant and then overall for each group [67]. Moreover, hunger (on a 5-point Likert scale ranging from 0 “not at all hungry” to 5 “extremely hungry”) and fasting level (hours without eating) were collected. Subjects remained naïve as to the purpose of the study until debriefing at the end of the experimental session. The two groups did not show any significant difference in terms of BMI index, hunger and fasting level (all ps > 0.2). Participants had no history of psychiatric or neurological diseases, had normal or corrected-to-normal vision and all gave written informed consent before the beginning of the experiment. The experimental protocol was conducted in accordance with the Declaration of Helsinki (2008) and approved by the Institutional Review Board (or Ethics Committee) of the University of Bologna (protocol number 14, 8 February 2013).

2.2. Apparatus and Stimuli

The experiment was implemented in E-prime 2.0 (Psychology Software Tool, Sharpsburg, PA, USA) and run on a Windows-based PC (Lenovo ThinkCentre Desktop Computer, Beijing, China). Participants sat in front of a 15-inch colour LCD monitor (1024 × 768 pixels) with an unconstrained viewing distance of approximately 65 cm.
Two rectangles were displayed centred on the screen in two different positions. One rectangle (55 × 75 mm) was positioned in the upper part, and the other (15 × 75 mm) in the lower part of the screen. They could be connected either through a large (155 × 65 mm) or a thin (155 × 20 mm) path (Figure 1). These paths induced participants to perform a potential movement over the path. In particular, the thin path forced participants to perform more careful movements compared to the large one [68]. Pictures of food and drink items (50 × 50 mm) appeared one at the time inside the top rectangle, while the bottom one was used as the starting point. The size of the paths was randomized among trials (see Figure 1). Pictures of Food and drink items were coloured pictures of 28 different snack food and drink items consisting of candy bars (e.g., Bounty or KitKat), potato crisps (e.g., Fonzies), crackers (e.g., Ritz), fruit juices (e.g., Pago) and carbonated drinks (e.g., Sprite). Such items were available at local convenience stores, each with a mean price of EUR 1.36 (sd = 0.54). To reduce the influence of personal food preference, the presentation of the stimuli was counterbalanced across participants. All stimuli were balanced for luminance, complexity and colour saturation using photo editing software (Adobe Photoshop CS6).

2.3. Tasks

2.3.1. Experimental Valuation Task

In this task, and for each trial, participants first had to answer to two questions. Second, they had to imagine themselves dragging the mouse along the path shown on the screen (thin or large) from the starting point rectangle to the upper rectangle. Specifically, they were required to imagine keeping the mouse cursor inside the path until the food item was reached.
Trials started with a black fixation cross, centrally displayed on a white background (1000 ms), followed by the presentation of a food item, together with one of the two paths. Participants could observe the screen for as long as they needed. When they felt ready, they were instructed to press the spacebar so that one question and its rating scale appeared at one bottom corner of the screen. The order and screen position of questions and their respective scales were counterbalanced across participants. The two questions (in Italian) were “How pleasant would it be to experience eating this item now?” (liking ratings), and “How much do you want to eat it now?” (wanting ratings) [69]. Participants answered through a seven-point Likert scale (ranging from 1 “not at all” to 7 “extremely”) [70] by pressing the corresponding number on the keyboard. After the last rating was submitted, the question and the scale faded out. Then, mouse cursor appeared, centred within the bottom starting rectangle. At this point, participants had to imagine, in a first-person perspective, dragging the mouse along the path from the starting point to the food item picture in the upper rectangle at the end of the path. They had to press the left mouse button with the index finger of the right hand to signal the start of their imagined movement, and the button had to be pressed again to flag the imagined reaching of the food item. Trials were separated by a 1000 ms inter-trial interval (ITI) with a blank screen (see Figure 2). The experimental valuation task consisted of 56 randomized trials, 28 for each path width. Before starting the task, participants had to perform three trials for training. They had to press the left mouse button with the index finger of the right hand, drag the mouse inside the path and reach the food item. Finally, the mouse button had to be pressed again to complete the trial. It is important to note that during the training, participants had to physically move the mouse along the path to ensure that participants understood the kinetic characteristics of the actions [68]. Indeed, the training aimed at familiarising participants with the reaching movement that they had to imagine completing across the paths, where the large path was assumed to be easier than the thin one.

2.3.2. Control Valuation Task

The control valuation task was designed to ensure that only the imagery time required to perform the reaching movement affected the value assigned to the item, as performed during the experimental task. Before participants began the control valuation task, a short training (e.g., 3 trials) was performed, during which they were familiarised with the food and drink items, as well as with the two different paths, to ensure that they could understand the characteristics of the task (e.g., the different paths). After the initial set of training trials, participants started the task. The sequence of trial events was equivalent to the experimental task. There was a 1000 ms fixation period, followed by the presentation of a food item and one of the two paths. They could observe the path on the screen for as long as they wanted and, as in the experimental task, they were provided with liking and wanting rating scales. Subsequently, participants had to press the left mouse button twice, as done in the experimental task, although here it had no relation with path navigation. Finally, a 1000 ms ITI blank screen appeared. Notice that, differently from the experimental task, participants were not requested to make or imagine any action.

2.4. Experimental Procedures

The study was performed at the Centre for Studies and Research in Cognitive Neuroscience (CsrCN), Cesena, Italy. Participants sat comfortably in a silent room, and their demographic data, including height and weight with self-report questionnaires, were collected in order to calculate their BMI. They were also asked to rate their hunger at the moment of the experiment and estimate their fasting level (hours). In addition, participants filled out two questionnaires assessing imagery abilities: The Vividness of Visual Imagery Questionnaire (VVIQ; [71]) and the Vividness of Movement Imagery Questionnaire (VMIQ [72]). The main purpose of these questionnaires was, on the one hand, to assess participants’ ability to imagine movements. On the other hand, they raised the vividness of the motor imagination, which was necessary for the experimental task. The VVIQ consists of 16 items, divided into four groups of four items each, in which participants are invited to vividly imagine specific scenes and situations, e.g., a sunrise evolving into a rainstorm. The VMIQ consists of 24 items asking participants to describe a simple movement, such as walking, or a complex movement, such as rope jumping. The VVIQ and VMIQ consist of items triggering the vivid imagination of movement, rated on a five-point scale. The order of questionnaire submission was counterbalanced across participants. After filling out the questionnaires, participants performed the task. At the end of the session, they were debriefed on the purpose of the study.

2.5. Statistical Analyses

The aim of this study was to investigate how the effort, associated with imagining moving along each path, influenced the value assigned to the food and drink items. The significance of the experimental factors was tested using 2 × 2 ANOVAs—one for the liking rating, one for the wanting rating and one for the reaction times as dependent variables—using group (experimental, control) as the between-participants independent variable and the path width (large, thin) as the within-participants independent variable. The alpha-level of all analyses was set at p < 0.05 using a univariate approach. Furthermore, scores related to the questionnaires were analysed. All statistical analyses were performed with SPSS Statistics (IBM Corp, released March 2013, IBM SPSS Statistics for Windows, version 22.0, Armonk, NY, USA) and STATISTICA (Dell Software, released September 2015, StatSoft STATISTICA for Windows, version 13.0, Round Rock, TX, USA).

3. Results

3.1. Liking

The ANOVA performed on the liking rating revealed a significant main effect of the path width (F(1, 38) = 22.461, p < 0.001, part.η2 = 0.4), a significant group X path width interaction (F(1, 38) = 5.958, p = 0.019, part.η2 = 0.1; Figure 3) and no significant group effect (p = 0.778). Newman–Keuls post-hoc analysis revealed a significant difference (p < 0.001) between the large path (mean = 4.74; sd = 0.89) and the thin path (mean = 4.15; sd = 0.88) in the experimental group, but not in the control group (p = 0.112; large path: mean = 4.62, sd = 0.95; thin path: mean = 4.43, sd = 1.02). These results indicate that the path widths significantly influenced the liking ratings only in the experimental group, with greater liking when items appeared at the end of the large path than the thin path.

3.2. Wanting

The ANOVA performed on the wanting rating revealed a significant main effect of the path width (F(1, 38) = 8.219 p = 0.006 part.η2 = 0.17), but no significant group X path width interaction (F(1, 38) = 0.259 p = 0.613) and no group effect (p = 0.281; Figure 4). These results indicate that the path widths influenced the wanting rating such that for the large path (mean = 3.44; sd = 1.02), participants showed higher wanting score compared to the thin path (mean = 3.22; sd = 1.04), regardless of the group.

3.3. Response Time

The ANOVA performed on the participants’ response times revealed a significant main effect of the path (F(1, 38) = 37.459, p < 0.001, part.η2 = 0.49), a significant main effect of the group (F(1, 38) = 34.360, p < 0.001, part.η2 = 0.47) and a significant group X path width interaction (F(1, 38) = 34.283, p < 0.001, part.η2 = 0.48; Figure 5). Newman–Keuls post-hoc analysis revealed a significant difference (p < 0.001) between the large path (mean = 3152.91 ms; sd = 2437.17 ms) and thin path (mean = 3994.39 ms; sd = 2665.35 ms) on the response times in the experimental group, but not in the control group (p = 0.852; large path trials: mean = 236.25 ms, sd = 140.93 ms; thin path trials: mean = 254.88 ms, sd = 166.54 ms). These findings indicate that the path width had a significant influence on response times only in the experimental group, with greater response times when imagining navigating the thin path than the large path.

3.4. Questionnaires and Correlations

The analysis of the questionnaires revealed that the experimental group’s VVIQ mean score was 58.4 (sd = 7.93), and control group’s VVIQ mean score was 63.9 (sd = 8.41) out of a maximum of 80. The experimental group’s VMIQ mean score was 84.7 (sd = 15.75), and control group’s VMIQ mean score was 89.3 (sd = 14.31) out of a maximum of 120 (Table 2). Two-tailed Pearson correlations were performed between the participants’ scores on the questionnaires and response times. The VVIQ scores negatively correlated with the response times (r = −0.363 (p = 0.021)), while no correlation resulted for the VMIQ scores (r = −0.17 (p = 0.283)). The significant negative correlation suggests that lower response times were associated with higher scores of vividness of visual imagery but not of motor imagery.

4. Discussion

Although different studies have investigated multiple factors involved in value computation [47,52,73,74,75,76], including risk [77,78], spatial distance [79,80,81], effort [9,10,11,12,82] and temporal discounting [15,16,17,18], little is known about how the cost of an action impacts on valuation processes. This study describes a new experimental protocol for studying and quantifying how such cost can affect valuation processes and, thus, behaviour. In particular, this research explores how the subjective value assigned to an item can be affected by manipulating the difficulty of an imaged action to reach it.
A previous study showed that the cost of real actions could affect how people assign value to the stimuli in their environment [23]; however, to the best of our knowledge, no study to date has tested the cost of imagined actions. To this end, first, participants familiarized with physically moving the mouse cursor inside each of two different paths. Second, they were asked to imagine dragging the mouse inside these paths in order to reach a food item. According to Fitts’ law [29], given the different path widths, participants’ imagined movements implied a variable difficulty in reaching the target; such difficulty was revealed by the discrepant timings needed to navigate each path. In addition, participants answered two questions via a seven-point Likert scale, which was designed to evaluate the liking and wanting of each food item. Participants took shorter time to imagine navigating the large path than the thin path. In addition, they liked more foods and drinks at the end of the large path than the thin path, but only if they were performing the motor imagery task. These results suggest that the cost (in terms of time) of the imagined action influences value ratings, with less value attributed to items that involve higher action cost. The rating differences were obtained by increasing or decreasing the path widths and, thus, manipulating the cost of the imagined action required to reach the item. The higher liking to the lower-difficulty and short-time items at the end of the large path reveals that an action’s cost is computed even before its execution [83,84,85]. Furthermore, these data show how the value of an item is influenced by the time required to reach it, even if the reaching is only imagined. In other words, presenting a food item with a large or thin path induced participants to anticipate the cost of the action, consequently affecting their evaluation. This is known as effort discounting [6].
The results reveal that an increased difficulty in mentally performing an action implied lower scores on the liking ratings for each item; the same expected result was not found across the wanting ratings. We explained that this discrepancy was caused by how the question may have been interpreted by participants. In line with this hypothesis, a recent systematic review of the human literature revealed a contradictory operationalization of the wanting and liking constructs [86]. Pool and colleagues [86] argued that expected pleasantness represents a major conceptual confound. In particular, expected pleasantness is an evaluation of how good or how bad a particular reward is going to be. This prediction involves the active reconstruction of past episodic memories of liking experiences with the current reward and the use of these episodic memories to anticipate or predict a future experience [87,88,89]. Whereas expected pleasantness drives cognitive desires, the interaction between the individual’s physiological state and the perception of the relevant reward-associated cue determines incentive salience or wanting [90]. Therefore, cognitive desires driven by memories of past liking experiences are not completely independent from liking, whereas wanting is underlain by a mechanism that is independent from the liking component [91,92,93]. Furthermore, the cognitive domain, including memory, is in constant complex interaction with other behavioural domains such as the negative valence domain, including depression and anxiety, which is under the control of endogenous neuropeptides, neurohormones and metabolites [94,95,96,97,98,99]. In addition, the functions of the domains are subject to the close influence of the adjacent biosystems [100,101,102,103,104].
In other words, it may be possible that our experimental manipulation had an effect on the expected pleasantness of eating or drinking the items, which is more related to self-reported measures of liking rather than wanting. In this regard, it has been shown in the human literature that self-reported rating scales seem to be the most reliable index of the hedonic experience [105,106]. Therefore, our results suggest that the cost of an imagined action directly influences the food item’s value computation, even though the action is not related to the hedonic features of such item. Specifically, the difficulty to reach an item is also included in the computation of value, in addition to the main sensory features that define that item. Crucially, in this study, the participants’ rating was affected because they were anticipating the specific difficulty of each action while performing the experimental trials. Our results support the hypothesis that imagining actions with variable difficulties automatically influences the item value.
Concerning response time, the results showed that the experimental group took more time to imagine making a movement along the thin path rather than the large path. These data revealed that simply imagining such movement influenced the participants’ response time, as well as their ratings. As previously described, we also found some correlations. The significant negative correlations between the VVIQ score and response time revealed that an increased participants’ vividness of imagination resulted in a reduced motor imagery time and, therefore, in reaching the food item faster.
These findings indicate that the value of the item is influenced by the cost of the action required to obtain it. In line with previous studies, items that can be obtained with minor difficulty have a higher value because they can be reached more easily [9,10,92,107], and this occurs even when performing the reaching of the object is not necessary [108]. According to these data, the value of the reward is inversely proportional to the amount of effort required to reach it. In general, this evidence confirms the main principle that governs effort discounting: a higher effort leads to a devaluation of the reward.
Our results could be interpreted according to an evolutionary perspective, which makes plausible the interaction between the computation processes underlying the value of an item and those codifying the difficulty to obtain it. Therefore, our evidence could be included along the theories of embodied cognition [109,110,111]. These theories emphasize the role of the body in cognition, arguing that the body’s condition influences cognitive states as they, at the same time, influence the body. According to these theories, participants’ knowledge of the world would be represented by neural structures which store sensory, motor and affective information. In agreement with this idea, the simple reaching of an object, or anticipating the difficulty to obtain it, activates such neural structures which are also involved in one’s own perceptual experience. In line with our results, the anticipation of an action’s difficulty could be considered as a simulation of the effort required for executing the action. The process governing the value computation could thus be influenced by the physical or cognitive effort required to reach it. Our data are further confirmed by, and in line with, several neurophysiological and neuroimaging data. These data show a possible representation of the subjective value not only in areas directly related to value computation and decision-making processes, such as ventromedial prefrontal cortex (vmPFC) [112,113,114,115,116,117,118,119], but also in other cortices related to motor preparation and action [51,52,120,121]. According to this evidence, the economic choice would be embodied in the motor processes of action selection [27,122].

5. Conclusions

In conclusion, our data show that the difficulty of an imagined action can influence valuation judgements. Moreover, our results support the hypothesis of the close relationship between motor and valuation processes. These links remain largely unexplored in current investigations, and they can be useful to better understand neurological or psychiatric conditions, such as schizophrenia, depression or frontal-apathy, which are characterized by an alteration of the ability to anticipate the effort necessary to obtain rewarding items in the environment [123,124,125,126,127,128]. Finally, future studies should also investigate the neural basis of this phenomenon; consequently, it would be very informative to submit a similar experimental paradigm to patients with focal brain lesions, for example, lesions affecting the medial orbitofrontal cortex (mOFC) or the anterior cingulate cortex.

Author Contributions

Conceptualization, M.S. and G.d.P.; methodology, M.S., G.d.P. and S.B.; software, M.S.; formal analysis, M.S., G.d.P. and S.B.; investigation, M.S., D.T. and S.B.; data collection, D.T.; writing—original draft preparation, M.S., G.d.P. and S.B.; writing—review and editing, M.S., D.T., F.S., G.d.P. and S.B.; visualization, S.B.; supervision G.d.P. and S.B.; project administration, G.d.P. and S.B.; funding acquisition, G.d.P., F.S. and S.B. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by grants from the RFO of the University of Bologna to G.d.P. Bial Foundation Grant for Scientific Research 2020/2021 [Grant Number 47/20] to F.S. and private funding by S.B.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of the University of Bologna (protocol code #14 on 8 February 2013).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study, see Section 2.1 for more details.

Data Availability Statement

The datasets used and analysed during the current study are available from the corresponding authors on reasonable request.

Acknowledgments

The authors thank Chiara Di Fazio and Claudio Nazzi for their help in searching the relevant literature, and Vincenza Iacono and Nicholas Menghi for recruiting participants and helping with data acquisition.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Walton, M.E.; Kennerley, S.W.; Bannerman, D.M.; Phillips, P.E.M.; Rushworth, M.F.S. Weighing up the Benefits of Work: Behavioral and Neural Analyses of Effort-Related Decision Making. Neural Netw. 2006, 19, 1302–1314. [Google Scholar] [CrossRef] [Green Version]
  2. Kolling, N.; Behrens, T.E.; Mars, R.B.; Rushworth, M.F. Neural Mechanisms of Foraging. Science 2012, 336, 95–98. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Shenhav, A.; Straccia, M.A.; Cohen, J.D.; Botvinick, M.M. Anterior Cingulate Engagement in a Foraging Context Reflects Choice Difficulty, Not Foraging Value. Nat. Neurosci. 2014, 17, 1249–1254. [Google Scholar] [CrossRef]
  4. Seinstra, M.S.; Sellitto, M.; Kalenscher, T. Rate Maximization and Hyperbolic Discounting in Human Experiential Intertemporal Decision Making. Behav. Ecol. 2018, 29, 193–203. [Google Scholar] [CrossRef]
  5. Rangel, A.; Camerer, C.; Montague, P.R. A Framework for Studying the Neurobiology of Value-Based Decision Making. Nat. Rev. Neurosci. 2008, 9, 545–556. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Botvinick, M.M.; Huffstetler, S.; McGuire, J.T. Effort Discounting in Human Nucleus Accumbens. Cogn. Affect. Behav. Neurosci. 2009, 9, 16–27. [Google Scholar] [CrossRef] [Green Version]
  7. Massar, S.A.A.; Lim, J.; Sasmita, K.; Chee, M.W.L. Rewards Boost Sustained Attention through Higher Effort: A Value-Based Decision Making Approach. Biol. Psychol. 2016, 120, 21–27. [Google Scholar] [CrossRef] [Green Version]
  8. Frömer, R.; Lin, H.; Wolf, C.K.D.; Inzlicht, M.; Shenhav, A. Expectations of Reward and Efficacy Guide Cognitive Control Allocation. Nat. Commun. 2021, 12, 1030. [Google Scholar] [CrossRef]
  9. Phillips, P.E.M.; Walton, M.E.; Jhou, T.C. Calculating Utility: Preclinical Evidence for Cost-Benefit Analysis by Mesolimbic Dopamine. Psychopharmacol 2007, 191, 483–495. [Google Scholar] [CrossRef]
  10. Rudebeck, P.H.; Walton, M.E.; Smyth, A.N.; Bannerman, D.M.; Rushworth, M.F.S. Separate Neural Pathways Process Different Decision Costs. Nat. Neurosci. 2006, 9, 1161–1168. [Google Scholar] [CrossRef] [PubMed]
  11. Prévost, C.; Pessiglione, M.; Metereau, E.; Clery-Melin, M.-L.; Dreher, J.-C. Separate Valuation Subsystems for Delay and Effort Decision Costs. J. Neurosci. 2010, 30, 14080–14090. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Garofalo, S.; Finotti, G.; Starita, F.; Bouchard, A.E.; Fecteau, S. Effort-Based Decision Making. The Sage Handbook of Cognitive and Systems Neuroscience II, 2022; in press. [Google Scholar]
  13. Apps, M.A.J.; Grima, L.L.; Manohar, S.; Husain, M. The Role of Cognitive Effort in Subjective Reward Devaluation and Risky Decision-Making. Sci. Rep. 2015, 5, 16880. [Google Scholar] [CrossRef]
  14. Vassena, E.; Deraeve, J.; Alexander, W.H. Predicting Motivation: Computational Models of PFC Can Explain Neural Coding of Motivation and Effort-Based Decision-Making in Health and Disease. J. Cogn. Neurosci. 2017, 29, 1633–1645. [Google Scholar] [CrossRef]
  15. Ainslie, G. Specious Reward: A Behavioral Theory of Impulsiveness and Impulse Control. Psychol. Bull. 1975, 82, 463–496. [Google Scholar] [CrossRef] [Green Version]
  16. Myerson, J.; Green, L. Discounting of Delayed Rewards: Models of Individual Choice. J. Exp. Anal. Behav. 1995, 64, 263–276. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Frederick, S.; Loewenstein, G.; O’Donoghue, T. Time Discounting and Preference: A Critical Review. J. Econ. Lit. 2002, 40, 351–401. [Google Scholar] [CrossRef]
  18. Sellitto, M.; Ciaramelli, E.; Pellegrino, G. The Neurobiology of Intertemporal Choice: Insight from Imaging and Lesion Studies. Rev. Neurosci. 2011, 22, 565–574. [Google Scholar] [CrossRef]
  19. Guleken, Z.; Sutcubasi, B.; Metin, B. The Cognitive Dynamics of Small-Sooner over Large-Later Preferences during Temporal Discounting Task through Event-Related Oscillations (EROs). Neuropsychologia 2021, 162, 108046. [Google Scholar] [CrossRef]
  20. Shadmehr, R.; Orban de Xivry, J.J.; Xu-Wilson, M.; Shih, T.-Y. Temporal Discounting of Reward and the Cost of Time in Motor Control. J. Neurosci. 2010, 30, 10507–10516. [Google Scholar] [CrossRef] [Green Version]
  21. Berret, B.; Jean, F. Why Don’t We Move Slower? The Value of Time in the Neural Control of Action. J. Neurosci. 2016, 36, 1056–1070. [Google Scholar] [CrossRef] [Green Version]
  22. Shadmehr, R.; Huang, H.J.; Ahmed, A.A. A Representation of Effort in Decision-Making and Motor Control. Curr. Biol. 2016, 26, 1929–1934. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Shadmehr, R. Control of Movements and Temporal Discounting of Reward. Curr. Opin. Neurobiol. 2010, 20, 726–730. [Google Scholar] [CrossRef]
  24. Choi, J.E.S.; Vaswani, P.A.; Shadmehr, R. Vigor of Movements and the Cost of Time in Decision Making. J. Neurosci. 2014, 34, 1212–1223. [Google Scholar] [CrossRef] [PubMed]
  25. Schultz, W. Dopamine Signals for Reward Value and Risk: Basic and Recent Data. Behav. Brain Funct. 2010, 6, 24. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Grogan, J.P.; Sandhu, T.R.; Hu, M.T.; Manohar, S.G. Dopamine Promotes Instrumental Motivation, but Reduces Reward-Related Vigour. Elife 2020, 9, e58321. [Google Scholar] [CrossRef]
  27. Sedaghat-Nejad, E.; Herzfeld, D.J.; Shadmehr, R. Reward Prediction Error Modulates Saccade Vigor. J. Neurosci. Off. J. Soc. Neurosci. 2019, 39, 5010–5017. [Google Scholar] [CrossRef] [Green Version]
  28. Shadmehr, R.; Reppert, T.R.; Summerside, E.M.; Yoon, T.; Ahmed, A.A. Movement Vigor as a Reflection of Subjective Economic Utility. Trends Neurosci. 2019, 42, 323–336. [Google Scholar] [CrossRef]
  29. Fitts, P.M. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. J. Exp. Psychol. 1954, 47, 381–391. [Google Scholar] [CrossRef] [Green Version]
  30. Jeannerod, M. The Representing Brain: Neural Correlates of Motor Intention and Imagery. Behav. Brain Sci. 1994, 17, 187–202. [Google Scholar] [CrossRef] [Green Version]
  31. Paszkiel, S.; Dobrakowski, P. Brain—Computer Technology-Based Training System in the Field of Motor Imagery. IET Sci. Meas. Technol. 2021, 14, 1014–1018. [Google Scholar] [CrossRef]
  32. Hwang, H.-J.; Kwon, K.; Im, C.-H. Neurofeedback-Based Motor Imagery Training for Brain-Computer Interface (BCI). J. Neurosci. Methods 2009, 179, 150–156. [Google Scholar] [CrossRef] [PubMed]
  33. Paszkiel, S.; Rojek, R.; Lei, N.; Castro, M. Review of Solutions for the Application of Example of Machine Learning Methods for Motor Imagery in Correlation with Brain-Computer Interfaces. Przegląd Elektrotechniczny 2021, 1, 113–118. [Google Scholar] [CrossRef]
  34. Mane, R.; Robinson, N.; Vinod, A.P.; Lee, S.-W.; Guan, C. A Multi-View CNN with Novel Variance Layer for Motor Imagery Brain Computer Interface. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada, 20–24 July 2020; pp. 2950–2953. [Google Scholar] [CrossRef]
  35. Pawus, D.; Paszkiel, S. The Application of Integration of EEG Signals for Authorial Classification Algorithms in Implementation for a Mobile Robot Control Using Movement Imagery—Pilot Study. Appl. Sci. 2022, 12, 2161. [Google Scholar] [CrossRef]
  36. Decety, J.; Jeannerod, M.; Prablanc, C. The Timing of Mentally Represented Actions. Behav. Brain Res. 1989, 34, 35–42. [Google Scholar] [CrossRef]
  37. Porro, C.A.; Francescato, M.P.; Cettolo, V.; Diamond, M.E.; Baraldi, P.; Zuiani, C.; Bazzocchi, M.; Di Prampero, P.E. Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study. J. Neurosci. 1996, 16, 7688–7698. [Google Scholar] [CrossRef] [Green Version]
  38. Decety, J. The Neurophysiological Basis of Motor Imagery. Behav. Brain Res. 1996, 77, 45–52. [Google Scholar] [CrossRef]
  39. Batula, A.M.; Mark, J.A.; Kim, Y.E.; Ayaz, H. Comparison of Brain Activation during Motor Imagery and Motor Movement Using FNIRS. Comput. Intell. Neurosci. 2017, 2017, 1–12. [Google Scholar] [CrossRef]
  40. Decety, J.; Jeannerod, M. Mentally Simulated Movements in Virtual Reality: Does Fitt’s Law Hold in Motor Imagery? Behav. Brain Res. 1995, 72, 127–134. [Google Scholar] [CrossRef]
  41. Sirigu, A.; Duhamel, J.; Cohen, L.; Pillon, B.; Dubois, B.; Agid, Y. The Mental Representation of Hand Movements after Parietal Cortex Damage. Science 1996, 273, 1564–1568. [Google Scholar] [CrossRef]
  42. Dahm, S.F.; Rieger, M. Cognitive Constraints on Motor Imagery. Psychol. Res. 2016, 80, 235–247. [Google Scholar] [CrossRef] [Green Version]
  43. Bertucco, M.; Cesari, P.; Latash, M.L. Fitts’ Law in Early Postural Adjustments. Neuroscience 2013, 231, 61–69. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Cisek, P.; Kalaska, J.F. Neural Mechanisms for Interacting with a World Full of Action Choices. Annu. Rev. Neurosci. 2010, 33, 269–298. [Google Scholar] [CrossRef] [Green Version]
  45. Huda, R.; Goard, M.J.; Pho, G.N.; Sur, M. Neural Mechanisms of Sensorimotor Transformation and Action Selection. Eur. J. Neurosci. 2019, 49, 1055–1060. [Google Scholar] [CrossRef]
  46. Borgomaneri, S.; Serio, G.; Battaglia, S. Please, Don’t Do It! Fifteen Years of Progress of Non-Invasive Brain Stimulation in Action Inhibition. Cortex 2020, 132, 404–422. [Google Scholar] [CrossRef] [PubMed]
  47. Battaglia, S.; Serio, G.; Scarpazza, C.; D’Ausilio, A.; Borgomaneri, S. Frozen in (e)Motion: How Reactive Motor Inhibition Is Influenced by the Emotional Content of Stimuli in Healthy and Psychiatric Populations. Behav. Res. Ther. 2021, 146, 103963. [Google Scholar] [CrossRef] [PubMed]
  48. O’Doherty, J.; Dayan, P.; Schultz, J.; Deichmann, R.; Friston, K.; Dolan, R.J. Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning. Science 2004, 304, 452–454. [Google Scholar] [CrossRef] [Green Version]
  49. Rich, E.L.; Wallis, J.D. Decoding Subjective Decisions from Orbitofrontal Cortex. Nat. Neurosci. 2016, 19, 973–980. [Google Scholar] [CrossRef] [Green Version]
  50. Ballesta, S.; Shi, W.; Conen, K.E.; Padoa-Schioppa, C. Values Encoded in Orbitofrontal Cortex Are Causally Related to Economic Choices. Nature 2020, 588, 450–453. [Google Scholar] [CrossRef]
  51. Gluth, S.; Rieskamp, J.; Büchel, C. Classic EEG Motor Potentials Track the Emergence of Value-Based Decisions. Neuroimage 2013, 79, 394–403. [Google Scholar] [CrossRef]
  52. Gold, J.I.; Shadlen, M.N. The Neural Basis of Decision Making. Annu. Rev. Neurosci. 2007, 30, 535–574. [Google Scholar] [CrossRef] [Green Version]
  53. Stuphorn, V.; Taylor, T.L.; Schall, J.D. Performance Monitoring by the Supplementary Eye Field. Nature 2000, 408, 857–860. [Google Scholar] [CrossRef] [PubMed]
  54. Ikeda, T.; Hikosaka, O. Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus. Neuron 2003, 39, 693–700. [Google Scholar] [CrossRef] [Green Version]
  55. Roesch, M.R.; Olson, C.R. Impact of Expected Reward on Neuronal Activity in Prefrontal Cortex, Frontal and Supplementary Eye Fields and Premotor Cortex. J. Neurophysiol. 2003, 90, 1766–1789. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Galaro, J.K.; Celnik, P.; Chib, V.S. Motor Cortex Excitability Reflects the Subjective Value of Reward and Mediates Its Effects on Incentive-Motivated Performance. J. Neurosci. 2019, 39, 1236–1248. [Google Scholar] [CrossRef] [Green Version]
  57. Donner, T.H.; Siegel, M.; Fries, P.; Engel, A.K. Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making. Curr. Biol. 2009, 19, 1581–1585. [Google Scholar] [CrossRef] [Green Version]
  58. Aitken, F.; Turner, G.; Kok, P. Prior Expectations of Motion Direction Modulate Early Sensory Processing. J. Neurosci. 2020, 40, 6389–6397. [Google Scholar] [CrossRef]
  59. Pastor-Bernier, A.; Cisek, P. Neural Correlates of Biased Competition in Premotor Cortex. J. Neurosci. 2011, 31, 7083–7088. [Google Scholar] [CrossRef] [Green Version]
  60. Gupta, N.; Aron, A.R. Urges for Food and Money Spill over into Motor System Excitability before Action Is Taken. Eur. J. Neurosci. 2011, 33, 183–188. [Google Scholar] [CrossRef] [Green Version]
  61. Borgomaneri, S.; Vitale, F.; Battaglia, S.; Avenanti, A. Early Right Motor Cortex Response to Happy and Fearful Facial Expressions: A TMS Motor-Evoked Potential Study. Brain Sci. 2021, 11, 1203. [Google Scholar] [CrossRef]
  62. Domínguez-Zamora, F.J.; Marigold, D.S. Motor Cost Affects the Decision of When to Shift Gaze for Guiding Movement. J. Neurophysiol. 2019, 122, 378–388. [Google Scholar] [CrossRef]
  63. Vourvopoulos, A.; Bermudez, S.; Liarokapis, F. EEG Correlates of Video Game Experience and User Profile in Motor-Imagery-Based Brain—Computer Interaction. Vis. Comput. 2017, 33, 533–546. [Google Scholar] [CrossRef]
  64. Klement, J.; Kubera, B.; Eggeling, J.; Rädel, C.; Wagner, C.; Park, S.Q.; Peters, A. Effects of Blood Glucose on Delay Discounting, Food Intake and Counterregulation in Lean and Obese Men. Psychoneuroendocrinology 2018, 89, 177–184. [Google Scholar] [CrossRef] [PubMed]
  65. Massar, S.A.A.; Pu, Z.; Chen, C.; Chee, M.W.L. Losses Motivate Cognitive Effort More Than Gains in Effort-Based Decision Making and Performance. Front. Hum. Neurosci. 2020, 14, 287. [Google Scholar] [CrossRef]
  66. Bowyer, C.; Brush, C.J.; Threadgill, H.; Harmon-Jones, E.; Treadway, M.; Patrick, C.J.; Hajcak, G. The Effort-Doors Task: Examining the Temporal Dynamics of Effort-Based Reward Processing Using ERPs. Neuroimage 2021, 228, 117656. [Google Scholar] [CrossRef]
  67. Smalley, K.; Knerr, N.; Kendrick, V.; Colliver, A.; Owen, O. Reassessment of Body Mass Indices. Am. J. Clin. Nutr. 1990, 52, 405–408. [Google Scholar] [CrossRef]
  68. Bakker, M.; De Lange, F.P.; Stevens, J.A.; Toni, I.; Bloem, B.R. Motor Imagery of Gait: A Quantitative Approach. Exp. Brain Res. 2007, 179, 497–504. [Google Scholar] [CrossRef] [PubMed]
  69. Finlayson, G.; King, N.; Blundell, J. The Role of Implicit Wanting in Relation to Explicit Liking and Wanting for Food: Implications for Appetite Control. Appetite 2008, 50, 120–127. [Google Scholar] [CrossRef]
  70. Born, J.M.; Lemmens, S.G.T.; Martens, M.J.I.; Goebel, R. Differences between Liking and Wanting Signals in the Human Brain and Relations with Cognitive Dietary Restraint and Body Mass Index. Am. J. Clin. Nutr. 2011, 94, 393–403. [Google Scholar] [CrossRef] [Green Version]
  71. Marks, D.F. Visual Imagery Differences in the Recall of Pictures. Br. J. Psychol. 1973, 64, 17–24. [Google Scholar] [CrossRef]
  72. Isaac, A.; Marks, D.F.; Russell, D.G. An Instrument for Assessing Imagery of Movement: The Vividness of Movement Imagery Questionnaire (VMIQ). J. Ment. Imag. 1986, 10, 23–30. [Google Scholar]
  73. Glimcher, P.W. Decisions, Decisions, Decisions: Choosing a Biological Science of Choice. Neuron 2002, 36, 323–332. [Google Scholar] [CrossRef] [Green Version]
  74. Kennerley, S.W.; Dahmubed, A.F.; Lara, A.H.; Wallis, J.D. Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables. J. Cogn. Neurosci. 2009, 21, 1162–1178. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  75. Garofalo, S.; Battaglia, S.; Di Pellegrino, G. Individual Differences in Working Memory Capacity and Cue-Guided Behavior in Humans. Sci. Rep. 2019, 9, 7327. [Google Scholar] [CrossRef]
  76. Garofalo, S.; Battaglia, S.; Starita, F.; di Pellegrino, G. Modulation of Cue-Guided Choices by Transcranial Direct Current Stimulation. Cortex 2021, 137, 124–137. [Google Scholar] [CrossRef] [PubMed]
  77. Kahneman, D.; Tversky, A.; Kahneman, B.Y.D.; Tversky, A. Prospect Theory: An Analysis of Decision under Risk Linked. Econometrica 1979, 47, 263–292. [Google Scholar] [CrossRef] [Green Version]
  78. Rigoli, F.; Martinelli, C.; Shergill, S.S. The Role of Expecting Feedback during Decision-Making under Risk. Neuroimage 2019, 202, 116079. [Google Scholar] [CrossRef] [PubMed]
  79. Mühlhoff, N.; Stevens, J.R.; Reader, S.M. Spatial Discounting of Food and Social Rewards in Guppies (Poecilia Reticulata). Front. Psychol. 2011, 2, 68. [Google Scholar] [CrossRef] [Green Version]
  80. Stevens, J.R.; Rosati, A.G.; Ross, K.R.; Hauser, M.D. Will Travel for Food: Spatial Discounting in Two New World Monkeys. Curr. Biol. 2005, 15, 1855–1860. [Google Scholar] [CrossRef] [Green Version]
  81. Dezfouli, A.; Balleine, B.W. Learning the Structure of the World: The Adaptive Nature of State-Space and Action Representations in Multi-Stage Decision-Making. PLoS Comput. Biol. 2019, 15, e1007334. [Google Scholar] [CrossRef] [Green Version]
  82. Salamone, J.D.; Correa, M.; Ferrigno, S.; Yang, J.-H.; Rotolo, R.A.; Presby, R.E. The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation. Pharmacol. Rev. 2018, 70, 747–762. [Google Scholar] [CrossRef] [Green Version]
  83. Cos, I.; Bélanger, N.; Cisek, P. The Influence of Predicted Arm Biomechanics on Decision Making. J. Neurophysiol. 2011, 105, 3022–3033. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  84. Cos, I.; Duque, J.; Cisek, P. Rapid Prediction of Biomechanical Costs during Action Decisions. J. Neurophysiol. 2014, 112, 1256–1266. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  85. Pierrieau, E.; Lepage, J.-F.; Bernier, P.-M. Action Costs Rapidly and Automatically Interfere with Reward-Based Decision-Making in a Reaching Task. Eneuro 2021, 8, ENEURO.0247-21.2021. [Google Scholar] [CrossRef] [PubMed]
  86. Pool, E.; Sennwald, V.; Delplanque, S.; Brosch, T.; Sander, D. Measuring Wanting and Liking from Animals to Humans: A Systematic Review. Neurosci. Biobehav. Rev. 2016, 63, 124–142. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  87. Dickinson, A.; Balleine, B. Motivational Control of Goal-Directed Action. Anim. Learn. Behav. 1994, 22, 1–18. [Google Scholar] [CrossRef]
  88. Kahneman, D. Choices, Values, and Frames. Am. Psychol. 1984, 39, 341–350. [Google Scholar] [CrossRef]
  89. Di Gregorio, F.; Ernst, B.; Steinhauser, M. Differential effects of instructed and objective feedback reliability on feedback-related brain activity. Psychophysiology 2019, 56, e13399. [Google Scholar] [CrossRef]
  90. Berridge, K.C.; O’Doherty, J.P. From Experienced Utility to Decision Utility. Neuroeconomics 2013, 335–354. [Google Scholar] [CrossRef]
  91. Berridge, K.C.; Robinson, T.E. Parsing Reward. Trends Neurosci. 2003, 26, 507–513. [Google Scholar] [CrossRef]
  92. Klein-Flügge, M.C.; Kennerley, S.W.; Friston, K.; Bestmann, S. Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-Off. J. Neurosci. 2016, 36, 10002–10015. [Google Scholar] [CrossRef] [Green Version]
  93. Finlayson, G.; King, N.; Blundell, J.E. Is It Possible to Dissociate ‘Liking’ and ‘Wanting’ for Foods in Humans? A Novel Experimental Procedure. Physiol. Behav. 2007, 90, 36–42. [Google Scholar] [CrossRef] [PubMed]
  94. Telegdy, G.; Adamik, A.; Tanaka, M.; Schally, A.V. Effects of the LHRH Antagonist Cetrorelix on Affective and Cognitive Functions in Rats. Regul. Pept. 2010, 159, 142–147. [Google Scholar] [CrossRef] [PubMed]
  95. Telegdy, G.; Tanaka, M.; Schally, A.V. Effects of the LHRH Antagonist Cetrorelix on the Brain Function in Mice. Neuropeptides 2009, 43, 229–234. [Google Scholar] [CrossRef] [PubMed]
  96. Martos, D.; Tuka, B.; Tanaka, M.; Vécsei, L.; Telegdy, G. Memory Enhancement with Kynurenic Acid and Its Mechanisms in Neurotransmission. Biomedicines 2022, 10, 849. [Google Scholar] [CrossRef] [PubMed]
  97. Tanaka, M.; Csabafi, K.; Telegdy, G. Neurotransmissions of Antidepressant-like Effects of Kisspeptin-13. Regul. Pept. 2013, 180, 1–4. [Google Scholar] [CrossRef] [Green Version]
  98. Tanaka, M.; Vécsei, L. Monitoring the Kynurenine System: Concentrations, Ratios or What Else? Adv. Clin. Exp. Med. 2021, 30, 775–778. [Google Scholar] [CrossRef]
  99. Telegdy, G.; Tanaka, M.; Schally, A.V. Effects of the Growth Hormone-Releasing Hormone (GH-RH) Antagonist on Brain Functions in Mice. Behav. Brain Res. 2011, 224, 155–158. [Google Scholar] [CrossRef]
  100. Tanaka, M.; Vécsei, L. Editorial of Special Issue “Crosstalk between Depression, Anxiety, and Dementia: Comorbidity in Behavioral Neurology and Neuropsychiatry”. Biomedicines 2021, 9, 517. [Google Scholar] [CrossRef]
  101. Spekker, E.; Tanaka, M.; Szabó, Á.; Vécsei, L. Neurogenic Inflammation: The Participant in Migraine and Recent Advancements in Translational Research. Biomedicines 2021, 10, 76. [Google Scholar] [CrossRef]
  102. Tanaka, M.; Török, N.; Vécsei, L. Are 5-HT(1) Receptor Agonists Effective Anti-Migraine Drugs? Expert Opin. Pharmacother. 2021, 22, 1221–1225. [Google Scholar] [CrossRef]
  103. Tanaka, M.; Bohár, Z.; Vécsei, L. Are Kynurenines Accomplices or Principal Villains in Dementia? Maintenance of Kynurenine Metabolism. Molecules 2020, 25, 564. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  104. Tanaka, M.; Tóth, F.; Polyák, H.; Szabó, Á.; Mándi, Y.; Vécsei, L. Immune Influencers in Action: Metabolites and Enzymes of the Tryptophan-Kynurenine Metabolic Pathway. Biomedicines 2021, 9, 734. [Google Scholar] [CrossRef] [PubMed]
  105. Bartoshuk, L. The Measurement of Pleasure and Pain. Perspect. Psychol. Sci. 2014, 9, 91–93. [Google Scholar] [CrossRef] [PubMed]
  106. Pichon, A.M.; Coppin, G.; Cayeux, I.; Porcherot, C.; Sander, D.; Delplanque, S. Sensitivity of Physiological Emotional Measures to Odors Depends on the Product and the Pleasantness Ranges Used. Front. Psychol. 2015, 6, 1821. [Google Scholar] [CrossRef]
  107. Kivetz, R. The Effects of Effort and Intrinsic Motivation on Risky Choice. Mark. Sci. 2003, 22, 477–502. [Google Scholar] [CrossRef] [Green Version]
  108. Bushong, B.; King, L.M.; Camerer, C.F.; Rangel, A. Pavlovian Processes in Consumer Choice: The Physical Presence of a Good Increases Willingness-to-Pay. Am. Econ. Rev. 2010, 100, 1556–1571. [Google Scholar] [CrossRef] [Green Version]
  109. Barsalou, L.W. Perceptual Symbol Systems. Behav. Brain Sci. 1999, 22, 577–660. [Google Scholar] [CrossRef]
  110. Barsalou, L.W. Simulation, Situated Conceptualization, and Prediction. Philos. Trans. R. Soc. B Biol. Sci. 2009, 364, 1281–1289. [Google Scholar] [CrossRef]
  111. Niedenthal, P.M.; Barsalou, L.W.; Winkielman, P.; Krauth-Gruber, S.; Ric, F. Embodiment in Attitudes, Social Perception, and Emotion. Personal. Soc. Psychol. Rev. 2005, 9, 184–211. [Google Scholar] [CrossRef]
  112. Padoa-Schioppa, C. Neurobiology of Economic Choice: A Good-Based Model. Annu. Rev. Neurosci. 2011, 34, 333–359. [Google Scholar] [CrossRef] [Green Version]
  113. Plassmann, H.; O’Doherty, J.; Rangel, A. Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions. J. Neurosci. 2007, 27, 9984–9988. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  114. Wallis, J.D. Orbitofrontal Cortex and Its Contribution to Decision-Making. Annu. Rev. Neurosci. 2007, 30, 31–56. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  115. Battaglia, S.; Garofalo, S.; di Pellegrino, G.; Starita, F. Revaluing the Role of VmPFC in the Acquisition of Pavlovian Threat Conditioning in Humans. J. Neurosci. 2020, 40, 8491–8500. [Google Scholar] [CrossRef]
  116. Battaglia, S.; Harrison, B.J.; Fullana, M.A. Does the Human Ventromedial Prefrontal Cortex Support Fear Learning, Fear Extinction or Both? A Commentary on Subregional Contributions. Mol. Psychiatry 2021, 1–3. [Google Scholar] [CrossRef]
  117. Battaglia, S. Neurobiological Advances of Learned Fear in Humans. Adv. Clin. Exp. Med. 2022, 31, 217–221. [Google Scholar] [CrossRef] [PubMed]
  118. Maier, M.E.; Di Gregorio, F.; Muricchio, T.; Di Pellegrino, G. Impaired rapid error monitoring but intact error signaling following rostral anterior cingulate cortex lesions in humans. Front. Hum. Neurosci. 2015, 9, 339. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  119. Battaglia, S.; Thayer, J.F. Functional interplay between central and autonomic nervous systems in human fear conditioning. Trends Neurosci. 2022; in press. [Google Scholar]
  120. Platt, M.L.; Glimcher, P.W. Neural Correlates of Decision Variables in Parietal Cortex. Nature 1999, 400, 233–238. [Google Scholar] [CrossRef]
  121. Bari, B.A.; Cohen, J.Y. Dynamic Decision Making and Value Computations in Medial Frontal Cortex. In What Does Medial Frontal Cortex Signal During Behavior? Insights from Behavioral Neurophysiology; Brockett, A.T., Amarante, L.M., Laubach, M., Roesch, M.R., Eds.; Academic Press: Cambridge, MA, USA, 2021; Volume 158, pp. 83–113. [Google Scholar] [CrossRef]
  122. Glimcher, P.W.; Dorris, M.C.; Bayer, H.M. Physiological Utility Theory and the Neuroeconomics of Choice. Games Econ. Behav. 2005, 52, 213–256. [Google Scholar] [CrossRef] [Green Version]
  123. Denk, F.; Walton, M.E.; Jennings, K.A.; Sharp, T.; Rushworth, M.F.S.; Bannerman, D.M. Differential Involvement of Serotonin and Dopamine Systems in Cost-Benefit Decisions about Delay or Effort. Psychopharmacology 2005, 179, 587–596. [Google Scholar] [CrossRef]
  124. Floresco, S.B.; Ghods-Sharifi, S. Amygdala-Prefrontal Cortical Circuitry Regulates Effort-Based Decision Making. Cereb. Cortex 2007, 17, 251–260. [Google Scholar] [CrossRef]
  125. Salamone, J.D.; Correa, M.; Mingote, S.; Weber, S.M. Nucleus Accumbens Dopamine and the Regulation of Effort in Food-Seeking Behavior: Implications for Studies of Natural Motivation, Psychiatry, and Drug Abuse. J. Pharmacol. Exp. Ther. 2003, 305, 1–8. [Google Scholar] [CrossRef] [PubMed]
  126. Walton, M.E.; Devlin, J.T.; Rushworth, M.F.S. Interactions between Decision Making and Performance Monitoring within Prefrontal Cortex. Nat. Neurosci. 2004, 7, 1259–1265. [Google Scholar] [CrossRef] [PubMed]
  127. Trajkovic, J.; Di Gregorio, F.; Ferri, F.; Marzi, C.; Diciotti, S.; Romei, V. Resting State Alpha Oscillatory Activity Is a Valid and Reliable Marker of Schizotypy. Sci. Rep. 2021, 11, 10379. [Google Scholar] [CrossRef]
  128. Marciniak, M.A.; Shanahan, L.; Binder, H.; Kalisch, R.; Kleim, B. Positive Prospective Mental Imagery Characteristics in Young Adults and Their Associations with Depressive Symptoms. PsyArXiv, 2022; pre-print. [Google Scholar] [CrossRef]
Figure 1. Examples of visual stimuli and paths. Shown brands for demonstrative purpose only.
Figure 1. Examples of visual stimuli and paths. Shown brands for demonstrative purpose only.
Brainsci 12 00582 g001
Figure 2. Schematic representation of the experimental trial sequences. Participants had to imagine, in a first-person perspective, dragging the mouse along the path, from the starting point to the food item picture in the upper rectangle at the end of the path. They had to press the left mouse button with the index finger of the right hand to signal the start of their imagined movement, and the button had to be pressed again to flag the imagined reaching of the food item. Trials were separated by a 1000 ms inter-trial interval (ITI) with a blank screen.
Figure 2. Schematic representation of the experimental trial sequences. Participants had to imagine, in a first-person perspective, dragging the mouse along the path, from the starting point to the food item picture in the upper rectangle at the end of the path. They had to press the left mouse button with the index finger of the right hand to signal the start of their imagined movement, and the button had to be pressed again to flag the imagined reaching of the food item. Trials were separated by a 1000 ms inter-trial interval (ITI) with a blank screen.
Brainsci 12 00582 g002
Figure 3. Analysis of the liking scores illustrates that the liking ratings were influenced by the path widths only in the experimental group (p < 0.001). Vertical lines indicate the standard error of mean (SEM), * p < 0.05.
Figure 3. Analysis of the liking scores illustrates that the liking ratings were influenced by the path widths only in the experimental group (p < 0.001). Vertical lines indicate the standard error of mean (SEM), * p < 0.05.
Brainsci 12 00582 g003
Figure 4. Analysis of the wanting scores illustrates that the wanting ratings were not differently influenced by the path widths in both groups. Vertical lines indicate the standard error of mean (SEM).
Figure 4. Analysis of the wanting scores illustrates that the wanting ratings were not differently influenced by the path widths in both groups. Vertical lines indicate the standard error of mean (SEM).
Brainsci 12 00582 g004
Figure 5. Analysis of the motor imagery time illustrates that the path width had an influence on the response time only in the experimental group. Vertical lines indicate the standard error of mean (SEM), * p < 0.001.
Figure 5. Analysis of the motor imagery time illustrates that the path width had an influence on the response time only in the experimental group. Vertical lines indicate the standard error of mean (SEM), * p < 0.001.
Brainsci 12 00582 g005
Table 1. Participants’ demographic data.
Table 1. Participants’ demographic data.
GroupnAgeEducation HungerFastingBMI
Experimental2023.35 (2.16)16.8 (1.85)2.25 (1.45)2.08 (1.34)21.49 (2.49)
Control2023.85 (3.36)16.95 (2.46)2.75 (1.16)2.18 (1.32)21.52 (3.16)
n is the number of participants. Age and Education are expressed in years. Hunger is expressed on a five-point scale. Fasting is expressed in hours. Body Mass Index (BMI) is expressed in kg/m2. Mean is represented out of the brackets, while the standard deviation is within them.
Table 2. Participants’ questionnaire scoring.
Table 2. Participants’ questionnaire scoring.
VVIQVMIQ
GroupExperimentalControlExperimentalControl
Mean58.463.984.789.3
SD7.938.4115.7514.31
The VVIQ score out of a maximum of 80, and the VMIQ score out of a maximum of 120.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sellitto, M.; Terenzi, D.; Starita, F.; di Pellegrino, G.; Battaglia, S. The Cost of Imagined Actions in a Reward-Valuation Task. Brain Sci. 2022, 12, 582. https://doi.org/10.3390/brainsci12050582

AMA Style

Sellitto M, Terenzi D, Starita F, di Pellegrino G, Battaglia S. The Cost of Imagined Actions in a Reward-Valuation Task. Brain Sciences. 2022; 12(5):582. https://doi.org/10.3390/brainsci12050582

Chicago/Turabian Style

Sellitto, Manuela, Damiano Terenzi, Francesca Starita, Giuseppe di Pellegrino, and Simone Battaglia. 2022. "The Cost of Imagined Actions in a Reward-Valuation Task" Brain Sciences 12, no. 5: 582. https://doi.org/10.3390/brainsci12050582

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop