Next Article in Journal
A Snapshot of Potentially Inappropriate Prescriptions upon Pediatric Discharge in Oman
Next Article in Special Issue
Podcasts as a Method to Deliver Education on Stigma Surrounding Opioid Use Disorder
Previous Article in Journal
Development and Implementation of a Healthcare Database Analysis Course for Graduate Students
Previous Article in Special Issue
Discordance in Addressing Opioid Crisis in Rural Communities: Patient and Provider Perspectives
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Pharmacy
Volume 10
Issue 5
10.3390/pharmacy10050120
pharmacy-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Need for Benzodiazepine Deprescribing in the COVID-19 Pandemic: A Cohort Study

by
Iva Bužančić
1,2,*,
Tajana Iva Pejaković
2 and
Maja Ortner Hadžiabdić
1
1
Faculty of Pharmacy and Biochemistry, University of Zagreb, A. Kovačića 1, 10 000 Zagreb, Croatia
2
City Pharmacies Zagreb, Kralja Držislava 6, 10 000 Zagreb, Croatia
*
Author to whom correspondence should be addressed.
Pharmacy 2022, 10(5), 120; https://doi.org/10.3390/pharmacy10050120
Submission received: 13 August 2022 / Revised: 17 September 2022 / Accepted: 22 September 2022 / Published: 23 September 2022
(This article belongs to the Special Issue Addiction and Mental Health in Pharmacy)
Versions Notes

Abstract

:
The COVID-19 pandemic has had a negative impact on patients’ mental health. The aim of this study was to explore whether the pandemic influenced the use and prescription of benzodiazepines and increased the need for community pharmacist involvement in counselling on deprescribing. Electronic prescription-related data from one pharmacy in Croatia were retrospectively collected for the COVID-19 period (April 2020 to March 2021) and compared with pre-COVID-19 (April 2019 to March 2020) data. Data were collected for patients diagnosed with anxiety disorders who filled out more than one prescription for benzodiazepines, and included age, sex, number of medicines, benzodiazepines, and comorbidities. A total of 1290 benzodiazepine users were identified; of these, 32.87% started using benzodiazepines during the COVID-19 period, while 35.2% continued with benzodiazepine use. More than half of all benzodiazepine users were identified as potential deprescribing candidates (dispensed more than three prescriptions). Women, older patients, multimorbid individuals, and patients with polypharmacy were more likely to use benzodiazepines for a prolonged period. The results show a negative trend of benzodiazepine usage among community-dwelling patients during the pandemic. Community pharmacists can identify potential candidates for deprescribing and initiate a process that ensures more rational use of benzodiazepines and increases the safety of treatment.

1. Introduction

Frontline health workers, such as community pharmacists, have been important during the current pandemic, ensuring a continuing provision of pharmaceutical care. In many countries, pharmacists took over additional tasks to help fight the pandemic, such as public education for the prevention and management of infections, vaccinations, medicine deliveries to patients in self-isolation, and tele-pharmacy services [1,2,3]. Inaccessibility of other healthcare providers and their services additionally highlighted the importance of community pharmacists and their role in ensuring safe use of medicines [4,5]. The COVID-19 pandemic has had a major negative impact on the mental health problems of the general public, including increased depression and anxiety, which could lead to increased prescribing and use of benzodiazepines [6].
Benzodiazepines and Z-drugs are extensively prescribed in the community setting throughout Europe [7,8,9]. In 2020, two benzodiazepines, diazepam and alprazolam, were among the ten most commonly used medications in the community setting, presented as defined daily doses per 1000 inhabitants per day in Croatia [10]. Even though benzodiazepines are used for a number of off-label purposes, such as vertigo, hypertension, angina pectoris or chemotherapy-induced nausea and vomiting, they are most commonly prescribed for the treatment of psychiatric health disorders, including anxiety and sleep disorders [11]. It is recommended for benzodiazepines to be used for a short period of no longer than 12 weeks, including the necessary time for careful discontinuation [12,13]. Prolonged use of benzodiazepines is linked to unfavourable outcomes, including falls, tolerance, dependence, memory impairment, and psychomotor retardation [14,15]. This is particularly evident in sensitive patient groups, such as the elderly [16].
To increase patient safety and improve outcomes, deprescribing should be suggested to patients with prolonged benzodiazepine use. Deprescribing is the planned and supervised process of dose reduction or stopping of medication that might be causing harm or no longer be of benefit. It can be described as the process of withdrawal of an inappropriate medication, supervised by a health care professional with the goal of managing polypharmacy and improving outcomes [17]. Research shows deprescribing of benzodiazepines can be successfully provided in community pharmacies thorough patient education, cognitive–behavioural therapy, or healthcare provider-led tapering [18,19,20,21]. Community pharmacist-led deprescribing of benzodiazepines has been proven to be cost-effective and to lead to increasing quality of life and decreasing harm in the elderly [22].
The aim of this study was to investigate whether the COVID-19 pandemic influenced the use and prescribing of benzodiazepines and increased the need for deprescribing.

2. Materials and Methods

Ethics Committee of City Pharmacies Zagreb (1-8EP/2021 granted on 25 May 2021) granted approval for this study. The principles of the Helsinki Declaration were followed during the research.

2.1. Data Collection

In Croatia, healthcare data are collected and stored in the Central Health Information System of the Republic of Croatia (CEZIH). CEZIH is the central system for storing health data and information for their standardized processing at the primary, secondary and tertiary levels of health care and is part of the health information infrastructure of Croatia. Healthcare providers connect to CEZIH through their practice’s software, using healthcare providers’ identification cards. When it comes to primary healthcare, physician prescribe electronic prescription (e-prescription) which are sent to CEZIH where community pharmacists can access them via pharmacy dispensing software.
Each e-prescription data point accessible to the dispensing pharmacist contains patient, insurance, medication, and prescriber information. Patient information includes unique personal healthcare identification number (PHIN), name, date of birth, sex, and contact information. Medication information includes name of medication, ATC code, dose, dosage and dispensing specifics, ICD code and name of disease. Prescriber information includes name, address, and contact information of practicing primary care physician (additional information of specialist physician is also available on prescription if necessary). Using the PHIN number pharmacists can access patients medical records and data on comorbidities and prescribed medications.
The e-prescription-related data of one urban community pharmacy located in Zagreb, Croatia, were collected for the early period of COVID-19 (April 2020 to March 2021) and compared with pre-COVID-19 (April 2019 to March 2020) data. Data were collected from CEZIH via pharmacy dispensing software. One researcher electronically extracted data for the pre-COVID-19 period, and one for the COVID-19 period. During data extraction researchers used a pre-agreed protocol. Through pharmacy dispensing software researchers could select specific information to be extracted in form of pivot data tables. For each month within the time period, data were arranged in ascending manner by date of dispensing, PHIN, ICD code for benzodiazepine prescribing and medication information. Using PHIN researchers collected other data such as age, sex, other comorbidities and medications. Data were collected for patients diagnosed with mental and behavioural disorders that are indications for benzodiazepine use, including ICD-10: F32.0, F40.0, F41.0, F41.1, F41.2, F41.9, F43.0, F43.2, and F48.0.
Data available for final analysis included PHIN, age, sex, number of medicines, type and number of dispensed benzodiazepines, and ICD codes for dispensed benzodiazepines and other comorbidities. The prescription data of patients were checked for COVID-19 diagnosis using ICD-10 codes (U07.1, U07.2, and U08.9). Using the PHIN, the two researchers cross-checked for overlapping patients. Unique patients were marked, ensuring no patients were double counted.

2.2. Variable Selection

Patients were included if they filled out one or more prescriptions for benzodiazepines and/or hypnotics in either of the periods defined.
Information was collected for benzodiazepines and one hypnotic with marketing authorization in Croatia (zolpidem, alprazolam, bromazepam, clonazepam, diazepam, lorazepam, nitrazepam, and oxazepam). Zolpidem was included as it is often prescribed to patients with anxiety disorders, for short-term insomnia relief, and has pharmacodynamic characteristics similar to those of benzodiazepines. For dispensed benzodiazepines, data on the number of prescriptions and dispensed tablets were collected.
Data on the type and dose of benzodiazepines were converted to those of diazepam using conversion tables [23,24,25]. For patients using two or more different benzodiazepines, the equivalent diazepam dose was calculated by summing the converted dose for each benzodiazepine and multiplying by the number of prescriptions for the respective benzodiazepine. The total dose of diazepam equivalent was calculated by multiplying the equivalent dose by the number of prescriptions and the number of dispensed tablets (i.e., for patients dispensed 2 prescriptions for oxazepam 10 mg, each containing 30 tablets, the total dose of dispensed diazepam equivalent was 2 × 30 × 5 mg = 300 mg).
Data were analysed based on pharmacokinetic characteristics of benzodiazepines, such as the half-life; short-acting benzodiazepines include alprazolam, bromazepam, lorazepam, nitrazepam, oxazepam, zolpidem, and combinations of two short-acting benzodiazepines, whereas long-acting benzodiazepines include clonazepam and diazepam [26].

2.3. Identification of Potential Deprescribing Candidates

Patients were identified as potential candidates for benzodiazepine deprescribing if they had used benzodiazepines for longer than 12 weeks (having had more than three consecutive prescriptions dispensed) based on information available in the summary of the benzodiazepine product characteristics and deprescribing guidelines [12,23,24]. This study did not plan or involve any intervention to patients or physicians.

2.4. Statistical Analysis

The collected data were analysed using IBM SPSS Statistics for Windows, Version 20.0. (IBM Corp., Armonk, NY, USA). Depending on the type of variable and normality of the distribution, frequencies, percentages, means with standard deviations, medians, and interquartile ranges were used to describe the data. A chi-squared test was used to analyse differences in frequencies between the groups and cohorts. Groups for gender (male or female), age (younger or older than 65 years), and number of medicines or comorbidities (<5 or ≥5) were formed. Data inspection indicated that patients should be placed into three cohorts: pre-COVID-19, COVID-19, and continuous use (overlapping sample, patients with use throughout both time periods). One-way ANOVA and a post hoc test were used to examine differences between cohorts. All tests were two-tailed, and statistical significance was set at p < 0.05.
The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement checklist and guidelines were followed in conducting and reporting this study [25] (Supplementary file S1).

3. Results

3.1. Participants

In this study, 1290 patients, who filled at least one benzodiazepine prescription during the study period (April 2019 to March 2021), were identified. A total of 412 patients (31.94%) were prescribed benzodiazepines only in 2019 (pre-COVID-19 cohort), 454 patients (35.19%) had continued using benzodiazepines during the COVID-19 period (continuous use cohort) and 424 (32.87%) new patients were identified in the COVID-19 cohort. Patient characteristics of the whole sample are summarized in Table 1.
Almost half of all patients used short-acting benzodiazepines (47.60%), 41.32% used long-acting benzodiazepines, and 11.08% used a combination of long- and short-acting benzodiazepines. The most common doses of prescribed benzodiazepines were 5 mg of diazepam (21.39% of prescriptions), 0.5 mg of alprazolam (11.47%), 2 mg of diazepam (11.39%), 0.25 mg of alprazolam (8.92%), and 15 mg of oxazepam (7.21%). The most used combinations were diazepam with alprazolam (49 patients), diazepam with zolpidem (30 patients), two diazepams (24 patients), diazepam with oxazepam (23 patients), and alprazolam with zolpidem (22 patients).
A reduction in dose and number of prescribed benzodiazepines was observed in only two patients from the COVID-19 cohort. Patients were prescribed a mean of 8.6 ± 6.62 mg of diazepam equivalent, and 10% of all patients were prescribed more than 15 mg diazepam equivalent. Slightly more than one-fifth of patients (n = 285; 22.09%) were prescribed other medications, such as antidepressants, antipsychotics, or anticonvulsives, for the same indications for which benzodiazepines were prescribed. In 18 patients, discontinuation of antidepressants and restarting of benzodiazepines was observed.
Patients younger than 65 years were more likely to use higher diazepam equivalent doses (11.54% vs. 8.16%; χ2(1) = 4.05; p = 0.044) and were more likely to use other drugs acting on the nervous system for the same indications (32.62% vs. 9.52%; χ2(1) = 99.18; p < 0.0001).

3.2. Cohort Comparisons and Sub-Cohort Analysis

Statistically significant difference was found between cohorts for number of benzodiazepine prescriptions (Welch’s F(2, 776.78) = 95.30, p < 0.0005), diazepam dose equivalent of single prescription (Welch’s F(2, 742.84) = 65.44, p < 0.0005), and total number of milligrams of diazepam equivalent (Welch’s F(2, 803.19) = 40.85, p < 0.0005). Data on Games–Howell post hoc test can be found in Table 2.
Patients in the COVID-19 cohort were more likely to use two or more benzodiazepines (24.76% vs. 17.55%; χ2(1) = 9.28; p = 0.003) and were more likely to be prescribed antidepressants for the treatment of anxiety disorders (27.83% vs. 19.28%; χ2(1) = 12.08; p = 0.001) than patients in the pre-COVID-19 cohort.
Sub analysis, using a paired samples t-test, of data on patients from the continuous use cohort shows that there was no change in the consumption of benzodiazepines between the two observed periods. Total number of milligrams of diazepam equivalent did not change significantly between the two time periods (1433.74 ± 2480.65 mg vs. 1275.94 ± 2675.99 mg; t(454) = 1.249; p = 0.212).
Patients with confirmed COVID-19 disease (n = 49) were prescribed and dispensed more benzodiazepine prescriptions (6.41 ± 9.19 vs. 4.26 ± 4.33; t(1288) = −3.20; p = 0.001) and used a higher total number of milligrams of diazepam equivalent (56.45 ± 92.76 vs. 36.14 ± 51.93 mg; t(1288) = −2.58; p = 0.010) than those without confirmed COVID-19. The majority used benzodiazepines prior to COVID-19 diagnosis (n = 34), with nine patients increasing the benzodiazepine dose or adding a new benzodiazepine after the diagnosis, whereas 15 patients started using benzodiazepines after the diagnosis.

3.3. Identifying Candidates for Potential Deprescribing of Benzodiazepines

More than half of all patients (n = 718, 55.66%) were dispensed three or more benzodiazepine prescriptions throughout the observed period of one year, with women, multimorbid patients, patients with polypharmacy (>5 chronic medications in addition to benzodiazepines), patients 65 years and older, and those using two or more different benzodiazepines being more likely to receive more prescriptions (Table 3). When it comes to different cohorts, 43.44% of patients in the pre-COVID-19 cohort, 40.09% of patients in the COVID-cohort, and 81.28% of patients in the continuous use cohort were dispensed three or more benzodiazepine prescriptions.

4. Discussion

The extended use of benzodiazepines has been a major problem and has become even more significant during the pandemic, both in Croatia and around the world [10,26]. The results of this study indicate that the COVID-19 pandemic may have led to a worsening in irrational use of benzodiazepines; we identified a higher use of benzodiazepines in patients from the COVID-19 cohort and a higher use in patients with confirmed diagnosis of COVID-19. This suggests that the pandemic has had an unfavourable influence on mental health. The results of this study are in line with reviews of trends in use of benzodiazepines during the pandemic [27,28,29]. Several observational studies during the early phases of the COVID-19 pandemic show a deterioration in mental health, especially in women and young people [30,31,32,33]. A meta-analysis on public mental health problems during the COVID-19 pandemic reported the prevalence of anxiety symptoms in almost 33% of the general population, with suspected patients having a higher prevalence of anxiety or depressive symptoms [34].
Although the need for acute benzodiazepine prescription and use is understandable, long-term use should be limited as there is evidence of its negative impact on individual health and society [13].
Patients with a confirmed COVID-19 diagnosis in this study were dispensed more benzodiazepine prescriptions. Evidence on the negative long-term effects of COVID-19 on the mental health of survivors and convalescents is emerging [35]. However, the evidence on benzodiazepine’s role in this population is lacking. The lack of available guidelines on benefits and safety of long-term benzodiazepine use for possible post-COVID-19 syndrome impedes the justification of prolonged use in such patients. For pharmacists, who counsel on safe and effective use of psychoactive medications, it could be useful to have access to patients’ COVID-19 or post-COVID-19 syndrome diagnosis. This is especially important for patients with prolonged benzodiazepine use and without adequate first-line therapy.
More than half of all benzodiazepine users were dispensed three or more benzodiazepine prescriptions. A lenient cut-off point of three prescriptions (representing 12 weeks of use) was chosen to include both the maximum 2–8 weeks of use and 4 weeks of deprescribing tapering. More than 80% of patients from the continuous use cohort were classified as prolonged users suggesting chronic use of benzodiazepines. This could indicate poor prescription practices as well as poor pharmaceutical care for these patients. Limiting prescriptions, creating prescribing and dispensing system alerts, and educating healthcare providers and patients could help improve care and reduce overuse. Research shows educational intervention aimed at elderly patients using benzodiazepines results in greater discontinuation than usual care [21]. Likewise, education around deprescribing can help healthcare providers in facilitating deprescribing interventions [36,37]. For instance, different educational materials are available for patients and healthcare providers, which can help in medication withdrawal [38]. Further investigation into reasons for prolonged use are necessary. Dispensing pharmacists should detect such patients and initiate a discussion on how to appropriately manage this problem.
Pharmacists can help identify deprescribing candidates in several ways: while dispensing medications and counselling on appropriate use during everyday practice, through pre-consultation screening processes such as medication review or comprehensive medication management, based on prescribing patterns, or through pre-defined pharmacist-led deprescribing initiatives aimed at specific patient populations such as the elderly [39,40,41]. Depending on the specifics of healthcare systems, different methods might be more appropriate. To aid the process of patient identification and, when appropriate, counselling on deprescribing, pharmacists can use deprescribing guidelines, checklists, or tools [42].
Prolonged benzodiazepines use in this study was identified in the following patient groups: women, elderly, and those using two or more benzodiazepines. These results are in concordance with previous findings that the use of psychotropic medications is generally more common in females and the elderly [43,44]. Hence, they could be targeted as priority patient groups for potential deprescribing initiatives. The side effects of prolonged use of benzodiazepines, such as falls or cognitive decline, especially in the elderly, are well known [45]. There is evidence that improvements in balance and cognition can be observed in patients within 2–3 weeks of stopping benzodiazepines or Z-drugs [23]. Some authors state that the risk of benzodiazepine use for anxiety has been overestimated, resulting in underprescribing [46]. Patients with refractory anxiety can benefit from their required use. It is important to consider and discuss deprescribing with patients who continuously use benzodiazepines but are candidates for alternative treatment options, such as cognitive–behavioural therapy, psychotherapy, and/or antidepressants.
This study identified potential candidates for benzodiazepine deprescribing. However, deprescribing is a patient-centred process, and patient involvement, agreement, and willingness to have the drug deprescribed are essential. To identify actual candidates for deprescribing, a consultation with the patient should be initiated and the focus should be on those willing to stop the drug. This might be especially difficult with benzodiazepines, which can cause dependence [47]. Nevertheless, Reeve et al. found that over 90% of patients would be willing to stop their medicines if recommended by their physician [48], whereas evidence on successful discontinuation of benzodiazepines or Z-drugs differs across studies, and indicates ranges between 27% and 80% of older patients [23]. Community pharmacists have an important role in the safe use of medicines and might be key healthcare professionals to recognise potential overuse, educate patients, collaborate with prescribers, and suggest deprescribing as a means to combat inappropriate use [39,49,50].
Younger patients in this study used higher doses of benzodiazepines compared to those older than 65 years. The COVID-19 pandemic has had a negative influence on mental health, especially in younger individuals [51]. Social restrictions affected the use of other modalities of treatment, such as individual or group therapies, and increased the use of telehealth, which younger individuals are more likely to use [52]. Although older patients have been using lower doses of benzodiazepines than younger ones, other drug-related problems in older populations were identified. More than 90% of all patients older than 65 years, in this study, were found to be using benzodiazepines as the only psycholeptic drug. Older patients were also more likely to use benzodiazepines for more than 3 months and with no other treatment. Pharmacists should focus on recognising such patients and initiating a dialogue on adverse effects and risks of prolonged use, and when appropriate, open a discussion on potential deprescribing. Elderly patients should be educated on the benefits and availability of other forms of treatment.
The selected cohort periods were chosen for several reasons. Even though WHO issued the global pandemic declaration in early March 2020, there were fewer than 40 cases per day in Croatia at that moment and the first lockdown followed in late March and early April. An increase in number of cases in Croatia followed in autumn and winter of 2020 and throughout 2021. Two earthquakes hit the capital and central Croatia in March and December 2020, which might have worsened mental health and influenced the use of benzodiazepines. It could be proven useful to potentially repeat the study both in Croatia and worldwide to include the extended pandemic period, given the continuing effect of the pandemic on public mental health.

4.1. Practical Implications and Potential Future Research

This is among the first studies to analyse benzodiazepine prescription-related data in the COVID-19 context. The results of this study provide useful insights into the overall prescription and use of benzodiazepines during the COVID-19 pandemic and indicate an urgent need for actions aimed at reducing non-rational prescription as well as recognizing the increased mental health needs of the community. Croatia has had less strict lockdown measures compared to other countries in Europe and worldwide. It would be interesting to compare and contrast use of benzodiazepines during the pandemic with countries with extensive and prolonged lockdown measures which could have additionally worsened populations mental health.
Urgent measures need to be taken for more overall rational use of benzodiazepines. Pharmacists can identify patients who meet the criteria for deprescribing and initiate the process through consultation with the patient and the prescriber [53]. This can be important for those using two or more benzodiazepines, prescribed without adequate justification, as the use of multiple benzodiazepines may lead to an increased risk of toxicity [54]. There was almost 20% of users in this study using multiple benzodiazepines, what is higher percentage than in other European countries [55]. Based on Croatian annual reports on drug utilisation, benzodiazepines have a steady growth in use, from 35.82 DDD/1000 patients/day for diazepam in 2017 to 40.57 DDD/1000 patients/day in 2020 [10]. Most western, northern, and southwestern European countries report a trend of a decline in benzodiazepine outpatient dispensing [43,56]. Increasing trends in benzodiazepine use in Croatia should encourage healthcare providers to change prescribing and dispensing habits to help increase patient safety. Our results prompt the need to investigate whether other countries have experienced similar deterioration in benzodiazepine overuse due to the COVID-19 pandemic.

4.2. Limitations

This study has several limitations. Exploring use of benzodiazepines in the period of COVID-19 pandemic could be viewed as biased, as it is expected that lockdown measures and its effects, fear of infection and uncertainty, would lead to many patients experiencing symptoms of anxiety and other mental health disorders. Regardless, it is important to explore the level of impact on benzodiazepine prescribing, as it could serve as a surrogate indicator of not only the mental health status of the population, but also the inappropriate use of anxiety medications as well. E-prescription data were collected from one community pharmacy. This pharmacy cares for around 50,000 patients, serves as a designated out-of-hours pharmacy for more than 110,000 patients, and neighbours the healthcare centre where the majority of prescribing physicians from this study practice. It is located in a residential district with demographic composition and population features representative of the country’s population, based on the 2019 city’s strategic planning documentation and the available census data [57]. It was one of few pharmacies exempt from lockdown mandates in March and April 2020, ensuring continuous provision of pharmaceutical care throughout the entire study period. Therefore, this community pharmacy served as a convenient site for data collection. Furthermore, in considering limitation, one should keep in mind that the actual use of benzodiazepines could be underestimated for several reasons. The analysis included only e-prescription information, while benzodiazepines could have been dispensed based on paper prescription, as well. However, this way of prescribing refers to private prescriptions and out-of-pocket drug reimbursement, therefore, is not common for benzodiazepines. Moreover, benzodiazepines might be prescribed off-label for diagnoses such as musculoskeletal pain, hypertension, and angina pectoris, or as part of post-acute cardiovascular incident treatment. Patients using benzodiazepines for such diagnoses were not included in this study, but they could have increased their use and should be monitored for prolonged and excessive use of anxiolytics as well. As only data of dispensed e-prescriptions were collected, it is hard to estimate whether or not patients were administering benzodiazepines as prescribed or their use was self-managed, either as increased or decreased use. Additional limitation concerns unavailability of data on chronic comorbidities and other medications for one-fifth of the patients (there was no difference between cohorts in data unavailability). Possible reasons include e-prescription system errors, loss or temporary changes in health insurance status, death, or benzodiazepine prescriptions by a substitute physician. It is important to state that e-prescriptions can be dispensed in any pharmacy across Croatia. Certain patients could have continued to have benzodiazepines dispensed from other pharmacies as well, which could not be considered in our analysis. Only a small number of confirmed COVID-19 cases, among benzodiazepine users, were identified, which could be attributed to all over lower number of confirmed cases in Croatia at the beginning of the pandemic in comparison to other countries. Yet, results indicate a negative impact on benzodiazepine use. Additional research on the effect of later stages of the pandemic, as well as post-pandemic use of benzodiazepines is needed.

5. Conclusions

The results of this study show an increase in the number of patients using benzodiazepines during the COVID-19 pandemic, as well as a large number of patients with potentially inappropriately long use of benzodiazepines. This study indicates deterioration in benzodiazepine overuse. Time constraints and patient reluctance prevent the initiation of benzodiazepine deprescribing. Community pharmacists can help identify candidates and initiate a consultation on benzodiazepine withdrawal.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/pharmacy10050120/s1, Supplementary file S1: STROBE checklist.

Author Contributions

Conceptualization, I.B.; methodology, I.B.; formal analysis, I.B. and T.I.P.; investigation, I.B. and T.I.P.; data curation, I.B. and T.I.P.; writing—original draft preparation, I.B. and T.I.P.; writing—review and editing, I.B. and M.O.H.; visualization, I.B. and M.O.H.; supervision, M.O.H.; project administration, I.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Ethics Committee of City Pharmacies Zagreb (1-8EP/2021 granted on 25 May 2021).

Informed Consent Statement

Patient consent was waived due to Ethics Committee statement that the patient consent forms were not necessary as personal or identifying information were not collected or were appropriately masked insuring GDPR was followed. Only dispensing data were collected.

Data Availability Statement

The data underlying this article will be shared on reasonable request to the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Novak, H.; Tadić, I.; Falamić, S.; Ortner Hadžiabdić, M. Pharmacists’ Role, Work Practices, and Safety Measures against COVID-19: A Comparative Study. J. Am. Pharm. Assoc. 2021, 61, 398–407. [Google Scholar] [CrossRef]
  2. Hayden, J.C.; Parkin, R. The challenges of COVID-19 for community pharmacists and opportunities for the future. Ir. J. Psychol. Med. 2020, 37, 198–203. [Google Scholar] [CrossRef]
  3. Elbeddini, A.; Yeats, A. Pharmacist intervention amid the coronavirus disease 2019 (COVID-19) pandemic: From direct patient care to telemedicine. J. Pharm. Policy Pract. 2020, 13, 23. [Google Scholar] [CrossRef]
  4. Tuczyńska, M.; Matthews-Kozanecka, M.; Baum, E. Accessibility to Non-COVID Health Services in the World During the COVID-19 Pandemic: Review. Front. Public Health 2021, 9, 1958. [Google Scholar] [CrossRef]
  5. Akour, A.; Elayeh, E.; Tubeileh, R.; Hammad, A.; Ya’Acoub, R.; Al-Tammemi, A.B. Role of Community Pharmacists in Medication Management during COVID-19 Lockdown. Pathog. Glob. Health 2021, 115, 168–177. [Google Scholar] [CrossRef]
  6. Knolle, F.; Ronan, L.; Murray, G.K. The Impact of the COVID-19 Pandemic on Mental Health in the General Population: A Comparison between Germany and the UK. BMC Psychol. 2021, 9, 60. [Google Scholar] [CrossRef]
  7. Maric, N.P.; Latas, M.; Andric Petrovic, S.; Soldatovic, I.; Arsova, S.; Crnkovic, D.; Gugleta, D.; Ivezic, A.; Janjic, V.; Karlovic, D.; et al. Prescribing Practices in Southeastern Europe—Focus on Benzodiazepine Prescription at Discharge from Nine University Psychiatric Hospitals. Psychiatry Res. 2017, 258, 59–65. [Google Scholar] [CrossRef]
  8. Pétein, C.; Spinewine, A.; Henrard, S. Trends in Benzodiazepine Receptor Agonists Use and Associated Factors in the Belgian General Older Population: Analysis of the Belgian Health Interview Survey Data. Ther. Adv. Psychopharmacol. 2021, 11, 204512532110118. [Google Scholar] [CrossRef]
  9. Landolt, S.; Rosemann, T.; Blozik, E.; Brüngger, B.; Huber, C.A. Benzodiazepine and Z-Drug Use in Switzerland: Prevalence, Prescription Patterns and Association with Adverse Healthcare Outcomes. Neuropsychiatr. Dis. Treat. 2021, 17, 1021–1034. [Google Scholar] [CrossRef]
  10. Annual Report on Drug Utilisation for 2020—Croatian Document—Reports on Drug Utilisation | Publications and Reports | News and Educations: HALMED. Available online: https://www.halmed.hr/en/Novosti-i-edukacije/Publikacije-i-izvjesca/Izvjesca-o-potrosnji-lijekova/Izvjesce-o-potrosnji-lijekova-u-Republici-Hrvatskoj-u-2020/ (accessed on 14 November 2021).
  11. Bandelow, B.; Michaelis, S.; Wedekind, D. Treatment of Anxiety Disorders. Dialogues Clin. Neurosci. 2017, 19, 93. [Google Scholar] [CrossRef]
  12. Diazepam Tablets BP 5mg—Summary of Product Characteristics (SmPC)—(Emc). Available online: https://www.medicines.org.uk/EMC/medicine/24405/SPC/Diazepam+Tablets+BP+5mg#gref (accessed on 4 November 2021).
  13. Guina, J.; Merrill, B. Benzodiazepines I: Upping the Care on Downers: The Evidence of Risks, Benefits and Alternatives. J. Clin. Med. 2018, 7, 17. [Google Scholar] [CrossRef]
  14. Uzun, S.; Kozumplik, O.; Jakovljević, M.; Sedić, B. Side Effects of Treatment with Benzodiazepines. Psychiatr. Danub. 2010, 22, 90–93. [Google Scholar]
  15. Gandra, S.S.A.; Almeida, A.L.D.; Teixeira, Z.M. Benzodiazepines Dependence: Addiction to Legally Prescribed Substances. J. Forensic Psychol. 2019, 4, 149. [Google Scholar] [CrossRef]
  16. Kroll, D.S.; Reyes Nieva, H.; Barsky, A.J.; Linder, J.A. Benzodiazepines Are Prescribed More Frequently to Patients Already at Risk for Benzodiazepine-Related Adverse Events in Primary Care. J. Gen. Intern. Med. 2016, 31, 1027–1061. [Google Scholar] [CrossRef]
  17. Reeve, E.; Gnjidic, D.; Long, J.; Hilmer, S. A Systematic Review of the Emerging Definition of ‘deprescribing’ with Network Analysis: Implications for Future Research and Clinical Practice. Br. J. Clin. Pharmacol. 2015, 80, 1254–1268. [Google Scholar] [CrossRef]
  18. Lui, E.; Wintemute, K.; Muraca, M.; Truong, C.; Ha, R.; Choe, A.K.B.; Michell, L.; Laine-Gossin, J.; Blankenstein, H.; Klein, S.; et al. Pharmacist-Led Sedative-Hypnotic Deprescribing in Team-Based Primary Practice. Can. Pharm. J. CPJ 2021, 154, 278. [Google Scholar] [CrossRef]
  19. Pollmann, A.S.; Murphy, A.L.; Bergman, J.C.; Gardner, D.M. Deprescribing benzodiazepines and Z-drugs in community-dwelling adults: A scoping review. BMC Pharmacol. Toxicol. 2015, 16, 19. [Google Scholar] [CrossRef]
  20. Tannenbaum, C.; Martin, P.; Tamblyn, R.; Benedetti, A.; Ahmed, S. Reduction of Inappropriate Benzodiazepine Prescriptions Among Older Adults Through Direct Patient Education: The Empower Cluster Randomized Trial. JAMA Intern. Med. 2014, 174, 890–898. [Google Scholar] [CrossRef]
  21. Martin, P.; Tamblyn, R.; Benedetti, A.; Ahmed, S.; Tannenbaum, C. Effect of a Pharmacist-Led Educational Intervention on Inappropriate Medication Prescriptions in Older Adults: The D-PRESCRIBE Randomized Clinical Trial. JAMA 2018, 320, 1889. [Google Scholar] [CrossRef]
  22. Turner, J.P.; Sanyal, C.; Martin, P.; Tannenbaum, C. Economic Evaluation of Sedative Deprescribing in Older Adults by Community Pharmacists. J. Gerontol. Ser. A 2021, 76, 1061–1067. [Google Scholar] [CrossRef]
  23. Ng, B.J.; Le Couteur, D.G.; Hilmer, S.N. Deprescribing Benzodiazepines in Older Patients: Impact of Interventions Targeting Physicians, Pharmacists, and Patients. Drugs Aging 2018, 35, 493–521. [Google Scholar] [CrossRef]
  24. Pottie, K.; Thompson, W.; Davies, S.; Grenier, J.; Sadowski, C.A.; Welch, V.; Holbrook, A.; Boyd, C.; Swenson, R.; Ma, A.; et al. Deprescribing Benzodiazepine Receptor Agonists: Evidence-Based Clinical Practice Guideline. Can. Fam. Physician 2018, 64, 339. [Google Scholar]
  25. Von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. Ann. Intern. Med. 2007, 147, 573–577. [Google Scholar] [CrossRef]
  26. Sarangi, A.; McMahon, T.; Gude, J. Benzodiazepine Misuse: An Epidemic Within a Pandemic. Cureus 2021, 13, e15816. [Google Scholar] [CrossRef]
  27. Mattiuzzi, C.; Sanchis-Gomar, F.; Lippi, G. Benzodiazepines Consumption May Have Increased during the COVID-19 Pandemic. J. Affect. Disord. 2022, 314, 124. [Google Scholar] [CrossRef]
  28. Agrawal, R. Careful Prescribing of Benzodiazepines during COVID-19 Pandemic: A Review. J. Ment. Health Clin. Psychol. 2020, 4, 13–16. [Google Scholar] [CrossRef]
  29. Milani, S.A.; Raji, M.A.; Chen, L.; Kuo, Y.F. Trends in the Use of Benzodiazepines, Z-Hypnotics, and Serotonergic Drugs Among US Women and Men Before and During the COVID-19 Pandemic. JAMA Netw. Open 2021, 4, e2131012. [Google Scholar] [CrossRef]
  30. Benke, C.; Autenrieth, L.K.; Asselmann, E.; Pané-Farré, C.A. Lockdown, quarantine measures, and social distancing: Associations with depression, anxiety and distress at the beginning of the COVID-19 pandemic among adults from Germany. Psychiatry Res. 2020, 293, 113462. [Google Scholar] [CrossRef]
  31. Kim, A.W.; Nyengerai, T.; Mendenhall, E. Evaluating the mental health impacts of the COVID-19 pandemic: Perceived risk of COVID-19 infection and childhood trauma predict adult depressive symptoms in urban South Africa. Psychol. Med. 2020, 52, 1587–1599. [Google Scholar] [CrossRef]
  32. Bäuerle, A.; Teufel, M.; Musche, V.; Weismüller, B.; Kohler, H.; Hetkamp, M.; Dörrie, N.; Schweda, A.; Skoda, E.-M. Increased Generalized Anxiety, Depression and Distress during the COVID-19 Pandemic: A Cross-Sectional Study in Germany. J. Public Health 2020, 42, 672–678. [Google Scholar] [CrossRef]
  33. Pierce, M.; Hope, H.; Ford, T.; Hatch, S.; Hotopf, M.; John, A.; Kontopantelis, E.; Webb, R.; Wessely, S.; McManus, S.; et al. Mental Health before and during the COVID-19 Pandemic: A Longitudinal Probability Sample Survey of the UK Population. Lancet Psychiatry 2020, 7, 883–892. [Google Scholar] [CrossRef]
  34. Liu, X.; Zhu, M.; Zhang, R.; Zhang, J.; Zhang, C.; Liu, P.; Feng, Z.; Chen, Z. Public Mental Health Problems during COVID-19 Pandemic: A Large-Scale Meta-Analysis of the Evidence. Transl. Psychiatry 2021, 11, 1–10. [Google Scholar] [CrossRef]
  35. Taquet, M.; Geddes, J.R.; Husain, M.; Luciano, S.; Harrison, P.J. 6-Month Neurological and Psychiatric Outcomes in 236 379 Survivors of COVID-19: A Retrospective Cohort Study Using Electronic Health Records. Lancet Psychiatry 2021, 8, 416–427. [Google Scholar] [CrossRef]
  36. Isenor, J.E.; Bai, I.; Cormier, R.; Helwig, M.; Reeve, E.; Whelan, A.M.; Burgess, S.; Martin-Misener, R.; Kennie-Kaulbach, N. Deprescribing Interventions in Primary Health Care Mapped to the Behaviour Change Wheel: A Scoping Review. Res. Soc. Adm. Pharm. 2021, 17, 1229–1241. [Google Scholar] [CrossRef]
  37. Poots, A.J.; Jubraj, B.; Barnett, N.L. Education around Deprescribing: ‘Spread and Embed’ the Story so Far. Eur. J. Hosp. Pharm. 2017, 24, 7. [Google Scholar] [CrossRef]
  38. Deprescribing.org Resources—Do I Still Need This Medication? Is Deprescribing for You? Available online: https://www.deprescribingnetwork.ca/useful-resources (accessed on 30 August 2022).
  39. Farrell, B.; Clarkin, C.; Conklin, J.; Dolovich, L.; Irving, H.; McCarthy, L.; Raman-Wilms, L. Community pharmacists as catalysts for deprescribing: An exploratory study using quality improvement processes. Can. Pharm. J. Rev. Pharm. Can. 2019, 153, 37–45. [Google Scholar] [CrossRef]
  40. Niznik, J.D.; Collins, B.J.; Armistead, L.T.; Larson, C.K.; Kelley, C.J.; Hughes, T.D.; Sanders, K.A.; Carlson, R.; Ferreri, S.P. Pharmacist interventions to deprescribe opioids and benzodiazepines in older adults: A rapid review. Res. Soc. Adm. Pharm. 2022, 18, 2913–2921. [Google Scholar] [CrossRef]
  41. Trenaman, S.C.; Kennie-Kaulbach, N.; d’Entremont-MacVicar, E.; Isenor, J.E.; Goodine, C.; Jarrett, P.; Andrew, M.K. Implementation of pharmacist-led deprescribing in collaborative primary care settings. Int. J. Clin. Pharm. 2022, 1–6. [Google Scholar] [CrossRef]
  42. Reeve, E. Deprescribing Tools: A Review of the Types of Tools Available to Aid Deprescribing in Clinical Practice. J. Pharm. Pract. Res. 2020, 50, 98–107. [Google Scholar] [CrossRef]
  43. Torres-Bondia, F.; De Batlle, J.; Galván, L.; Buti, M.; Barbé, F.; Pinõl-Ripoll, G. Trends in the Consumption Rates of Benzodiazepines and Benzodiazepine-Related Drugs in the Health Region of Lleida from 2002 to 2015. BMC Public Health 2020, 20, 818. [Google Scholar] [CrossRef]
  44. Taipale, H.; Särkilä, H.; Tanskanen, A.; Kurko, T.; Taiminen, T.; Tiihonen, J.; Sund, R.; Tuulio-Henriksson, A.; Saastamoinen, L.; Hietala, J. Incidence of and Characteristics Associated With Long-Term Benzodiazepine Use in Finland. JAMA Netw. Open 2020, 3, e2019029. [Google Scholar] [CrossRef]
  45. Picton, J.D.; Brackett Marino, A.; Lovin Nealy, K. Benzodiazepine Use and Cognitive Decline in the Elderly. Am. J. Health Pharm. 2018, 75, e6–e12. [Google Scholar] [CrossRef]
  46. Tibrewal, P.; Looi, J.C.L.; Allison, S.; Bastiampillai, T. Benzodiazepines for the Long-Term Treatment of Anxiety Disorders? Lancet 2021, 398, 119–120. [Google Scholar] [CrossRef]
  47. Brett, J.; Murnion, B. Management of Benzodiazepine Misuse and Dependence. Aust. Prescr. 2015, 38, 152. [Google Scholar] [CrossRef]
  48. Reeve, E.; Wiese, M.D.; Hendrix, I.; Roberts, M.S.; Shakib, S. People’s Attitudes, Beliefs, and Experiences Regarding Polypharmacy and Willingness to Deprescribe. J. Am. Geriatr. Soc. 2013, 61, 1508–1514. [Google Scholar] [CrossRef]
  49. International Pharmaceutical Federation (FIP) Patient Safety. Pharmacists’ Role in Medication without Harm. Available online: https://www.fip.org/file/4757 (accessed on 21 December 2021).
  50. Al-Quteimat, O.; Siddiqui, M.; Hussein, L.; Al Emleh, H.; Shamieh, I.E.D. Analysis of Pharmacist Interventions in Adult COVID-19 Patients Admitted to a Tertiary Care Hospital. J. Pharm. Pract. 2022, 2022, 08971900211065536. [Google Scholar] [CrossRef]
  51. Hawes, M.T.; Szenczy, A.K.; Klein, D.N.; Hajcak, G.; Nelson, B.D. Increases in depression and anxiety symptoms in adolescents and young adults during the COVID-19 pandemic. Psychol. Med. 2021, 1–9. [Google Scholar] [CrossRef]
  52. Fischer, S.H.; Ray, K.N.; Mehrotra, A.; Bloom, E.L.; Uscher-Pines, L. Prevalence and Characteristics of Telehealth Utilization in the United States. JAMA Netw. Open 2020, 3, e2022302. [Google Scholar] [CrossRef]
  53. Gallagher, H.C. Addressing the Issue of Chronic, Inappropriate Benzodiazepine Use: How Can Pharmacists Play a Role? Pharmaceutical 2013, 1, 65–93. [Google Scholar] [CrossRef]
  54. The Royal Australian and New Zealand College of Psychiatrists. Guidance for the Use of Benzodiazepines in Psychiatric Practice. Prof. Pract. Guid. 2019, 11, 1–4. [Google Scholar]
  55. Handal, M.; Skurtveit, S.; Mørland, J.G. Co-Medication with Benzodiazepines. Tidsskr. Nor. Laegeforen. 2012, 132, 526–530. [Google Scholar] [CrossRef]
  56. Estrela, M.; Herdeiro, M.T.; Ferreira, P.L.; Roque, F. The Use of Antidepressants, Anxiolytics, Sedatives and Hypnotics in Europe: Focusing on Mental Health Care in Portugal and Prescribing in Older Patients. Int. J. Environ. Res. Public Health 2020, 17, 8612. [Google Scholar] [CrossRef]
  57. City Office for Economy Environmental Sustainability and Strategic Planning. Statistical Yearbook of the City of Zagreb 2019; City Office for the Strategic Planning and Development of the City: Zagreb, Croatia, 2019; Volume 68.
Table
Table 1. Patient characteristics.
Table 1. Patient characteristics.
  Patient Characteristics
Age (years)
  Median (IQR)62 (47–73)
  <65 years (n, % of participants)702 (54.42%)
  >65 years (n, % of participants)588 (45.58%)
Gender (n, %)
  Male438 (33.95%)
  Female852 (66.05%)
Number of medications
  No information325 (25.19%)
  <5 medications (n, % of participants)811 (62.87%)
  ≥5 medications (n, % of participants)154 (11.94%)
Number of chronic comorbidities
  No information325 (25.19%)
  <5 comorbidities (n, % of participants)905 (70.16%)
  ≥5 comorbidities (n, % of participants)60 (4.65%)
Diagnoses for benzodiazepine use (n, % of participants)
  F32.0 mild depressive episode28 (2.17%)
  F40.0 phobic anxiety disorder7 (0.54%)
  F41.0 panic disorder519 (40.23%)
  F41.1 generalised anxiety disorder90 (6.98%)
  F41.2 mixed anxiety and depressive disorder223 (17.29%)
  F41.9 unspecified anxiety disorder41 (3.18%)
  F43.0 acute stress reaction160 (12.40%)
  F43.2 adjustment disorders91 (7.05%)
  F48.0 neurasthenia131 (10.16%)
Type of benzodiazepine (n, % of participants)
  Alprazolam302 (23.41%)
  Bromazepam35 (2.71%)
  Clonazepam40 (3.10%)
  Diazepam462 (35.81%)
  Lorazepam38 (2.95%)
  Nitrazepam6 (0.47%)
  Oxazepam108 (8.37%)
  Zolpidem42 (3.26%)
  Two benzodiazepines228 (17.67%)
  Three or more benzodiazepines29 (2.25%)
COVID-19 diagnosis
  Yes49 (3.80%)
  No1241 (96.20%)
Table
Table 2. Games–Howell post hoc test.
Table 2. Games–Howell post hoc test.
Dependent VariableCohort (Mean, SD)Mean
Difference		Sig.95% CI
number of benzodiazepine prescriptionsCOVID-19
3.00 ± 2.16		pre-COVID-19
2.71 ± 1.46		0.29p = 0.057−0.01 to 0.59
continuous use
7.07 ± 6.55		pre-COVID-19
2.71 ± 1.46		4.36p < 0.00053.62 to 5.10
continuous use
7.07 ± 6.55		COVID-19
3.00 ± 2.16		4.07p < 0.00053.30 to 4.83
diazepam dose equivalent of single prescription (mg)COVID-19
25.85 ± 37.41		pre-COVID-19
18.47 ± 31.77		5.42p = 0.02572.25 to 537.80
continuous use
62.20 ± 75.20		pre-COVID-19
18.47 ± 31.77		41.91p < 0.000527.15 to 45.82
continuous use
62.20 ± 75.20		COVID-19
25.85 ± 37.41		36.49p < 0.000533.27 to 50.54
total number of milligrams of diazepam equivalentCOVID-19
1073.16 ± 1528.72		pre-COVID-19
768.13 ± 1333.63		305.03p = 0.00672.25 to 537.80
continuous use
2708.09 ± 4402.77		pre-COVID-19
768.13 ± 1333.63		1939.96p < 0.00051430.39 to 2449.54
continuous use
2708.09 ± 4402.77		COVID-19
1073.16 ± 1528.72		1634.93p < 0.00051118.98 to 2150.88
Table
Table 3. Candidates for potential deprescribing of benzodiazepines.
Table 3. Candidates for potential deprescribing of benzodiazepines.
VariableGroupsn, % of Candidates for
Potential Benzodiazepine
Deprescribing **		Chi-Squared Value, p Value
Age<65 years349, 49.72%χ2(1) = 22.05; p < 0.0001
≥65 years369, 62.76%
Medication<5473, 58.32%χ2(1) = 30.35; p < 0.0001
≥5126, 81.82%
Comorbidities<5547, 60.44%χ2(1) = 16.44; p < 0.0001
≥552, 86.67%
SexMale221, 50.46%χ2(1) = 7.27; p = 0.007
Female497, 58.33%
Number of benzodiazepines1549, 53.15 %χ2(1) = 13.265; p < 0.0001
≥2169, 65.76%
Use of medication for psychiatric disordersYes145, 50.88%χ2(1) = 3.39; p = 0.066
No573, 57.01%
** defined as participants who were dispensed more than three prescriptions.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bužančić, I.; Pejaković, T.I.; Hadžiabdić, M.O. A Need for Benzodiazepine Deprescribing in the COVID-19 Pandemic: A Cohort Study. Pharmacy 2022, 10, 120. https://doi.org/10.3390/pharmacy10050120

AMA Style

Bužančić I, Pejaković TI, Hadžiabdić MO. A Need for Benzodiazepine Deprescribing in the COVID-19 Pandemic: A Cohort Study. Pharmacy. 2022; 10(5):120. https://doi.org/10.3390/pharmacy10050120

Chicago/Turabian Style

Bužančić, Iva, Tajana Iva Pejaković, and Maja Ortner Hadžiabdić. 2022. "A Need for Benzodiazepine Deprescribing in the COVID-19 Pandemic: A Cohort Study" Pharmacy 10, no. 5: 120. https://doi.org/10.3390/pharmacy10050120

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop