Next Article in Journal
Changing Attitudes toward the COVID-19 Vaccine among North Carolina Participants in the COVID-19 Community Research Partnership
Next Article in Special Issue
Competition of SARS-CoV-2 Variants in Cell Culture and Tissue: Wins the Fastest Viral Autowave
Previous Article in Journal
Effect of SARS-CoV-2 Mutations on the Efficacy of Antibody Therapy and Response to Vaccines
Previous Article in Special Issue
Agent Based Model of Anti-Vaccination Movements: Simulations and Comparison with Empirical Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Modeling Study on Vaccination and Spread of SARS-CoV-2 Variants in Italy

by
Chiara Antonini
1,*,
Sara Calandrini
1,2 and
Fortunato Bianconi
3
1
ICT4life Srl, Via Mario Donati Guerrieri, 16, 06132 Perugia, Italy
2
Department of Engineering, University of Perugia, Via Goffredo Duranti, 93, 06125 Perugia, Italy
3
COVID-19 Epidemiological Unit, Regional Government of Umbria, Corso Vannucci, 96, 06121 Perugia, Italy
*
Author to whom correspondence should be addressed.
Vaccines 2021, 9(8), 915; https://doi.org/10.3390/vaccines9080915
Submission received: 25 June 2021 / Revised: 29 July 2021 / Accepted: 12 August 2021 / Published: 17 August 2021
(This article belongs to the Special Issue Dynamic Models in Viral Immunology)

Abstract

:
From the end of 2020, different vaccines against COVID-19 have been approved, offering a glimmer of hope and relief worldwide. However, in late 2020, new cases of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) started to re-surge, worsened by the emergence of highly infectious variants. To study this scenario, we extend the Susceptible-Exposed-Infectious-Removed model with lockdown measures used in our previous work with the inclusion of new lineages and mass vaccination campaign. We estimate model parameters using the Bayesian method Conditional Robust Calibration in two case studies: Italy and the Umbria region, the Italian region being worse affected by the emergence of variants. We then use the model to explore the dynamics of COVID-19, given different vaccination paces and a policy of gradual reopening. Our findings confirm the higher reproduction number of Umbria and the increase of transmission parameters due to the presence of new variants. The results illustrate the importance of preserving population-wide interventions, especially during the beginning of vaccination. Finally, under the hypothesis of waning immunity, the predictions show that a seasonal vaccination with a constant rate would probably be necessary to control the epidemic.

1. Introduction

The outbreak of COVID-19, caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has caused a global health and economic crisis, with over 167 million cases and 3 million deaths, at the time of writing [1].
Italy was the first European country strongly affected by the COVID-19 pandemic in early 2020. The first confirmed cases were detected at the end of February and, since then, the epidemic rapidly spread in the entire country, especially in the northern regions. From March 2020 until the beginning of May 2020, the Italian Government imposed a country-scale lockdown in order to reduce the spreading of the virus and mitigate the impact on the national health system [2]. Starting in May 2020, new positive cases and hospitalizations were drastically reduced and the intervention measures were progressively eased. However, the increased mobility and social gatherings caused a resurgence of SARS-CoV-2 infections at the end of August, leading the beginning of the second wave of the COVID-19 pandemic [2]. Despite the social distancing measures imposed, many factors, such as school reopening and crowded public transport, caused a new critical rise of infected cases and deaths, breaking the testing, tracing, and isolation program. This situation forced the Italian government to adopt a new color-coded system of restrictions, based on the risk scenario of each region [3]. The mitigation measures introduced, if compared to the first lockdown, were less restrictive, in order to be bearable from a social and economic point of view. As a result, the descending phase of the second wave was very slow and steady [4].
The second wave of infections was also characterized by two antithetical events, critical for the evolution of the pandemic: the discovery of new variants and the approval of the first vaccines. The novel lineages of SARS-CoV-2 were initially detected in Italy in December, and they rapidly gave rise to a third wave of infections in 2021 [5]. The so-called variants of concerns (VOC) are more transmissible and might be associated with higher disease severity than the original strain [6,7]. When the Italian government closed the borders to limit the introduction of new lineages, these variants were already spread across the country and they soon became dominant [8]. Moreover, while almost all regions experienced an uptick of the curve of contagion in March 2021, the Umbria region and the province of Bolzano were exposed to a high circulation of these lineages already between January and February, 2021 [9].
Since the first publishing of the genetic sequence of SARS-CoV-2 in January 2020, industry developers have struggled to develop a vaccine against this disease [10]. To date, there are four vaccines approved by the European Medicines Agency (EMA) and the Italian Medicines Agency (AIFA). The first to be approved are two mRNA vaccines, i.e., Pfizer/BioNTech and Moderna, which are administered in a two-dose regimen. They have 95% and 94.1% efficacy at preventing COVID-19 illness, respectively [11,12]. Then, two viral vector vaccines were also approved, the Vaxzevria vaccine by Oxford-AstraZeneca and the Johnson&Johnson’s vaccine. The Vaxzevria vaccine, administered in two doses 12 weeks apart, has an efficacy of 81.3%, while the Johnson&Johnson’s vaccine is one shot with an efficacy up to 85% [13,14]. The Italian vaccination campaign started on 27 December 2020 and was divided in four main phases [15]. Initially, the priority was given to medical workers together with guests and personnel from nursing homes. Then, the roll-out was organized according to age and clinical vulnerabilities of people.
Given this scenario, epidemiological models play a crucial role in exploring the future trajectory of COVID-19 and assessing the role of immunity response and the impact of new variants [16,17]. Various frameworks, based on the well known Susceptible-Infected-Recovered (SIR) model and its derivatives, have been developed to understand the nature of the pandemic and predict its possible evolution. In [18], the duration of the immune responses and the severity of secondary cases are studied through a Susceptible-Infected-Recovered-Susceptible (SIRS) model. In [6], an age-structured and regionally structured mathematical model is employed to understand the transmissibility of the B.1.1.7 lineage in United Kingdom (UK), while in [7], a Bayesian model analyzes the increase of infections due to the P.1 variant in Manaus, Brazil. As regards Italy, Giordano et al. evaluated the adoption of different restriction scenarios during the mass vaccination campaign with the compartmental model SIDARTHE-V [4].
Here, we extend the SEIR model with intervention parameters (SEIRL) presented in [19] to include the presence of new variants and vaccination roll-out (SEIRL-V). We focus on the case study of Italy and of the Umbria region, the first region displaying the emergence of variants. To faithfully reproduce the epidemic evolution, we estimate model parameters using our Bayesian method Conditional Robust Calibration (CRC) against the Italian and Umbria data [20,21,22]. By varying the vaccination rate and the relaxation of non-pharmaceutical interventions (NPIs), we simulate multiple scenarios to forecast the dynamics of COVID-19 in 2021 and beyond.

2. Materials and Methods

2.1. SEIRL-V Compartmental Model

In this study, we use and extend the SEIRL model presented in [19], with the introduction of vaccinations (SEIRL-V). The SEIRL-V compartmental model is shown in Figure 1 and it includes twelve infection states. Susceptible individuals (class S), when in contact with infected people, evolve into the exposed condition (class E) where they are infected but do not transmit the virus. Then, E individuals become pre-symptomatic (class P S ), meaning that they still do not have symptoms but are able to infect other people. After leaving the P S class, the group of infected is divided between asymptomatic (class A) and mild cases (class M). People in M class can progress to severe infection (class H), which requires hospitalization. Individuals in H may develop acute life-threatening symptoms and need treatment in an Intensive Care Unit (ICU) (class I C U ). All infected classes can instead recover and evolve to the R class. Here, differently from the authors of [19], we suppose that both people in H and I C U class can die. Susceptible individuals are vaccinated with the injection of two doses (classes V 1 and V 2 ). After several days from the second dose, people acquire immunity (class I m ). However, due to incomplete vaccine efficacy, vaccinated people may not develop the immunization and become infected, entering the E class. Even though vaccinated people contract the infection, they have a reduced probability of developing symptoms and do not need to be hospitalized. People in the I m and R classes have a finite period of immunity, after which they return to the susceptible class.
The model is a positive and bilinear system: all state variables have non-negative values for time t 0 , if initialized with non-negative values at time 0. Due to the rapid disease spread, human birth and death rates are omitted in the model [23]. For the mass conservation property, we have that S ˙ + E ˙ + P S ˙ + A ˙ + M ˙ + H ˙ + I C U ˙ + R ˙ + D ˙ + V 1 ˙ + V 2 ˙ + I m ˙ = 0 , thus the sum of the states is constant and equal to the total population N.
The Ordinary Differential Equations (ODEs) system describing the interaction between these groups of population is as follows:
S ˙ = ( b e P S , ν + b 0 A + b 1 M + b 2 H + b 3 I C U + η ) S + R δ + I m δ E ν ˙ = ( b e P S , ν + b 0 A + b 1 M + b 2 H + b 3 I C U ) S ν a 0 E P S , ν ˙ = a 0 E ν a 1 P S , ν A ˙ = z ν f a 1 P S , ν g 0 A M ˙ = ( 1 z ν ) ( 1 f ) a 1 P S , ν g 1 M p 1 M H ˙ = p 1 M g 2 H p 2 H u 1 H I C U ˙ = p 2 H g 3 I C U u I C U R ˙ = g 0 A + g 1 M + g 2 H + g 3 I C U R δ D ˙ = u I C U + u 1 H V 1 ˙ = η S V 1 τ ( b e P S , ν + b 0 A + b 1 M + b 2 H + b 3 I C U ) ( 1 ρ 1 ) V 1 V 2 ˙ = V 1 τ ( b e P S , ν + b 0 A + b 1 M + b 2 H + b 3 I C U ) ( 1 ρ 2 ) V 2 V 2 τ i m m I m ˙ = V 2 τ i m m I m δ
The state variables of the ODEs are represented by the capital Latin letters:
  • S: susceptible individuals,
  • E ν : exposed individuals, where ν = 0 , 1 , 2 denotes the numbers of vaccines doses received,
  • P S , ν : pre-symptomatic individuals, where ν = 0 , 1 , 2 denotes the numbers of vaccines doses received,
  • A: asymptomatic individuals,
  • M: people with mild infection,
  • H: people in hospital with severe symptoms,
  • I C U : people with critical infection which requires ICU level care,
  • R: recovered individuals,
  • D: dead people,
  • V 1 : people vaccinated with the first dose of vaccine,
  • V 2 : people vaccinated with the second dose of vaccine,
  • I m : immune individuals.
  • S ν with ν = 0 , 1 , 2 as the number of doses received. In more detail, S 0 = S , S 1 = ( 1 ρ 1 ) V 1 and S 2 = ( 1 ρ 2 ) V 2 .
Parameters b i , i = e , 0 , 1 , 2 , 3 , are the transmission rates, representing a contact between a susceptible individual and an infected of classes P S , A, M, H, and I C U , respectively. Parameters g i i = 0 , 1 , 2 , 3 represent the different recovery rates of classes A, M, H, and I C U , respectively, while u 1 and u are the death rates of hospitalized and ICU people. Parameters a i i = 0 , 1 indicate the rate of exit from classes E and P S , while parameters p 1 and p 2 are the progression rate from mild to severe infection and from severe to critical infection. Parameter f is the fraction of asymptomatic individuals. All these model parameters are derived from the clinical observations using the following formulas:
(1)
a 1 = P r e s y m P e r i o d 1
(2)
a 0 = ( I n c u b P e r i o d P r e s y m P e r i o d ) 1
(3)
g 1 = D u r M i l d I n f 1 · ( 1 F r a c S e v e r e F r a c C r i t i c a l )
(4)
p 1 = D u r M i l d I n f 1 g 1
(5)
p 2 = D u r H o s p 1 · F r a c C r i t i c a l ( F r a c S e v e r e + F r a c C r i t i c a l )
(6)
u 1 = D u r H o s p 1 · ( ( P r o b D e a t h H · F r a c S e v e r e 100 ) F r a c S e v e r e
(7)
g 2 = D u r H o s p 1 p 2 u 1
(8)
u = T i m e I C U D e a t h 1 · ( ( P r o b D e a t h · F r a c C r i t i c a l 100 ) F r a c C r i t i c a l
(9)
g 3 = T i m e I C U D e a t h 1 u
(10)
f = F r a c A s y m
(11)
g 0 = D u r A s y m 1 ,
where P r e s y m P e r i o d is the length of the infectious phase of incubation period I n c u b P e r i o d . D u r A s y m is the average duration of asymptomatic infection, D u r M i l d I n f is defined as the duration of mild symptoms or the time from symptom onset to hospitalization, for those who progress to class H. The duration of severe infection D u r H o s p is the time from hospital admission to recovery or death or ICU admission. T i m e I C U D e a t h is the time from ICU admission to recovery or death. All time duration are expressed in days (d). F r a c A s y m is the percentage of infected people that develops asymptomatic infection while F r a c S e v e r e and F r a c C r i t i c a l are, respectively, the percentage of individuals requiring hospitalization and ICU-level care.
To describe the availability of an effective vaccine against SARS-CoV-2, we model the injection of two doses, as most of the approved vaccines adopt this regimen. All of them are characterized by different values of administration delays and efficacy. For the model, the value of vaccination parameters is chosen according to those of the Pfizer/BioNTech vaccine as it is currently the most administered in Italy [24]. The parameters related to vaccination are the following:
  • parameter η is the rate of injection of the first dose. It is modeled as a piecewise constant function;
  • parameter δ is the duration of natural and vaccinal immunity. We suppose that the average duration of natural and vaccinal immunity is equal to 8 months (240 days), according to [25,26];
  • parameter τ is the time between the first and second dose of vaccine and it is set to 21 days [11];
  • parameter τ i m m is the number of days between the second dose and the acquired immunity and it is set to 14 days [11];
  • parameter ρ 1 is the efficacy of the first shot of vaccine and it is set to 0.8 [27];
  • parameter ρ 2 is the efficacy of the second shot of vaccine and it is set to 0.95 [11];
  • parameter ρ 3 is the efficacy of the first shot against hospitalization ad it is set to 0.808 [28,29];
  • parameter ρ 4 is the efficacy of the second shot against hospitalization ad it is set to 0.946 [28,29];
  • parameter z ν with ν = 0 , 1 , 2 is introduced to represent vaccine efficacy against disease. Thus, z 0 = 0 , z 1 = ρ 3 and z 2 = ρ 4 .
Regarding vaccine efficacy, we consider two forms of efficacy: protection against infection, represented by parameters ρ 1 and ρ 2 , and efficacy against disease, through parameters ρ 3 and ρ 4 . Indeed, as vaccines do not provide full protection (100%), breakthrough infections are still possible. Thus, people who have received all recommended doses of vaccine can still contract the infection. However, vaccinated people who get sick are likely to have milder symptoms and it is very rare for them to experience severe illness or die [16]. The Italian vaccination program is mainly based on the prioritization of the oldest age groups and of vulnerable people. As age classes are not included in our model, we take them into account through the introduction of a Hill function between hospitalized (H) and immunized people ( I m ), in order to model the dependent decline of hospital admissions. As a result, the ODE for class H becomes
H ˙ = p 1 M g 2 H p 2 H u 1 H + 1 1 + ( I m K ) n u v a x ,
where K is the inverse feedback strength indicator and n is the Hill coefficient. Indeed, for a given n, increasing K reduces the repression level, and vice versa, while as n tends to infinity the Hill function resembles the step function [30]. The term u v a x is introduced to take into account the start of the massive vaccination campaign:
u v a x = 0 , t < t v a x 1 , t t v a x ,
where t v a x is the first day of vaccination in Italy, i.e., 27 December 2020 [24].
The model includes also non-pharmaceutical interventions (NPIs) and easing of restrictions alternatively promoted by the Italian Government, depending on the epidemic data. All these measures are represented by parameter s 0 . Thus, the transmission rates are multiplied as follows:
b e , l o c k = b e · s 0 b 0 , l o c k = b 0 · s 0
Parameters b 1 , b 2 , and b 3 are not scaled by any factor because we implicitly include the ban of detected positive people on leaving their houses and the employment of personal protective equipment (PPE) in hospitals, supposing that they are all requirements from the beginning of the second wave of the epidemic.
The presence of new variants is represented through the variation of parameters b e and b 0 , as it has been stated that these variants are highly transmissible [6,7]. In order to introduce this hypothesis, the transmission rate parameters of presymtpomatic and asymptomatic infected are given by
b e , l o c k = b e , 1 · s 0 , t < t v a r b e , 2 · s 0 , t t v a r
b 0 , l o c k = b 0 , 1 · s 0 , t < t v a r b 0 , 2 · s 0 , t t v a r
where t v a r is the time of introduction of the new variants. Using the next generation matrix, the formula for computing the basic reproduction number R 0 , i.e., the number of individuals infected by a single infected individual during his infectious period, is [4,19,31]:
R 0 = N [ b e a 1 + f b 0 g 0 + ( 1 f ) 1 p 1 + g 1 ( b 1 + p 1 p 2 + g 2 + u 1 ( b 2 + b 3 p 2 u + g 3 ) ) ] .
The system admits a disease-free state equilibrium where the disease dies out and an endemic equilibrium [4,18]. It can be partitioned into three subsystems: the first one with susceptible individuals and individuals vaccinated with one or two doses of vaccine; the second one with all the infected; and the third one which includes healed, dead, and immunized. The system can be rewritten in feedback form with the infected subsystem as a positive linear subsystem subjected to a feedback signal c. Defining x = [ E ν P S , ν A M H I C U ] T , the subsystem is
x ˙ ( t ) = F x ( t ) + d c ( t ) = a 0 0 0 0 0 0 a 0 a 1 0 0 0 0 0 z ν f a 1 g 0 0 0 0 0 ( 1 z ν ) ( 1 f ) a 1 0 ( g 1 + p 1 ) 0 0 0 0 0 p 1 ( g 2 + p 2 + u 1 ) 0 0 0 0 0 p 2 ( g 3 + u ) x ( t ) + 1 0 0 0 0 0 c ( t )
c ( t ) = S ν ( t ) y S ( t )
y S ( t ) = 0 b e b 0 b 1 b 2 b 3 x ( t )
y R ( t ) = 0 0 g 0 g 1 g 2 g 3 x ( t )
y D ( t ) = 0 0 0 0 u 1 u x ( t )
S ˙ ( t ) = S ( t ) ( y S ( t ) η ) + 1 δ ( R ( t ) + I m ( t ) )
R ˙ ( t ) = y R ( t ) R ( t ) δ
D ˙ ( t ) = y D ( t )
V 1 ˙ ( t ) = η S ( t ) V 1 ( t ) τ ( 1 ρ 1 ) y S ( t ) V 1 ( t )
V 2 ˙ ( t ) = V 1 ( t ) τ V 2 ( t ) τ i m m ( 1 ρ 2 ) y S ( t ) V 2 ( t )
I m ˙ ( t ) = V 2 ( t ) τ i m m I m ( t ) δ

2.2. Data

We calibrate the model against hospitalized, ICU, and dead patients (classes H, I C U , and D in the model, respectively). Epidemiological data about the COVID-19 evolution are available in the GitHub repository of the Italian Civil Protection Department [32]. Data about total number of vaccines administered are taken from the Github repository of the Italian Government [24].

2.3. Conditional Robust Calibration (CRC) for Parameter Estimation

CRC is an iterative algorithm for parameter estimation, belonging to the class of Approximate Bayesian Computation Sequential Monte Carlo (ABC-SMC) methodologies. A detailed description of CRC can be found in [19,20,21,22]. CRC is based on the sampling of the parameter space and it considers the parameter vector as a random variable P. It returns in output an approximation of the parameter posterior distribution conditioned to the available data f P | y * ( p ) , where y * is the dataset. At each iteration, CRC generates a matrix P O of N S parameter vectors through Latin Hypercube Sampling (LHS). Each parameter vector p is sampled inside an interval between a lower and upper boundary, L 1 and U 1 , chosen by the user. Parameters are assumed to be uniformly or logarithmically distributed in their intervals. Then, for each sample p P O , the ODE model is integrated to compute the in silico vector of observables y. The fitting between the simulated vector y and the dataset y * is measured through the Absolute Distance Function (ADF):
A D F i = j = 1 k | y i ( t j ) y i j * | i = 1 , . . . , m ,
where y i is the simulated observable at time point t j , and y i j * is the corresponding measured variable. This distance function measures the distribution of the error between simulated and real data when the parameters are sampled in each iteration. For each p  P O , each A D F i i = 1 , . . . , m is computed, and we select only those distance functions under a user defined threshold ϵ i 0 . Thus, we obtain different parameter sets P O , ϵ i , one for each output variable. Each set contains only those parameters that yield the values of a specific distance function under the corresponding threshold. All these sets are intersected to obtain P O , ϵ = { i = 1 m P O , ϵ i } , where ϵ = { ϵ 1 , . . . , ϵ i , . . . , ϵ m } . Using a kernel density approach, the approximate posterior distribution f P | P O , ϵ is estimated. This procedure is repeated for multiple iterations, updating the sampling interval on the basis of the posterior distribution of the previous iteration. The final output of the algorithm is f P | P O , ϵ , where ϵ is the set of thresholds chosen in the final CRC iteration. The code for running CRC and the SEIRL-V model of COVID-19 is available at https://github.com/fortunatobianconi/CRC (accessed on 7 June 2021).

3. Results

3.1. Spread of Sars-CoV-2 Lineages in Umbria and Italy

During the second and third wave of COVID-19, several novel variants of Sars-CoV-2 emerged in Italy. Some of these lineages, i.e., B.1.1.7, B.1.351, and P.1, are known as VOC, as they may be characterized by increasing transmissibility, more severe disease and reduced cross-protective immunity [33]. The B.1.1.7 lineage was first detected in the UK in September 2020 and then it rapidly spread in at least 114 countries [6]. Around mid-November 2020, the P.1 strain emerged in Manaus, Brazil, causing a rapid resurgence of Sars-CoV-2 hospitalizations and new positive cases [7]. Another fast-spreading variant is the B.1.351, first reported in South Africa in December 2020 [34]. The proportion of COVID-19 cases imputable to these VOC has rapidly increased worldwide, replacing previously circulating variants. In Italy, the presence of variants was initially reported in late 2020 and the outbreak progressed to a peak in late March, when more than 20,000 new cases were notified every day. The B.1.1.7 lineage was the first one identified and, according to the Italian National Institute of Health (ISS), it became the prevalent one in a few months. Indeed, we started from a prevalence of 17.8 % at the beginning of February to a prevalence of 91.6 % at the end of April 2021 [8,35]. However, in the Umbria region, especially in the province of Perugia, the new variants pushed up the contagion curve way before the other Italian regions. Umbria was classified by the ISS as the epicenter of the P.1 lineage in Italy, with a prevalence of 36.2 % in mid-February [36]. Indeed, as shown in Figure 2, the Umbria region experienced a peak of hospitalizations in February rather than in March, with a number of ICU admissions almost twice as much the one in Italy.

3.2. Umbria Case Study

The SEIRL-V model is calibrated using the CRC algorithm against data of Umbria from 1 September 2020 to 1 May 2021. We normalize data over the population N = 882,000 and multiply them by 10 5 . According to the work in [32], initial conditions are set as follows: S 0 = 10 5 E 0 , E 0 = ( 400 / N ) × 10 5 , P S , 0 = 300 , A 0 = 144 , M 0 = 144 , H 0 = 8 , I C U 0 = 2 , R 0 = 1452 , D 0 = 80 , V 1 , 0 = 0 , V 2 , 0 = 0 , I m 0 = 0 . From September, many measures were issued by the national and local governments in order to contain the contagion curve. In the model, we consider the most relevant ones:
(1)
14 September 2020 ( T l o c k , 1 ), school reopening;
(2)
19 October 2020 ( T l o c k , 2 ), the Regional Government adopted some preventative measures such as remote teaching for part of the students, limited capacity of public transportation and closure of shopping malls during the weekend [37];
(3)
11 November 2020 ( T l o c k , 3 ), Umbria region is classified as “orange”, i.e., as a medium-risk contagion zone;
(4)
6 December 2020 ( T l o c k , 4 ), Umbria goes back to “yellow” zone, i.e., with moderate risk of virus spread;
(5)
7 January 2021 ( T l o c k , 5 ), school reopening and easing of some restrictions after the country-wide red area;
(6)
8 February 2021 ( T l o c k , 6 ), “red” area for the entire Province of Perugia, i.e., the highest level of restrictions, following an improvement in the contagion data and the identification of variants;
(7)
22 March 2021 ( T l o c k , 7 ), back to ’orange’ zone with reopening of schools for the youngest.
Thus, the parameter vector that reproduces all these measures is s 0 = [ s 01 , s 02 , s 03 , s 04 , s 05 , s 06 , s 07 ] , which modifies the transmission rate parameters as follows:
b e , l o c k = b e , t < T l o c k , 1 b e · s 0 , i , T l o c k , i t < T l o c k , i + 1 i = 1 , . . . , 6 b e · s 0 , 7 t T l o c k , 7
b 0 , l o c k = b 0 , t < T l o c k , 1 b 0 · s 0 , i , T l o c k , i t < T l o c k , i + 1 i = 1 , . . . , 6 b 0 · s 0 , 7 t T l o c k , 7
Parameters b e and b 0 are differentiated also to account for the presence of new virus variants, starting from 19 December 2020 ( t v a r ), around a month before the resurgence of new infections. Moreover, to accurately simulate the epidemic in Umbria, we vary the fraction of critical infected patients F r a c C r i t i c a l as follows:
  • F r a c C r i t i c a l = F r a c C r i t i c a l 1 from day 0 (1 September 2020) to day 35 (5 October 2020);
  • F r a c C r i t i c a l = F r a c C r i t i c a l 2 from day 36 to day 83 (22 November 2020);
  • F r a c C r i t i c a l = F r a c C r i t i c a l 3 from day 84 to day 152 (30 January 2021);
  • F r a c C r i t i c a l = F r a c C r i t i c a l 4 from day 153 to day 200 (19 March 2021);
  • F r a c C r i t i c a l = F r a c C r i t i c a l 5 from day 201 onward.
Finally, the vaccination rate η is a piecewise constant and is set in order to resemble the gradually increasing trend of first doses injected, as shown in Figure 3a. Thus, η = [ 0 , 5.22 × 10 4 , 7.97 × 10 4 , 0.0027 , 0.0041 ] at days [ 0 , 118 , 154 , 181 , 212 ] , as depicted in Figure 3b.
The parameter vector to estimate for Umbria contains twenty-four model parameters and seven interventions parameters, i.e., p R 31 . As regards CRC, we set N S = 10 5 the number of samples in the parameter space, and we perform 10 iterations of the method. We repeat each iteration for 10 times, in order to ensure reliability of results. Table 1 shows the prior distribution chosen at the beginning of the calibration and the mode of the approximate posterior distribution computed by CRC in the 10th iteration for one of the realizations. The initial range of transmission rates is taken from [19]. For the intervention parameters, we suppose a range of variation between 0.1 and 0.9 if the corresponding event is supposed to curb the virus spread while we suppose a range between 0.4 and 1.5 if the associated event might foster the resurgence of new cases.
According to Table 1, CRC estimates that the spread of new SARS-CoV-2 lineages caused a percentage increase of 50.6% for the pre-symptomatic transmission rate and of 15.5% for the asymptomatic transmission rate. Consequently, the basic reproduction number R 0 is evaluated equal to 2.28 at the beginning of September and then goes up to 2.75 at the end of December. Figure 4 depicts the estimation of the time evolution for H, ICU and D variables, in comparison with the data.
Then, we simulate the evolution of the epidemic in the summer by comparing different vaccination schedules and the progressive loosening of restrictions, as shown in Table 2. We hypothesize three vaccine roll-outs, a slow one with 8 × 10 3 first doses of vaccine every day, a medium one with 12.5 × 10 3 , and a fast one with 18 × 10 3 per day. In parallel, we reduce restrictions, supposing a progressive reopening, divided in three main steps, according to the work in [38]:
  • 26 April 2021: reintroduction of the low-risk “yellow” zone;
  • 24 May 2021: curfew extension, gym reopening and restaurants with indoor seating;
  • 21 June 2021: curfew lifted and holiday season.
As before, we assume an intervention strategy with a mild, moderate, or high impact on the transmission parameters.
Figure 5, Figure 6 and Figure 7 show the evolution of the epidemic dynamics in all these nine possible scenarios until October 2021. Finally, Figure 8 reports the area plots for four scenarios chosen among the nine simulated, over a two-year time period in order to evaluate the long-term effects of vaccination and waning immunity. The four scenarios selected are Low/Low, High/Low, Low/Low, and High/High (see Table 2). In all cases, we evaluate the achievement of herd immunity, i.e., when the majority of the population is immune to the disease and the rate of infections goes down without restrictions. We define the 70% of the population as the herd immunity threshold, according to [39,40]. We consider to be immune from COVID-19 recovered people (class R), immune people (class I m ) and people who have received the second dose of vaccine ( V 2 ) as, at least in Italy, the so-called COVID-19 Green Pass is released 15 days after the first vaccine jab [41]. For Umbria, the model predicts that herd immunity is reached between the end of July and the beginning of August 2021 when 18 × 10 3 vaccine doses are administered per day (Low/High and High/High scenarios). On the other hand, with 8 × 10 3 vaccines per day, it is achieved at the beginning of September 2021 in the High/Low scenario while, in the Low/Low case, the percentage of immune people is stabilized at about 67%. In all cases, the number of hospitalizations becomes very small, without overwhelming the health care system.

3.3. Italy Case Study

As regards Italy, the model is calibrated from 1 September 2020 to 1 May 2021. According to the work in [32], initial conditions are S 0 = 10 5 E 0 , E 0 = ( 30,000 / N ) × 10 5 , P S , 0 = 20,000 , A 0 = 15,000 , M 0 = 26,271 , H 0 = 1437 , I C U 0 = 109 , R 0 = 208,201 , D 0 = 35,497 , V 1 , 0 = 0 , V 2 , 0 = 0 , I m 0 = 0 . Data are normalized over the Italian population N = 60 × 10 6 and multiplied by 10 5 . From the beginning of September 2020, the Italian Government implemented multiple containment measures, more and more restrictive as infections soar. In November, Italian regions were divided in three risk zones on the basis of contagion data. There are high-risk ’red’ zones where only essential movements are allowed. In medium-risk ’orange’ zones, movements are allowed only in the same municipality and bars and restaurants can do only takeaway. In moderate-risk ’yellow’ zones, restrictions are less stringent as, for example, all shops can be open and restaurants can serve people outdoors. Moreover, a nationwide curfew from 10 pm to 5 am was approved to limit night movements. A detailed description of all the restrictions adopted can be found in [42].
Since multiple containment measures were implemented by the Italian Government from the beginning of September 2021, we consider the most significant ones in the model:
(1)
14 September 2020 ( T l o c k , 1 ), school reopening;
(2)
6 November 2020 ( T l o c k , 2 ), introduction of a three-tier color coded system of restrictive measures, based on the risk profile of each region;
(3)
24 December 2020 ( T l o c k , 3 ), country-wide lockdown for Christmas holidays;
(4)
7 January 2021 ( T l o c k , 4 ), school reopening and easing of some restrictions after the country-wide red area;
(5)
15 March 2021 ( T l o c k , 5 ), removal of ’yellow’ zone in the color-coded system, leaving only medium and high risk zones.
Thus, the parameter vector s 0 = [ s 01 , s 02 , s 03 , s 04 , s 05 ] changes the transmission rate parameters in the following way:
b e , l o c k = b e , t < T l o c k , 1 b e · s 0 , i , T l o c k , i t < T l o c k , i + 1 i = 1 , . . . , 4 b e · s 0 , 5 t T l o c k , 5
b 0 , l o c k = b 0 , t < T l o c k , 1 b 0 · s 0 , i , T l o c k , i t < T l o c k , i + 1 i = 1 , . . . , 4 b 0 · s 0 , 5 t T l o c k , 5
As, in most of the Italian regions, the emergence of new lineages determined a growth of new hospitalization and deaths about a month later than Umbria (see Figure 2), we update parameters b e and b 0 on 19 January 2021 ( t v a r ). The fraction of patients in ICU is varied as follows: F r a c C r i t i c a l = F r a c C r i t i c a l 1 from day 0 (1 September 2020) to day 35 (5 October 2020), F r a c C r i t i c a l = F r a c C r i t i c a l 2 from day 36 to day 77 (16 November 2020), F r a c C r i t i c a l = F r a c C r i t i c a l 3 from day 78 to day 117 (26 December 2020), F r a c C r i t i c a l = F r a c C r i t i c a l 4 from day 118 onward. The vaccination rate η is set as η = [ 0 , 5.9 × 10 4 , 0.0018 , 0.0031 , 0.0044 ] at days [ 0 , 118 , 168 , 205 , 221 ] , as depicted in Figure 9.
The parameter vector to estimate contains twenty-three model parameters and five interventions parameters, i.e., p R 28 . Tuning parameters of CRC are set in the same way as Umbria, except for the number of iterations that is set to 11. The result of the calibration for H, ICU, and D state variables is shown in Figure 10. As for Umbria, CRC estimates a variation of the transmission rate parameters due to the new variants. The pre-symptomatic rate is characterized by a percentage increase of 87.3% while the asymptomatic rate undergoes a minimal decrease of 9.9%. Given these estimates, R 0 varies from an initial value of 1.94 in September to a value of 2.17 in January. As regards the other parameters, most of them are estimated with similar values for both Umbria and Italy, such as the pre-symptomatic period and the transmission rates of mild and hospitalized patients (see Table 1).
Finally, Figure 11, Figure 12 and Figure 13 depict the dynamics of the epidemic in the nine scenarios presented in Table 2. For Italy, the slow vaccination schedule is set equal to 5 × 10 5 first doses of vaccine every day, the medium one is 8 × 10 5 , and the fast one 10 6 per day. The intervention measures are implemented in the same way of Umbria. Figure 14 reports the area plots for the same four scenarios of Umbria, over a two-year time period. In case of fast vaccination, herd immunity is achieved at the end of August 2021 while in case of slow vaccination, the number of immune people is stable at 65% but with a negligible number of hospitalization and deaths.
As regards the computational cost, CRC takes around 20 minutes to complete one iteration. All the simulations are performed using Matlab (R2019a) on a Intel Core i7-4700HQ CPU, 2.40 GHz 8, 16-GB memory, Ubuntu 18.04 LTS (64 bit).

4. Discussion

This study highlights how the control of COVID-19 pandemic can be accomplished by a multi-strategy approach that combines high efficacy vaccines, social distancing, and isolation of detected cases.
Through model calibration with CRC, we are able to reproduce the second and third wave of the epidemic and understand the complex lineage turnover of COVID-19 in both presented case studies. First of all, CRC estimates similar values for the pre-symptomatic transmission rate b e in Italy and Umbria during the second wave, while the asymptomatic transmission rate b 0 is much higher in Umbria. These values explain the major incidence of new cases in Umbria during October and early November 2020. Indeed, at the end of October, the incidence over 10 5 inhabitants was 458.49 in Umbria and 279.72 in Italy [43,44]. As shown in Figure 2, also the number of patients in ICU in Umbria was over the median national range. The restrictive measures adopted between November and December helped in the containment of this critical scenario at a regional and national level, until the emergence of the new VOC. Our model confirms the high transmissibility of the B.1.1.7 and P.1 lineages, through the increase of transmission rate parameters. However, while CRC estimates a growth of parameter b e in both case studies, parameter b 0 is estimated to rise only in Umbria, between the second and third wave. This is due to the stronger circulation of the P.1 variant from the beginning of 2020, as stated also by the ISS [35]. This context, considering that the vaccination campaign was only at the beginning, has led to a rapid resurgence of cases and made Umbria one of the worst-affected regions in the country during the third wave. The ’red’ area imposed in the province of Perugia in February reduced virus transmission by 70% (parameter s 06 ). The removal of ’yellow’ zone and the prohibition of travel between regions has caused a decrease in transmission by 80% (parameter s 05 ) in the entire country. Thus, containment measures were effective, especially in reducing the spread of the P.1 variant from Umbria to the other regions.
We then simulate different scenarios to evaluate the effects of mass vaccination campaign at different rates, combined with waning immunity and gradual reopening. In most predictions, the epidemic diffusion is contained and hospitalizations are reduced in both Umbria and Italy. The gap between slow and fast vaccination is not particularly significant if the reopening policy is low or medium. Things change when an high strategy of reopening is adopted. At a medium and high vaccination speed, there is a minimum increase of H and ICU variable at the end of summer 2021. On the other hand, at a slow vaccination rate, the growth in hospitalization may be more substantial but still under the peak of the third wave. This is probably due to the reverse age order of the vaccination schedule, which has immunized most of the elderly and vulnerable people. Moreover, because of the presence of variants, in Umbria the rise of hospital admissions may cause new pressure on the regional healthcare system. Thus, it is important to highlight that during the first part of the mass vaccination roll-out, the use of NPIs is pivotal to avoid the circulation of variants and the emergence of possible immune escape lineages.
Over longer time scales, model predictions reveal that waning immunity and vaccination play a crucial role in the eradication of SARS-CoV-2. Seasonal vaccination at a constant rate will be probably required, in order to control the epidemic diffusion and prevent a new wave of hospitalizations. COVID-19 will most likely become a manageable infection that will continue to circulate but with smaller and rarer outbreaks. However, we still lack precise information on the duration of immunity and on the severity of second infections [16,45]. Moreover, the value of herd immunity threshold is still under study as it depends on population heterogeneity and virus transmission dynamics [46,47].
Finally, this study contains some limitations. Our SEIRL-V model is a compartmental model which does not take into account age classes and seasonality in the transmission rates, as it is common for most respiratory diseases. Furthermore, it would also be interesting to study how long term predictions are affected by the variation of vaccine and natural immunity.

5. Conclusions

Our work presents a new SEIRL-V model for exploring multiple epidemiological scenarios in the presence of new SARS-CoV-2 variants and of high-efficacy vaccines. The calibrated model reproduces the high transmissibility of new virus variants and underlines the need of maintaining social distancing and case isolation, particularly during the first phase of the vaccination campaign. Then, it shows how effective vaccines are crucial in the long-term control of COVID-19.

Author Contributions

Conceptualization, methodology, C.A., S.C. and F.B.; software, C.A.; validation, F.B.; formal analysis, C.A. and S.C.; writing—original draft preparation, C.A.; writing—review and editing, S.C. and F.B.; supervision, F.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found here: https://github.com/pcm-dpc/COVID-19, https://github.com/italia/covid19-opendata-vaccini (accessed on 2 May 2021).

Acknowledgments

We thank all the components of the COVID-19 epidemiological unit, Department of Health, Regional Government of Umbria (D.G.R. 206/2020, 25 June 2020). We also thank ICT4Life Srl for free support on mathematical modeling and for providing computational resources.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. CRC results for Umbria. The columns show the 60th, 70th, and 90th percentile of the probability density function (pdf) of the parameter vector returned by CRC in the last iteration, for one of the realizations.
Table A1. CRC results for Umbria. The columns show the 60th, 70th, and 90th percentile of the probability density function (pdf) of the parameter vector returned by CRC in the last iteration, for one of the realizations.
Parameter60th Percentile70th Percentile90th Percentile
b e , 1 [0.1483–0.1521][0.1462–0.154][0.1422–0.1581]
b 0 , 1 [0.3084–0.3173][0.3032–0.3232][0.2895–0.3331]
b e , 2 [0.2044–0.2377][0.1896–0.2609][0.1621–0.313]
b 0 , 2 [0.3392–0.3589][0.3299–0.3673][0.31–0.3883]
b 1 [0.0314–0.0365][0.0291–0.0387][0.0223–0.0441]
b 2 [0.0158–0.0195][0.0142–0.0218][0.0114–0.0272]
b 3 [0.0286–0.0342][0.0263–0.0379][0.0217–0.0461]
F r a c S e v e r e [0.0166–0.0175][0.0161–0.018][0.0148–0.0192]
F r a c C r i t i c a l 1 [0.0044–0.0046][0.0043–0.0047][0.0041–0.0049]
F r a c C r i t i c a l 2 [0.0051–0.0054][0.005–0.0056][0.0047–0.0059]
F r a c C r i t i c a l 3 [0.0039–0.0041][0.0038–0.0042][.0036–0.0044]
F r a c C r i t i c a l 4 [0.0048–0.0051][0.0047–0.0052][0.0046–0.0054]
F r a c C r i t i c a l 5 [0.0028–0.003][0.0027–0.0031][0.0026–0.0034]
F r a c A s y m [0.4738–0.4834][0.4684–0.4878][0.4567–0.4962]
I n c u b P e r i o d [4.4704–4.5473][4.429–4.591][4.3421–4.662]
D u r M i l d I n f [15.8483–16.2392][15.63–16.4292][15.2157–16.809]
D u r A s y m [10.9094–11.3187][10.7329–11.4892][10.3026–11.844]
D u r H o s p [12.9659–13.3531][12.8103–13.5196][12.33–13.8242]
T i m e I C U D e a t h [11.3651–11.5532][11.2718–11.6631][11.0916–11.8755]
P r o b D e a t h [28.5227–29.8384][27.5732–30.6969][25.865–32.129]
P r o b D e a t h H [21.9761–22.7784][21.5211–23.2579][20.6255–24.3682]
P r e s y m P e r i o d [0.5967–0.6039][0.5928–0.6085][0.5844–0.6163]
n[48.1783–51.8111][45.8733–53.8871][41.8768–57.764]
K[ 2.8576 × 10 4 3.8125 × 10 4 ][ 2.3307 × 10 4 4.3381 × 10 4 ][ 1.2627 × 10 4 5.4783 × 10 4 ]
s 01 [1.0424–1.0614][1.0331–1.0727][1.0110–1.0911]
s 02 [0.2722–0.2807][0.2663–0.2857][0.2562–0.2949]
s 03 [0.263–0.2746][0.2578–0.2802][0.2456–0.2929]
s 04 [0.4205–0.4297][0.4146–0.4346][0.4049–0.4447]
s 05 [0.5608–0.5818][0.5506–0.5922][0.5307–0.6165]
s 06 [0.2678–03279][0.2634–0.2839][0.2542–0.2944]
s 07 [0.3181–0.3279][0.3126–0.334][0.3044–0.344]
Table A2. CRC results for Italy. The columns show the 60th, 70th, and 90th percentile of the probability density function (pdf) of the parameter vector returned by CRC in the last iteration, for one of the realizations.
Table A2. CRC results for Italy. The columns show the 60th, 70th, and 90th percentile of the probability density function (pdf) of the parameter vector returned by CRC in the last iteration, for one of the realizations.
Parameter60th Percentile70th Percentile90th Percentile
b e , 1 [0.1467–0.1559][0.1418–0.1609][0.1318–0.1721]
b 0 , 1 [0.1933–0.2016][0.1901–0.2054][0.1833–0.214]
b e , 2 [0.2686–0.2912][0.2587–0.3063][0.2393–0.3451]
b 0 , 2 [0.1564–0.1711][0.1493–0.1792][0.1366–0.205]
b 1 [0.0151–0.0189][0.0135–0.0208][0.0112–0.0261]
b 2 [0.057–0.0608][0.0552–0.0627][0.0517–0.0677]
b 3 [0.0157–0.0196][0.0141–0.0218][0.0112–0.0267]
F r a c S e v e r e [0.0246–0.0258][0.024–0.0264][0.0221–0.0283]
F r a c C r i t i c a l 1 [0.0053–0.0054][0.0052–0.0055][0.0051–0.0057]
F r a c C r i t i c a l 2 [0.0066–0.0069][0.0064–0.007][0.0061–0.0073]
F r a c C r i t i c a l 3 [0.0033–0.0035][0.0033–0.0036][0.0031–0.0039]
F r a c C r i t i c a l 4 [0.0044–0.0045][0.0043–0.0046][0.0041–0.0049]
F r a c A s y m [0.4622–0.4683][0.4592–0.4712][0.4529–0.4772]
I n c u b P e r i o d [5.1812–5.2188][5.16–5.2379][5.1188–5.2792]
D u r M i l d I n f [9.3392–9.9241][9.0192–10.2157][8.366–10.7008]
D u r A s y m [14.6655–15.0305][14.4845–15.2173][14.1736–15.7103]
D u r H o s p [15.3648–15.5912][15.2701–15.7051][15.0902–15.8961]
T i m e I C U D e a t h [12.3828–12.5781][12.2907–12.673][12.0992–12.8822]
P r o b D e a t h [34.7139–35.4889][34.3299–35.9058][33.4267–36.5895]
P r o b D e a t h H [23.6944–24.3566][23.2392–24.8239][22.1059–25.5674]
P r e s y m P e r i o d [0.615–0.6227][0.6114–0.6274][0.6033–0.6363]
n[50.9573–53.9461][49.4666–55.479][46.4324–58.8729]
K[ 4.321 × 10 4 4.9343 × 10 4 ][ 3.9531 × 10 4 5.2406 × 10 4 ][ 3.3381 × 10 4 5.7296 × 10 4 ]
s 01 [1.0205–1.0297][1.0153–1.0359][1.0055–1.0442]
s 02 [0.3–0.3233][0.289–0.3369][0.2653–0.369]
s 03 [0.242–0.2708][0.2305–0.2842][0.2099–03254]
s 04 [0.6434–0.6667][0.6337–0.6829][0.612–0.7307]
s 05 [0.1744–0.2092][0.1614–0.2262][0.1344–0.2704]

References

  1. WHO. COVID-19 Dashboard; World Health Organization: Geneva, Switzerland, 2020; Available online: https://covid19.who.int/ (accessed on 15 June 2021).
  2. Vinceti, M.; Filippini, T.; Rothman, K.J.; Di Federico, S.; Orsini, N. SARS-CoV-2 infection incidence during the first and second COVID-19 waves in Italy. Environ. Res. 2021, 197, 111097. [Google Scholar] [CrossRef]
  3. Trasmissione Documento “Prevenzione e Risposta a Covid-19: Evoluzione Della Strategia e Pianificazione Nella Fase di Transizione Per il Periodo Autunno-Invernale. Available online: https://www.trovanorme.salute.gov.it/norme/renderNormsanPdf?anno=2020&codLeg=76597&parte=1%20&serie=null (accessed on 15 October 2020).
  4. Giordano, G.; Colaneri, M.; Di Filippo, A.; Blanchini, F.; Bolzern, P.; De Nicolao, G.; Sacchi, P.; Colaneri, P.; Bruno, R. Modeling vaccination rollouts, SARS-CoV-2 variants and the requirement for non-pharmaceutical interventions in Italy. Nat. Med. 2021, 27, 993–998. [Google Scholar] [CrossRef]
  5. Di Giallonardo, F.; Puglia, I.; Curini, V.; Cammà, C.; Mangone, I.; Calistri, P.; Cobbin, J.C.; Holmes, E.C.; Lorusso, A. Emergence and spread of SARS-CoV-2 lineages B. 1.1. 7 and P. 1 in Italy. Viruses 2021, 13, 794. [Google Scholar] [CrossRef]
  6. Davies, N.G.; Abbott, S.; Barnard, R.C.; Jarvis, C.I.; Kucharski, A.J.; Munday, J.D.; Pearson, C.A.; Russell, T.W.; Tully, D.C.; Washburne, A.D.; et al. Estimated transmissibility and impact of SARS-CoV-2 lineage B. 1.1. 7 in England. Science 2021, 372, 6538. [Google Scholar] [CrossRef]
  7. Faria, N.R.; Mellan, T.A.; Whittaker, C.; Claro, I.M.; Candido, D.d.S.; Mishra, S.; Crispim, M.A.; Sales, F.C.; Hawryluk, I.; McCrone, J.T.; et al. Genomics and epidemiology of the P. 1 SARS-CoV-2 lineage in Manaus, Brazil. Science 2021, 372, 815–821. [Google Scholar] [CrossRef]
  8. Prevalenza delle VOC (Variant of Concern) del virus SARS-CoV-2 in Italia: Blineage B.1.1.7, P.1 e B.1.351, e Altre Varianti (Variant of Interest, VOI) Tra Cui Lineage P.2 e Lineage B.1.525 (Indagine del 20 April 2021). Available online: https://www.iss.it/documents/20126/0/Relazione+tecnica+indagine+rapida+varianti+SARS-COV-2.pdf/f425e647-efdb-3f8c-2f86-87379d56ce8d?t=1620232350272 (accessed on 26 April 2021).
  9. COVID: Bolzano, Umbria Likely to Become Red Zones. Available online: https://www.ansa.it/english/news/politics/2021/02/19/covid-bolzano-umbria-likely-to-become-red-zones_b92c110b-a505-4100-a241-7ee2d459e8a0.html (accessed on 20 February 2021).
  10. Le, T.T.; Andreadakis, Z.; Kumar, A.; Román, R.G.; Tollefsen, S.; Saville, M.; Mayhew, S. The COVID-19 vaccine development landscape. Nat. Rev. Drug Discov. 2020, 19, 305–306. [Google Scholar] [CrossRef]
  11. Polack, F.P.; Thomas, S.J.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Pérez Marc, G.; Moreira, E.D.; Zerbini, C.; et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N. Engl. J. Med. 2020, 383, 2603–2615. [Google Scholar] [CrossRef]
  12. Baden, L.R.; El Sahly, H.M.; Essink, B.; Kotloff, K.; Frey, S.; Novak, R.; Diemert, D.; Spector, S.A.; Rouphael, N.; Creech, C.B.; et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. N. Engl. J. Med. 2021, 384, 403–416. [Google Scholar] [CrossRef] [PubMed]
  13. Voysey, M.; Clemens, S.A.C.; Madhi, S.A.; Weckx, L.Y.; Folegatti, P.M.; Aley, P.K.; Angus, B.; Baillie, V.L.; Barnabas, S.L.; Bhorat, Q.E.; et al. Single-dose administration and the influence of the timing of the booster dose on immunogenicity and efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine: A pooled analysis of four randomised trials. Lancet 2021, 397, 881–891. [Google Scholar] [CrossRef]
  14. Sadoff, J.; Gray, G.; Vandebosch, A.; Cárdenas, V.; Shukarev, G.; Grinsztejn, B.; Goepfert, P.A.; Truyers, C.; Fennema, H.; Spiessens, B.; et al. Safety and efficacy of single-dose Ad26. COV2. S vaccine against Covid-19. N. Engl. J. Med. 2021, 384, 2187–2201. [Google Scholar] [CrossRef] [PubMed]
  15. Piano Vaccini Anti Covid-19. Available online: https://www.salute.gov.it/portale/nuovocoronavirus/dettaglioContenutiNuovo-Coronavirus.jsp?lingua=italiano&id=5452&area=nuovoCoronavirus&menu=vuoto (accessed on 20 December 2020).
  16. Moore, S.; Hill, E.M.; Tildesley, M.J.; Dyson, L.; Keeling, M.J. Vaccination and non-pharmaceutical interventions for COVID-19: A mathematical modelling study. Lancet Infect. Dis. 2021, 21, 793–802. [Google Scholar] [CrossRef]
  17. Bubar, K.M.; Reinholt, K.; Kissler, S.M.; Lipsitch, M.; Cobey, S.; Grad, Y.H.; Larremore, D.B. Model-informed COVID-19 vaccine prioritization strategies by age and serostatus. Science 2021, 371, 916–921. [Google Scholar] [CrossRef] [PubMed]
  18. Saad-Roy, C.M.; Wagner, C.E.; Baker, R.E.; Morris, S.E.; Farrar, J.; Graham, A.L.; Levin, S.A.; Mina, M.J.; Metcalf, C.J.E.; Grenfell, B.T. Immune life history, vaccination, and the dynamics of SARS-CoV-2 over the next 5 years. Science 2020, 370, 811–818. [Google Scholar] [CrossRef] [PubMed]
  19. Antonini, C.; Calandrini, S.; Stracci, F.; Dario, C.; Bianconi, F. Mathematical Modeling and Robustness Analysis to Unravel COVID-19 Transmission Dynamics: The Italy Case. Biology 2020, 9, 394. [Google Scholar] [CrossRef] [PubMed]
  20. Bianconi, F.; Antonini, C.; Tomassoni, L.; Valigi, P. Robust calibration of high dimension nonlinear dynamical models for omics data: An application in cancer systems biology. IEEE Trans. Control Syst. Technol. 2018, 28, 196–207. [Google Scholar] [CrossRef]
  21. Bianconi, F.; Antonini, C.; Tomassoni, L.; Valigi, P. Application of conditional robust calibration to ordinary differential equations models in computational systems biology: A comparison of two sampling strategies. IET Syst. Biol. 2020, 14, 107–119. [Google Scholar] [CrossRef] [PubMed]
  22. Bianconi, F.; Tomassoni, L.; Antonini, C.; Valigi, P. A New Bayesian Methodology for Nonlinear Model Calibration in Computational Systems Biology. Front. Appl. Math. Stat. 2020, 6, 25. [Google Scholar] [CrossRef]
  23. López, L.; Rodo, X. A modified SEIR model to predict the COVID-19 outbreak in Spain and Italy: Simulating control scenarios and multi-scale epidemics. Results Phys. 2020, 21, 103746. [Google Scholar] [CrossRef]
  24. Covid-19 Opendata Vaccini, GitHub Repository. Available online: https://github.com/italia/covid19-opendata-vaccini (accessed on 1 June 2021).
  25. Dispinseri, S.; Secchi, M.; Pirillo, M.F.; Tolazzi, M.; Borghi, M.; Brigatti, C.; De Angelis, M.L.; Baratella, M.; Bazzigaluppi, E.; Venturi, G.; et al. Neutralizing antibody responses to SARS-CoV-2 in symptomatic COVID-19 is persistent and critical for survival. Nat. Commun. 2021, 12, 1–12. [Google Scholar] [CrossRef]
  26. Pfizer and BioNTech Initiate a Study as Part of Broad Development Plant o Evaluate Covid-19 Booster and New Variants. Available online: https://www.pfizer.com/news/press-release/press-release-detail/pfizer-and-biontech-initiate-study-part-broad-development (accessed on 27 February 2021).
  27. Thompson, M.G.; Burgess, J.L.; Naleway, A.L.; Tyner, H.L.; Yoon, S.K.; Meece, J.; Olsho, L.E.; Caban-Martinez, A.J.; Fowlkes, A.; Lutrick, K.; et al. Interim estimates of vaccine effectiveness of BNT162b2 and mRNA-1273 COVID-19 vaccines in preventing SARS-CoV-2 infection among health care personnel, first responders, and other essential and frontline workers—Eight US locations, December 2020–March 2021. Morb. Mortal. Wkly. Rep. 2021, 70, 495. [Google Scholar] [CrossRef]
  28. Task force COVID-19 del Dipartimento Malattie Infettive e Servizio di Informatica, Istituto Superiore di Sanità. Epidemia COVID-19. Aggiornamento Nazionale: 14 Luglio 2021. Available online: https://www.epicentro.iss.it/coronavirus/bollettino/Bollettino-sorveglianza-integrata-COVID-19_14-luglio-2021.pdf (accessed on 15 July 2021).
  29. Mateo-Urdiales, A.; Alegiani, S.S.; Fabiani, M.; Pezzotti, P.; Filia, A.; Massari, M.; Riccardo, F.; Tallon, M.; Proietti, V.; Del Manso, M.; et al. Risk of SARS-CoV-2 infection and subsequent hospital admission and death at different time intervals since first dose of COVID-19 vaccine administration, Italy, 27 December 2020 to mid-April 2021. Eurosurveillance 2021, 26, 2100507. [Google Scholar] [CrossRef]
  30. Nguyen, L.K.; Kulasiri, D. On the functional diversity of dynamical behaviour in genetic and metabolic feedback systems. BMC Syst. Biol. 2009, 3, 51. [Google Scholar] [CrossRef] [Green Version]
  31. Fosu, G.O.; Akweittey, E.; Adu-Sackey, A. Next-generation matrices and basic reproductive numbers for all phases of the Coronavirus disease. Open J. Math. Sci. 2020, 4, 261–272. [Google Scholar] [CrossRef]
  32. Dipartimento Protezione Civile, GitHub Repository. Available online: https://github.com/pcm-dpc/COVID-19 (accessed on 2 May 2021).
  33. SARS-CoV-2 Variant Classifications and Definitions. Available online: https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/variant-surveillance/variant-info.html#Concern (accessed on 15 May 2021).
  34. Pearson, C.A.; Russell, T.W.; Davies, N.; Kucharski, A.J.; CMMID COVID-19 working group; Edmunds, W.J.; Eggo, R.M. Estimates of Severity and Transmissibility of Novel South Africa SARS-CoV-2 Variant 501Y. V2. Available online: https://cmmid.github.io/topics/covid19/sa-novel-variant.html (accessed on 1 May 2021).
  35. Prevalenza Della Variante VOC 202012/01, Lineage B.1.1.7 in Italia, Studio di Prevalenza 4–5 Febbraio 2021. Available online: https://www.iss.it/documents/20126/0/Relazione+tecnica+prima+indagine+flash+VOC+UK+12.2.2021_rev+finale.pdf/636b3651-a358-468e-24d5-65364a004994?t=1613400983576 (accessed on 10 February 2021).
  36. Prevalenza Delle Varianti VOC 202012/01 (Lineage B.1.1.7), P.1, e 501.V2 (Lineage B.1.351) in Italia Indagine del 18 Febbraio 2021. Available online: https://www.iss.it/documents/20126/0/Relazione+tecnica+terza+indagine+flash+per+le+varianti+del+virus+SARS-CoV-2+%282%29.pdf/a03f33e6-d775-9ab0-b0ce-9cdd289c711d?t=1614707205598 (accessed on 20 February 2021).
  37. Ordinanza della Presidente Della Giunta Regionale, 19 Ottobre 2020, n. 65. Available online: https://www.regione.umbria.it/documents/18/24917656/ORDINANZA_65.pdf/80514ae4-6ae5-43f0-a0d7-43e23dae6194 (accessed on 20 October 2020).
  38. Riaperture Italia, il Calendario del Governo. Available online: https://www.adnkronos.com/riaperture-italia-il-calendario-del-governo_4GbnBUMmxOnrDY2YEKt5Jv (accessed on 17 May 2021).
  39. Anderson, R.M.; Vegvari, C.; Truscott, J.; Collyer, B.S. Challenges in creating herd immunity to SARS-CoV-2 infection by mass vaccination. Lancet 2020, 396, 1614–1616. [Google Scholar] [CrossRef]
  40. D’Souza, G.; Dowdy, D. What’s herd immunity and how can we achieve it with COVID-19. Johns Hopkins Sch. Public Health Expert Insights. 2020, 10. Available online: https://www.jhsph.edu/covid-19/articles/achieving-herd-immunity-with-covid19.html (accessed on 1 June 2021).
  41. Certificazioni Verdi Covid-19. Available online: https://www.salute.gov.it/portale/nuovocoronavirus/dettaglioFaqNuovo-Coronavirus.jsp?lingua=italiano&id=264 (accessed on 1 June 2021).
  42. COVID-19: What You Have to Know about It. Available online: https://www.inmp.it/eng/CoViD-19-what-you-have-to-know-about-it/Covid-19-Red-zone (accessed on 15 January 2021).
  43. Epidemia COVID-19 Aggiornamento Nazionale 27 Ottobre 2020—Ore 11:00. Available online: https://www.epicentro.iss.it/coronavirus/bollettino/Bollettino-sorveglianza-integrata-COVID-19_27-ottobre-2020.pdf (accessed on 31 October 2020).
  44. Epidemia COVID-19 Aggiornamento Nazionale 18 Novembre 2020—Ore 11:00. Available online: https://www.epicentro.iss.it/coronavirus/bollettino/Bollettino-sorveglianza-integrata-COVID-19_18-novembre-2020.pdf (accessed on 21 November 2020).
  45. Ledford, H. COVID reinfections are unusual-but could still help the virus to spread. Nature 2021. [Google Scholar] [CrossRef]
  46. Britton, T.; Ball, F.; Trapman, P. A mathematical model reveals the influence of population heterogeneity on herd immunity to SARS-CoV-2. Science 2020, 369, 846–849. [Google Scholar] [CrossRef]
  47. Fontanet, A.; Cauchemez, S. COVID-19 herd immunity: Where are we? Nat. Rev. Immunol. 2020, 20, 583–584. [Google Scholar] [CrossRef]
Figure 1. Graphic representation of the SEIRL-V model. Clinical stages for the population are as follows: Susceptible (S), Exposed ( E ν ), Presymptomatic ( P S , ν ), Asymptomatic (A), Recovered (R), Mild infection (M), Severe infection (H), Critical infection ( I C U ), Dead (D), Vaccinated 1st dose ( V 1 ) , Vaccinated 2nd dose ( V 2 ) , and Immunized ( I m ). The intervention measures are represented by L.
Figure 1. Graphic representation of the SEIRL-V model. Clinical stages for the population are as follows: Susceptible (S), Exposed ( E ν ), Presymptomatic ( P S , ν ), Asymptomatic (A), Recovered (R), Mild infection (M), Severe infection (H), Critical infection ( I C U ), Dead (D), Vaccinated 1st dose ( V 1 ) , Vaccinated 2nd dose ( V 2 ) , and Immunized ( I m ). The intervention measures are represented by L.
Vaccines 09 00915 g001
Figure 2. Comparison of hospitalization and ICU admissions in Umbria (light blue line) and Italy (red line) from 1 September until 1 May 2021. (a) Daily hospitalizations normalized over the whole population (∼ 882,000 for Umbria and ∼60 million for Italy) and multiplied by 10 5 . (b) Daily ICU admissions normalized over the whole population and multiplied by 10 5 .
Figure 2. Comparison of hospitalization and ICU admissions in Umbria (light blue line) and Italy (red line) from 1 September until 1 May 2021. (a) Daily hospitalizations normalized over the whole population (∼ 882,000 for Umbria and ∼60 million for Italy) and multiplied by 10 5 . (b) Daily ICU admissions normalized over the whole population and multiplied by 10 5 .
Vaccines 09 00915 g002
Figure 3. Vaccination campaign in Umbria. (a) Number of first (light blue) and second (blue) doses injected every day. (b) Profile of the evolution of the vaccination rate η chosen for model calibration.
Figure 3. Vaccination campaign in Umbria. (a) Number of first (light blue) and second (blue) doses injected every day. (b) Profile of the evolution of the vaccination rate η chosen for model calibration.
Vaccines 09 00915 g003
Figure 4. Umbria. Time behavior of H, ICU and D variables using as parameter vector the final mode vector computed by CRC (black line) (see Table 1); dots are the public data available at [32]. Both data and simulations are in log-scale, normalized over the population of Umbria (∼ 882,000 ) and multiplied by 10 5 . The colored area represents the variation of the temporal behavior when the parameter vector varies between the 60th, 70th, and 90th percentile of its conditional probability density function (pdf) (see Table A1).
Figure 4. Umbria. Time behavior of H, ICU and D variables using as parameter vector the final mode vector computed by CRC (black line) (see Table 1); dots are the public data available at [32]. Both data and simulations are in log-scale, normalized over the population of Umbria (∼ 882,000 ) and multiplied by 10 5 . The colored area represents the variation of the temporal behavior when the parameter vector varies between the 60th, 70th, and 90th percentile of its conditional probability density function (pdf) (see Table A1).
Vaccines 09 00915 g004
Figure 5. Projections of the epidemic evolution with a vaccination schedule of 8000 first doses of vaccines per day in Umbria (slow vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Figure 5. Projections of the epidemic evolution with a vaccination schedule of 8000 first doses of vaccines per day in Umbria (slow vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Vaccines 09 00915 g005
Figure 6. Projections of the epidemic evolution with a vaccination schedule of 12,500 first doses of vaccines per day in Umbria (medium vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Figure 6. Projections of the epidemic evolution with a vaccination schedule of 12,500 first doses of vaccines per day in Umbria (medium vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Vaccines 09 00915 g006
Figure 7. Projections of the epidemic evolution with a vaccination schedule of 18,000 first doses of vaccines per day in Umbria (fast vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Figure 7. Projections of the epidemic evolution with a vaccination schedule of 18,000 first doses of vaccines per day in Umbria (fast vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Vaccines 09 00915 g007
Figure 8. Area plots of model variables to compare the long-term evolution of the epidemic dynamics in Umbria. (a) 8000 first doses every day and low values for b e and b 0 (Low/Low). (b) 8000 first doses every day and high values for b e and b 0 (High/Low). (c) 18,000 first doses every day and low values for b e and b 0 (High/Low). (d) 18,000 first doses every day and high values for b e and b 0 (High/High).
Figure 8. Area plots of model variables to compare the long-term evolution of the epidemic dynamics in Umbria. (a) 8000 first doses every day and low values for b e and b 0 (Low/Low). (b) 8000 first doses every day and high values for b e and b 0 (High/Low). (c) 18,000 first doses every day and low values for b e and b 0 (High/Low). (d) 18,000 first doses every day and high values for b e and b 0 (High/High).
Vaccines 09 00915 g008
Figure 9. Vaccination campaign in Italy. (a) Number of first (light blue) and second (blue) doses injected every day. (b) Profile of the evolution of the vaccination rate η chosen for model calibration.
Figure 9. Vaccination campaign in Italy. (a) Number of first (light blue) and second (blue) doses injected every day. (b) Profile of the evolution of the vaccination rate η chosen for model calibration.
Vaccines 09 00915 g009
Figure 10. Italy. Time behavior of H, ICU, and D variables using as parameter vector the final mode vector computed by CRC (black line) (see Table 1); dots are the public data available in [32]. Both data and simulations are in log-scale, normalized over the population of Italy (∼60 million) and multiplied by 100,000 . The colored area represents the variation of the temporal behavior when the parameter vector varies between the 60th, 70th and 90th percentile of its conditional pdf (see Table A2).
Figure 10. Italy. Time behavior of H, ICU, and D variables using as parameter vector the final mode vector computed by CRC (black line) (see Table 1); dots are the public data available in [32]. Both data and simulations are in log-scale, normalized over the population of Italy (∼60 million) and multiplied by 100,000 . The colored area represents the variation of the temporal behavior when the parameter vector varies between the 60th, 70th and 90th percentile of its conditional pdf (see Table A2).
Vaccines 09 00915 g010
Figure 11. Projections of the epidemic evolution with a vaccination schedule of 500,000 first doses of vaccines per day in Italy (slow vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Figure 11. Projections of the epidemic evolution with a vaccination schedule of 500,000 first doses of vaccines per day in Italy (slow vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Vaccines 09 00915 g011
Figure 12. Projections of the epidemic evolution with a vaccination schedule of 800,000 first doses of vaccines per day in Italy (medium vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Figure 12. Projections of the epidemic evolution with a vaccination schedule of 800,000 first doses of vaccines per day in Italy (medium vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Vaccines 09 00915 g012
Figure 13. Projections of the epidemic evolution with a vaccination schedule of 1,000,000 first doses of vaccines per day in Italy (fast vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Figure 13. Projections of the epidemic evolution with a vaccination schedule of 1,000,000 first doses of vaccines per day in Italy (fast vaccination). Each line corresponds to a different reopening strategy, i.e., different values of transmission rate parameters b e and b 0 (yellow for high values, blue for medium values, and pink for low values).
Vaccines 09 00915 g013
Figure 14. Area plots of model variables to compare the long-term evolution of the epidemic dynamics in Italy. (a) 500,000 first doses every day and low values for b e and b 0 (Low/Low). (b) 500,000 first doses every day and high values for b e and b 0 (Low/High). (c) 1,000,000 first doses every day and low values for b e and b 0 (High/Low). (d) 1,000,000 first doses every day and high values for b e and b 0 (High/High).
Figure 14. Area plots of model variables to compare the long-term evolution of the epidemic dynamics in Italy. (a) 500,000 first doses every day and low values for b e and b 0 (Low/Low). (b) 500,000 first doses every day and high values for b e and b 0 (Low/High). (c) 1,000,000 first doses every day and low values for b e and b 0 (High/Low). (d) 1,000,000 first doses every day and high values for b e and b 0 (High/High).
Vaccines 09 00915 g014
Table 1. CRC results for Umbria and Italy. The second column shows the prior distribution of parameters, set at the beginning of the first CRC iteration. The third and fourth columns show, respectively, the mode vector of f P | P O , ϵ in one of the 10 final realizations for Umbria and Italy. Note that the pre-symptomatic period (PresymPeriod) is supposed to be a percentage of the incubation period (IncubPeriod).
Table 1. CRC results for Umbria and Italy. The second column shows the prior distribution of parameters, set at the beginning of the first CRC iteration. The third and fourth columns show, respectively, the mode vector of f P | P O , ϵ in one of the 10 final realizations for Umbria and Italy. Note that the pre-symptomatic period (PresymPeriod) is supposed to be a percentage of the incubation period (IncubPeriod).
ParameterPriorUmbria p mode Italy p mode
b e , 1 log-U(0.01,1)0.14420.1342
b 0 , 1 log-U(0.01,1)0.31780.2109
b e , 2 log-U(0.01,1)0.21720.2512
b 0 , 2 log-U(0.01,1)0.36720.19
b 1 log-U(0.001,1)0.02690.0120
b 2 log-U(0.001,1)0.01190.0516
b 3 log-U(0.001,1)0.02600.0145
F r a c S e v e r e log-U(0.01,0.08)0.01820.0253
F r a c C r i t i c a l 1 log-U(0.001,0.02)0.00410.005
F r a c C r i t i c a l 2 log-U(0.001,0.02)0.00550.007
F r a c C r i t i c a l 3 log-U(0.001,0.02)0.00450.0035
F r a c C r i t i c a l 4 log-U(0.001,0.02)0.00530.0048
F r a c C r i t i c a l 5 log-U(0.001,0.02)0.0033-
F r a c A s y m U(0.2,0.7)0.4880.4618
I n c u b P e r i o d U(4,6)4.63895.2668
D u r M i l d I n f U(5,30)15.61579.8982
D u r A s y m U(5,20)10.701414.5149
D u r H o s p U(4,30)13.221415.6204
T i m e I C U D e a t h U(4,30)11.160812.6742
P r o b D e a t h U(10,90)31.062134.7989
P r o b D e a t h H U(10,90)22.208525.3705
P r e s y m P e r i o d log-U(0.5,0.9)0.60750.637
nU(1,100)47.172747.1717
KU(1, 10 5 ) 2.48 × 10 4 4.44 × 10 4
s 01 log-U(0.4,1.5)1.07291.0409
s 02 log-U(0.1,0.9)0.27050.3095
s 03 log-U(0.1,0.9)0.28150.2634
s 04 log-U(0.4,1.5)0.4320.6842
s 05 log-U(0.4,1.5)0.58050.1837
s 06 log-U(0.1,0.9)0.2952-
s 07 log-U(0.1,0.9)0.3077-
Table 2. Future scenarios simulated for Umbria and Italy through variation of the vaccination rate and of intervention parameters. The three values on the first column represent the increase of transmission parameters on 26 April, 24 May, and 21 June 2021, respectively. The first row indicates the number of first doses of vaccine per day.
Table 2. Future scenarios simulated for Umbria and Italy through variation of the vaccination rate and of intervention parameters. The three values on the first column represent the increase of transmission parameters on 26 April, 24 May, and 21 June 2021, respectively. The first row indicates the number of first doses of vaccine per day.
Vaccination Rate
UmbriaItaly
8 × 10 3 12.5 × 10 3 18 × 10 3 5 × 10 5 8 × 10 5 10 6
Intervention[0.4–0.6–0.8]Low/LowLow/MediumLow/HighLow/LowLow/MediumLow/High
[0.6–0.8–1]Medium/LowMedium/MediumMedium/HighMedium/LowMedium/MediumMedium/High
[0.8–1–1.2]High/LowHigh/MediumHigh/HighHigh/LowHigh/MediumHigh/High
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Antonini, C.; Calandrini, S.; Bianconi, F. A Modeling Study on Vaccination and Spread of SARS-CoV-2 Variants in Italy. Vaccines 2021, 9, 915. https://doi.org/10.3390/vaccines9080915

AMA Style

Antonini C, Calandrini S, Bianconi F. A Modeling Study on Vaccination and Spread of SARS-CoV-2 Variants in Italy. Vaccines. 2021; 9(8):915. https://doi.org/10.3390/vaccines9080915

Chicago/Turabian Style

Antonini, Chiara, Sara Calandrini, and Fortunato Bianconi. 2021. "A Modeling Study on Vaccination and Spread of SARS-CoV-2 Variants in Italy" Vaccines 9, no. 8: 915. https://doi.org/10.3390/vaccines9080915

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop