Next Article in Journal
Laboratory Results of a Real-Time SHM Integrated System on a P180 Full-Scale Wing-Box Section
Next Article in Special Issue
Alcohol Vapor Sensor Based on Quasi-2D Nb2O5 Derived from Oxidized Nb2CTz MXenes
Previous Article in Journal
Preliminary Test for 3D Surface Strain Measurement in the Tower and Foundation of Offshore Wind Turbines Using DOFS
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 23
Issue 15
10.3390/s23156736
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Perspective

Implementing Wearable Sensors for Clinical Application at a Surgical Ward: Points to Consider before Starting

by
Rianne van Melzen
1,*,†,
Marjolein E. Haveman
2,†,
Richte C. L. Schuurmann
1,
Michel M. R. F. Struys
2 and
Jean-Paul P. M. de Vries
1
1
Division of Vascular Surgery, Department of Surgery, University Medical Center Groningen, University of Groningen, 9713 GZ Groningen, The Netherlands
2
Department of Anesthesiology, University Medical Center Groningen, University of Groningen, 9713 GZ Groningen, The Netherlands
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Sensors 2023, 23(15), 6736; https://doi.org/10.3390/s23156736
Submission received: 9 June 2023 / Revised: 25 July 2023 / Accepted: 26 July 2023 / Published: 27 July 2023
(This article belongs to the Special Issue Clinical Application of Electronic Noses and Biosensors)
Browse Figure
Versions Notes

Abstract

:
Incorporating technology into healthcare processes is necessary to ensure the availability of high-quality care in the future. Wearable sensors are an example of such technology that could decrease workload, enable early detection of patient deterioration, and support clinical decision making by healthcare professionals. These sensors unlock continuous monitoring of vital signs, such as heart rate, respiration rate, blood oxygen saturation, temperature, and physical activity. However, broad and successful application of wearable sensors on the surgical ward is currently lacking. This may be related to the complexity, especially when it comes to replacing manual measurements by healthcare professionals. This report provides practical guidance to support peers before starting with the clinical application of wearable sensors in the surgical ward. For this purpose, the Non-Adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework of technology adoption and innovations in healthcare organizations is used, combining existing literature and our own experience in this field over the past years. Specifically, the relevant topics are discussed per domain, and key lessons are subsequently summarized.

1. Introduction

The World Health Organization forecasts increasing global demand for healthcare and social care personnel by 2030 [1]. Additionally, the COVID-19 pandemic has exacerbated the nurse shortage globally [2]. Incorporating technology into healthcare processes is necessary to continue the provision of high-quality care in the future, especially with the increase of aged, multimorbid, and frail patients. An example of a patient population where this applies is surgical patients who are at high risk of postoperative complications [3].
In the postoperative phase, patients are classically referred from high-care units, such as the intensive care unit (ICU), to low-care settings, such as the surgical ward. In high- or medium-care units, patients’ vital signs are generally continuously monitored, sometimes with invasive means. This level of care and monitoring demands a high nurse-to-patient ratio, and, therefore, patients are transferred to the ward as soon as possible when the risks of acute events are low enough. On the ward, nurses typically measure vital signs manually every 4 to 8 h. Scoring systems, such as the Modified Early Warning Score (MEWS) [3], are calculated based on nurse observations to identify the risk of deterioration and, eventually, to scale up the level of care. However, manual intermittent monitoring by nurses could cause delays in the detection of postoperative deterioration, is time consuming, and is not always accurate or registered completely [4].
Conversely, technological developments enable continuous wireless monitoring of vital signs and physical activity of patients with wearable sensors. Wearable sensors can unlock vital signs mainly by photoplethysmography (PPG), an optical technique for blood volume variation measurements, or electrocardiography (ECG). Heart rate is the most commonly measured vital sign and is often measured accurately by both techniques [5,6,7,8]. Respiration rate can be computed from PPG or ECG signals by algorithms based on amplitude and frequency modulation, although, in general, the performance of these algorithms is better based on ECG than on PPG [9]. Nevertheless, PPG allows the measurement of blood oxygen saturation (SpO2) by pulse oximetry and noninvasive calculation of blood pressure by pulse wave transit time and pulse wave analysis [10]. Furthermore, the (skin) temperature can be derived from negative temperature coefficient thermistors and physical activity from accelerometry. The market is still evolving because ideal wearable sensors must be able to measure reliably, be easy to wear (lightweight) and easy to use, be low in cost, have a long battery life, and enable the patient to be ambulant [11].
Integrating wearable sensors in clinical practice, specifically in the surgical ward, could be beneficial in several ways. First, the workload of health care professionals could be reduced by replacing intermittent manual measurements of vital signs with continuous vital sign monitoring. Second, continuous monitoring of vital signs and physical activity may assist healthcare professionals in the early detection of patient deterioration. Third, wearable sensors may contribute to the evaluation of patient recovery and support healthcare professionals in decision making [12].
Although the use of wearable sensors in the surgical ward has great potential, research on the subject has mostly been restricted to limited sample sizes. Recently, Leenen et al. reviewed the validity, feasibility, and clinical and cost outcomes of available sensors for continuous monitoring of at least two vital signs in hospitalized patients [13]. Of the 13 included sensors from 10 different manufacturers in their review, only three comprised the wearable sensors that were used on a general ward. They concluded that research on this topic is mainly still in the validation and feasibility phase [13]. Moreover, a recent meta-analysis evaluated the effect of wearable sensors on the detection of deterioration and related clinical outcome metrics in hospitalized patients [14]. The meta-analysis included only seven studies with a moderate level of evidence. In summary, wearable sensors are not yet widely used in clinical practice in the surgical ward, and the aforementioned expectations have not been supported by strong evidence.
The current lack of successful application of wearable sensors on the surgical ward might be related to their complexity and the consequences for scalability in clinical practice, especially when it comes to replacing actions performed by healthcare professionals. Our research group (consisting of technical physicians, anesthesiologists, surgeons, a clinical epidemiologist, and a nurse scientist) has performed several studies with wearable sensors on the surgical ward in which relevant lessons were learned. In this report, we aim to provide practical guidance to support peers in getting started with monitoring patients using wearable sensors in a surgical ward.

2. Materials and Methods

The Non-Adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework [15] offers a systematic evidence-based approach to cover the wide range of aspects involved in the use of wearable sensors in a surgical ward. The NASSS framework is developed for predicting and evaluating the success of technology-supported healthcare and social care programs. This framework supports implementation teams to identify and address the key challenges in different domains and the interactions between them. It consists of seven domains classified by different levels of complexity: (1) the condition, (2) the technology, (3) the value proposition, (4) the adopter system (staff, patient, caregivers), (5) the organization, (6) the wider system, and (7) embedding and adaptation over time. In relation to our expertise, the emphasis of this report is on the first four domains of the framework. Relevant topics from existing literature and our experiences are discussed per domain, and the key lessons per domain are summarized. These lessons are intended for peers to consider before starting with the clinical application of wearable sensors on the surgical ward and can be used to guide conversations and generate research ideas. The domains of the NASSS framework will be illustrated with data from a patient who was continuously monitored by two different wearable sensors (one ECG-based (VitalPatch, MediBioSense, Doncaster, UK) and one PPG-based (Radius PPG and Radius T, Masimo, Irvine, CA, USA)) in the surgical ward in an ongoing observational study at the University Medical Center Groningen.

3. Results

3.1. Condition

This domain of the NASSS framework comprises the clinical context, comorbidities, and sociocultural aspects of patients for which wearable sensors will be used [15]. It reflects the importance of identifying potential end users. To be able to implement wearable sensors in surgical wards, the types of patient for whom continuous monitoring can be of added value needs to be specified. For example, patients undergoing major abdominal surgery have complication rates of up to 44% [16]. Approximately 60% of these complications, such as respiratory failure, surgery-associated complications, pulmonary embolus, myocardial infarction, and congestive heart failure, occur within 3 postoperative days [17]. This type of information can help determine when the use of wearable sensors will be most effective for this specific population. In this example, the use of wearable sensors for early detection of postoperative complications may be most relevant in the first 3 days after surgery.
Before wearable sensors are implemented, the first step is to define the clinical purpose to accomplish customized use and to prevent the unnecessary use of time and resources. In addition, this knowledge can support healthcare professionals and policymakers in adopting the use of wearable sensors. Postoperative continuous monitoring of vital signs could also be of added value for earlier detection and possible prevention of hypotension, hypoxemia, apnea, or atrium fibrillation compared to intermittent monitoring at the ward [18]. Figure 1 shows an example of vital signs and physical activity monitored for a 20-year-old female patient by two wearable sensors during the first four postoperative days after thoracic surgery following multitrauma. During the first postoperative night after discharge from the recovery unit, SpO2 decreased to 87%, as measured by the nurse at 03:19 a.m., which could already be observed with continuous monitoring shortly after midnight.
Postoperative hypoxia (SpO2 < 90%) occurs frequently, and prolonged hypoxemia may result in arrhythmias, myocardial ischemia, and cognitive dysfunction [19]. Furthermore, prolonged desaturation may increase the risk of surgical site infections. However, monitoring SpO2 to target normoxemia in surgical patients with wearable sensors could prevent late detection of hypoxemia.
Previous studies on wearable sensors for continuous monitoring in the surgical ward have been mainly performed in postoperative patients [6,7,8]. However, which patient-specific characteristics influence the applicability of this technology is still unknown. Studies with wearable sensors in surgical patients are prone to selection bias, where participants often have a higher education [20] and are younger [21] compared with nonparticipants. One study in older surgical patients (aged 65 years or older) reported that nonparticipants were more often women, unmarried, living alone, and had a higher American Society of Anesthesiologists Physical Status Classification and more polypharmacy [21]. Generalizability to all surgical patients can therefore be a challenge. We advise specifying the patient characteristics of the population for which the use of wearable sensors should be feasible in an early stage.
In addition to patient characteristics, other patient-related factors play an important role in the ability to wear a sensor in the surgical ward. In a recent study by our research group, surgical patients wore a wearable sensor preoperatively at home until 30 days postoperatively. We found several main barriers to participation in and completion of the study, such as surgery-related mental burden, patients’ frailty, cognitive state, and low health literacy [22]. When the active contribution of patients is required, socioeconomic status and degree of education affect the acceptance and usability [23]. Overall, the vulnerability of the patient must be taken into account. For example, in the case of dementia or delirium, application of wires and plasters to the body should be minimized given the risk of the patient removing it. In such cases, professionals should evaluate the burden on the patient versus the benefits of continuous data from the wearable sensor. Although high generalizability is desired, not all patients may be able to be monitored, especially vulnerable or restless patients after surgery.

3.2. Technology

The technology domain addresses the features of and measured parameters by wearable sensors. This domain also includes the knowledge needed to use this technology and the extent to which adjustments are still needed within the organization for its daily use [15]. The potential of wearable sensors for monitoring vital signs increases as a result of the development of smaller sensors with improving battery capacity and a growing number of measured parameters. Regarding the choice of wearable sensors, the following items should be considered.
First, professionals should define which parameters are most relevant to be monitored by a wearable sensor based on the clinical purpose. Monitoring potential tachycardia in the early postoperative period or detection of respiratory insufficiencies over a longer period requires different parameters to be monitored. For example, postoperative atrium fibrillation occurs at a rate of up to 6.5% in patients after general surgery when continuously monitored at the ward, mainly on days 2 and 3, although this was not associated with prior deviation of vital signs [24]. This may require close monitoring of the heart rate (ECG). In our example, desaturation, as illustrated in Figure 1, was only measured by one of the sensors. Therefore, careful selection of sensor technology in relation to ongoing pathophysiological alterations is required.
Second, personnel should determine the desired quality of these measurements for the clinical purpose. The quality of the measured parameters should be investigated in the concerned patient population because validity and reliability of wearable sensors are often not assessed outside a controlled environment. Information about the quality of measurements by wearable sensors is essential for their use in clinical decision making because it affects the interpretation of data. In the absence of acceptable cutoff values for the reliability of wearable sensors, we reached a consensus in our research group on the acceptable mean difference between wearable sensors and reference measurements from the Bland–Altman analyses, as shown in Table 1. These values are based on the MEWS and on prior literature [6,8]. Nevertheless, the quality of measurements should be in reasonable proportion to the clinical purpose, for which the trending ability of the sensor may be as important.
In addition to the first and second items regarding the measured parameters, the following literature findings concerning respiration rate, SpO2, and temperature measurements by wearable sensors should be taken into account. Compared with heart rate, respiration rate and SpO2 measurements are more influenced by movement. Stam et al. demonstrated that movement artifacts easily corrupted respiration rate measurements with a wrist-worn sensor based on PPG [25], which led to the exclusion of 66% of the measurements due to a low quality index. Similarly, we derived approximately 30% fewer SpO2 values compared with heart rate and respiration rate measurements in a clinical validation study with an arm-worn sensor based on PPG in postoperative patients in the surgical ward [7]. Data availability of both parameters also decreased during physical activity in a validation study of wearable sensors during daily life activities in volunteers [5]. The position of the sensor on the body and differences in measurement techniques of wearable sensors might also play a role. Specifically, respiration rate measurements improve with sensor proximity to the chest [26], and respiration rate measurements with a patch on the chest based on ECG may be more accurate compared with an arm-worn sensor based on PPG [5]. The example in Figure 1 shows large variability in respiration rate measurements of both sensor types. SpO2 is commonly measured at the fingertip, which enables transmission mode PPG with higher perfusion in contrast to more convenient measurement sites that require reflection mode PPG, such as the upper arm [27]. Furthermore, only a few wearable sensors enable SpO2 measurements [18].
Regarding temperature measurements, there are a number of things to consider. In one of our previous studies, visual inspection of the continuous data from a wearable sensor showed increasing temperature values up to 60 min after sensor placement [7]. This warming-up period needs to be taken into account during interpretation. Additionally, some manufacturers use calibration with a clinically used thermometer once and/or repeatedly to guarantee certain reliability of the temperature measurements. This requires extra action from healthcare professionals. Moreover, the gold standard for temperature is rectal or bladder temperature, which is infrequently assessed in general wards and, therefore, is difficult to use for calibration or validation. Alternative temperature measurements are observer-dependent, which means the calibration will also depend on the observer. Figure 1 illustrates the moment of temperature calibration of the ECG-based sensor at postoperative day 1 around 5:00 p.m. The difference of 1 degree makes the accuracy of the previous measurements uncertain. Most validation studies on the temperature measured by wearable sensors are performed in comparison with nurse measurements and report mean differences higher than the ±0.5° Celsius as stated in Table 1 [18]. Lastly, caution is needed when interpreting temperature due to potential environmental influences, such as the temperature in the room or whether the sensor is below or above the blanket.
Third, other relevant properties of the wearable sensors may influence the measurements and implementation. Battery life can vary significantly among wearable sensors, ranging from 12 h to several days depending on the type of measurements, number of measured parameters, and sample frequency. The ECG-based sensor in the example of Figure 1 has a battery life of up to 7 days, while the PPG-based sensor lasts up to 4 days. Frequent battery charging or the need to change the sensor in case of disposable sensors requires a significant time investment for healthcare providers. In addition, not replacing the battery immediately leads to missing data. On top of that, the use of multiple disposables is costly and nonsustainable. For these reasons, the duration of monitoring needs to be chosen carefully. Clear agreements should be made with suppliers about the expiration date of disposables, the use and storage of data, and the interoperability of the wearable sensors with the existing hospital information technology systems. Additionally, in one of our studies, we experienced problems with the software that was used not being in a language understood by the healthcare professionals. Finally, professionals should consider choosing reusable wearable sensors when those are easier to use because they can be cheaper in the long run and may be more sustainable by reducing unnecessary electronic waste. Both sensors used in the example of Figure 1 were disposable and single use.

3.3. Value Proposition

This domain comprises the value proposition for the patient, the healthcare professional, and the healthcare organization. Knowing whether wearable sensors are worth using in the surgical ward at all is important because a mismatch frequently exists between the value for the manufacturer and for patients or healthcare professionals [15].
As mentioned before, the use of wearable sensors for continuous monitoring in the surgical ward is hypothesized to play a role in the early detection of deterioration and postoperative complications and by reducing the workload of healthcare professionals. However, evidence for the (cost-)effectiveness of wearable sensors is lacking [12,13]. For the patient, the added value of using wearable sensors might be a feeling of empowerment or security by high-frequency monitoring. In addition, continuous monitoring by wearable sensors might save time and money by reducing the number of unnecessary hospital visits. Even more, monitoring of clinical deterioration and early detection of postoperative complications is critical to ensure patients’ safety and well-being.
In an earlier review by our research group, examples of relevant outcome measures common to all patients were suggested, such as hospital length of stay and recovery in terms of time to full mobilization, and well-being parameters, such as pain and mental well-being, as part of the Patient Reported Outcomes Measurements (PROMs) [12]. Early detection of deterioration in hospitalized patients by wearable sensors caused a reduction in intensive care unit admissions, rapid response teams, cardiac arrest calls, and complications [28,29]. However, a recent study found that disease severity, length of stay, and mortality of patients with unplanned intensive care unit admission was not affected by continuous vital sign monitoring on the ward [30]. In addition to early deterioration outcomes, other reported outcomes, as a result of continuous monitoring, were better pain relief and higher patient satisfaction [31]. We advise defining outcome measures for cost-benefit analyses before starting the implementation and incorporation of this outcome in future prospective trials.
For healthcare professionals, the use of wearable sensors can also be of added value. Nowadays, vital signs are intermittently measured and electronically documented by nurses during rounds in the general ward. The frequency of measurements depends on the critical illness of the patient; however, measurements are generally performed 3 to 8 times per 24 h, as illustrated in Figure 1. In the case of increased MEWS scores, medical staff will be informed. Replacing these manual measurements with wearable sensors can increase nurse satisfaction and reduce workload perception [29].
Nevertheless, there are also critical notes to mention. First, not all parameters within the MEWS can be yet measured by a single wearable sensor. For completing the MEWS, nurses also need to measure blood pressure, consciousness, worry-indicator, and urine output. Second, a continuous data set of the vital parameters can lead to disturbance by giving unnecessary alarms and may lead to overdiagnosis and overtreatment. Third, software or algorithms needed to assist in deriving, handling, and interpreting continuously monitored vital signs are lacking. Although most healthcare professionals are not used to interpreting data from continuous monitoring in general, the suitable alarm criteria are still unknown [32,33]. As a result, the main barriers to the use of wearable sensors in the surgical ward mentioned are nurse engagement and alarm burden [34]. Figure 1 illustrates that if MEWS criteria are used for individual parameters, sensor measurements would lead to a high number of alarms due to artifacts, such as on the day of surgery around 9:00 p.m. Although automated trend analyses are often mentioned for their potential added value compared to absolute alarms [35], this area is still in its infancy. Introducing healthcare professionals with expertise in this field of technology could be of added value because these technological specialists could develop implementation strategies for feedback of data from wearable sensors. For example, they could determine how often vital sign measurements are stored in the electronic health record and enable flexibility in these frequencies. The latter allows healthcare professionals to change the frequency as the risk of patient deterioration increases or decreases.
Implementing the use of wearable sensors for patients has the potential of cost-effectiveness in hospitals. Continuous monitoring can alert the hospital that a surgical patient is deteriorating, resulting in an early return to the hospital and, perhaps, preventing unplanned readmissions or reoperations as well as unnecessary hospital visits. For wearable sensors to be added as part of usual care for patients, the department that makes acquisition decisions will need to see a formal document that explains how the benefits of wearable sensors justify the expenditures. Reimbursement options from health insurers, which can contribute to the sustainability of wearable sensors, should also be investigated early in the process. In the Netherlands, health insurers have recently agreed to reimburse the use of wearable sensors for chronic heart failure as part of the standard of care. For other applications, reimbursement still has to be arranged.

3.4. Adopter System

Whether patients and healthcare providers engage with and use wearable sensors depends on how easy the sensors and technology are to use, their acceptance, how much work is required by users, and the behavior of lay caregivers [15]. As elaborated in the technology acceptance model, the actual use of technology depends on perceived usefulness, and perceived ease of use will determine the actual use of technology [36]. Predicting whether technology will be used, according to the unified theory of acceptance and use of technology, also involves performance and effort expectancies, conditions that facilitate use and social influences, and is moderated by variables such as experience, sex, age, and willingness of the individual to use the technology [37]. A clinical benefit has been associated with compliance, defined as a measure of actual use, to such technology [38]. The usability of the technology is an important pillar in the adoption of a new system. The user friendliness can mostly be described from two perspectives, i.e., healthcare professionals and patients. For patients, a wearable sensor should not complicate daily life activities, such as washing or showering. The ingress protection rate indicates whether wearable sensors may or may not be exposed to water, such as the ECG- and PPG-based sensors from Figure 1, respectively. To be worn while showering, a wearable sensor needs an ingress protection rate of at least ×4. If the sensor needs to stay dry, this has unwanted consequences in terms of extra activities for the nurse and time without monitoring the patient. Thus, possibilities to change adhesive layers or plasters are recommended. In our previous experiences, some patients developed skin irritation from the plaster material [22]. In line with this, a recent review stated that most adverse device events reported for wearable sensors on the ward are skin related [39]. In general, frequent evaluation of acceptance and required workload is needed, so that the willingness to use remains high.
Furthermore, technical issues, such as a loss of connection of the wearable sensors, may occur regularly. This causes missing data, which was also the case in Figure 1 for temperature measurements between day 2 12:00 p.m. and day 3 12:00 p.m. In a recent study with wearable sensors in the general ward, about 10% of the sensors were replaced due to technical failure prematurely [40]. Another study showed that loss of connectivity occurred in 6.5% of the total monitoring time at the ward [41]. Therefore, especially in the starting phase, we advise allocating time to solve technical issues. This learning curve phenomenon [22] is challenging and requires a lot of effort and technical support to get through. Providing technological support and training for healthcare providers and for patients and their relatives will require a preinvestment in time and money. The ability for using, accepting, and investing in the work required will also hinge on the design or redesign of the hospital’s care process. Workload frequently increases when new technologies are first used, and healthcare providers and patients may need to be assigned relevant tasks according to their skills and capabilities. However, shifting work from healthcare providers to the patients, as detailed by the Burden of Treatment Theory of May [42], creates higher demands on patients, which might be rather disempowering instead of increasing self-empowerment for patients. However, healthcare professionals and patients may both benefit from support provided by a help desk or clear manuals [43]. Moreover, for clinical application, in general, feasibility and usability may be improved with the early-phase engagement of healthcare professionals and patients [43].

3.5. The Organization, The Wider System, and Embedding and Adaptation over Time

Important factors in an organization’s ability to increase the use of wearable sensors are its readiness for technological innovation and decisions on dedicated funding to support moving from a concept to reality. Aspects of the institutional and societal system include regulatory policies for technology development as well as health and legal issues [15]. Because these policies and technologies rapidly change, it is important that the organization is flexible and able to rebound. Pilot studies evaluating the feasibility and usability of continuous monitoring provide valuable information about clinical applications in a specific population; however, there is often a large gap between research and clinical application. A shared vision is needed between healthcare providers and policymakers upon which they can build and create collective guidance on what continuous monitoring technologies can and cannot execute in their institutions [15]. Furthermore, a space in the hospital could be used for device exchanges and for service and training for patients and healthcare providers.
Patients and healthcare providers are also concerned about safety and privacy issues [44,45]. Data from monitoring devices are commonly collected only within the hospital, whereas data from wearable sensors can also be acquired outside the hospital. The use of these technologies might be influenced by trust in safety and privacy aspects. It will be important for the network infrastructure that is chosen to comply with regulations on who is allowed to access data, and the contracts and Informed consents need to specify the appropriate use of data for research and development [45]. The ability to obtain support will also be desirable, ideally without substantial delay of the process, to cope with the continuously changing technology as well as legal, regulatory, and privacy issues.
The organization will need to be able to adapt to rapid changes in technology development. The technology domain suggests ideas on how to conduct this reevaluation. Depending on the actual differences in technology, the value proposition (domain 3) and adoption (domain 4) should be studied again, such as potential changes in ease of use or when different variables are monitored. Organizations are recommended to be mostly sensor independent to enable interoperability and standardized exchange of data, with which sensor suppliers need to comply, such as the MedMij criteria in the Netherlands [46]. The number of companies in the field of wearable sensor technology and software is increasing, and the organization needs to take into account that these companies can also potentially disappear from the market, which can affect the scalability and sustainability of the service.
In summary, Table 2 lists the key lessons per NASSS domain to consider before wearable sensors are used on the surgical ward, as previously discussed.

4. Future Perspectives

Based on existing literature and having several years of experience in the field of wearable sensors, we applied a framework providing key lessons in this study for the clinical application of wearable sensors in the surgical ward. One of the striking conclusions is that robust evidence is lacking in all domains of the NASSS framework and that more research is needed. Although research has been performed on the reliability and validity of vital sign measurements of wearable sensors, results are largely based on small-scale observational pilot studies. Nevertheless, the type of evaluation should match the quality of technology (technology readiness level (TRL)). For example, the adoption and (cost-)effectiveness of wearable sensors on the surgical ward can only be properly assessed after full integration and adaptation of clinical processes. A framework of service readiness levels has been developed to evaluate evidence based on the maturity of digital health innovations and the stage of the decision-making process and can be used to promote scaling [47].
We learned from our experiences that the clinical application of wearable sensors on the surgical ward requires a step-wise approach. The first step focuses on the technology. First of all, professionals should assess the quality of a new wearable sensor technology in a controlled environment (technology domain; TRL 6), such as an eHealth House [12]. Subsequently, professionals need to evaluate the quality of the wearable sensor technology with respect to reference devices in the patient population (both condition and technology domains; TRL 7), for example, in the recovery unit compared to the bedside monitor.
The second step contains an assessment of the feasibility and usability of the wearable sensor in clinical practice in a prospective pilot study on the surgical ward (as part of the adopter system domain). The result of these two steps may be that a wearable sensor is not able to fulfill the criteria for a particular clinical purpose and that it is better to proceed with a different wearable sensor.
The third step is to scale up the technological and clinical integration and evaluate the adoption and effectiveness of the wearable sensor on the surgical ward (value proposition, adopter system, and healthcare organization domains). There are several reasons why randomized controlled trials may not work well for the evaluation of these outcomes. These include rapidly evolving technologies, the dependence on patient preferences and acceptability, and embedding in clinical practice [48]. In addition, performing a truly double-blind study would be very difficult. Relton et al. proposed the idea of a cohort multiple randomized controlled trial as an alternative to randomized controlled trials. A large observational cohort is recruited, from which regular outcome measurements are obtained. Then, patients in this cohort are randomly selected to receive an intervention [49]. This may be more suitable when technology develops over time.

5. Conclusions

The application of wearable sensors for continuous monitoring of vital signs and physical activity in current healthcare processes in the surgical ward is complex and challenging. Although progress is being made in experience and research, full embedding in practice is still lacking. This perspective provides a practical guide to help peers before starting with the clinical application of wearable sensors on a surgical ward.

Author Contributions

Conceptualization, R.v.M. and M.E.H.; methodology, R.v.M. and M.E.H.; writing—original draft preparation, R.v.M. and M.E.H.; writing—review and editing, R.v.M. and M.E.H.; supervision, R.C.L.S., M.M.R.F.S. and J.-P.P.M.d.V. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study did not require ethical review because it did not involve humans or animals.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Working for Health 2022–2030 Action Plan. Available online: https://www.who.int/publications/i/item/9789240063341 (accessed on 19 July 2023).
  2. Jun, J.; Tucker, S.; Melnyk, B.M. Clinician Mental Health and Well-Being During Global Healthcare Crises: Evidence Learned From Prior Epidemics for COVID-19 Pandemic. Worldviews Evid. Based Nurs. 2020, 17, 182–184. [Google Scholar] [CrossRef] [PubMed]
  3. Subbe, C.P.; Kruger, M.; Rutherford, P.; Gemmel, L. Validation of a Modified Early Warning Score in Medical Admissions. QJM Int. J. Med. 2001, 94, 521–526. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Kellett, J.; Sebat, F. Make Vital Signs Great Again—A Call for Action. Eur. J. Intern. Med. 2017, 45, 13–19. [Google Scholar] [CrossRef] [PubMed]
  5. Haveman, M.E.; van Rossum, M.C.; Vaseur, R.M.E.; van der Riet, C.; Schuurmann, R.C.L.; Hermens, H.J.; de Vries, J.-P.P.M.; Tabak, M. Continuous Monitoring of Vital Signs With Wearable Sensors During Daily Life Activities: Validation Study. JMIR Form. Res. 2022, 6, e30863. [Google Scholar] [CrossRef] [PubMed]
  6. Breteler, M.J.M.; Huizinga, E.; Van Loon, K.; Leenen, L.P.H.; Dohmen, D.A.J.; Kalkman, C.J.; Blokhuis, T.J. Reliability of Wireless Monitoring Using a Wearable Patch Sensor in High-Risk Surgical Patients at a Step-down Unit in the Netherlands: A Clinical Validation Study. BMJ Open 2018, 8, e020162. [Google Scholar] [CrossRef] [Green Version]
  7. Haveman, M.E.; van Melzen, R.; Schuurmann, R.C.L.; El Moumni, M.; Hermens, H.J.; Tabak, M.; de Vries, J.P.P.M. Continuous Monitoring of Vital Signs with the Everion Biosensor on the Surgical Ward: A Clinical Validation Study. Expert Rev. Med. Devices 2021, 18, 145–152. [Google Scholar] [CrossRef]
  8. Weenk, M.; van Goor, H.; Frietman, B.; Engelen, L.J.; van Laarhoven, C.J.; Smit, J.; Bredie, S.J.; van de Belt, T.H. Continuous Monitoring of Vital Signs Using Wearable Devices on the General Ward: Pilot Study. JMIR mHealth uHealth 2017, 5, e91. [Google Scholar] [CrossRef]
  9. Charlton, P.H.; Bonnici, T.; Tarassenko, L.; Clifton, D.A.; Beale, R.; Watkinson, P.J. An Assessment of Algorithms to Estimate Respiratory Rate from the Electrocardiogram and Photoplethysmogram. Physiol. Meas. 2016, 37, 610–626. [Google Scholar] [CrossRef]
  10. Kachel, E.; Constantini, K.; Nachman, D.; Carasso, S.; Littman, R.; Eisenkraft, A.; Gepner, Y. A Pilot Study of Blood Pressure Monitoring After Cardiac Surgery Using a Wearable, Non-Invasive Sensor. Front. Med. 2021, 8, 693926. [Google Scholar] [CrossRef]
  11. Joshi, M.; Ashrafian, H.; Aufegger, L.; Khan, S.; Arora, S.; Cooke, G.; Darzi, A. Wearable Sensors to Improve Detection of Patient Deterioration. Expert Rev. Med. Devices 2019, 16, 145–154. [Google Scholar] [CrossRef]
  12. Haveman, M.E.; Jonker, L.T.; Hermens, H.J.; Tabak, M.; de Vries, J.-P.P. Effectiveness of Current Perioperative Telemonitoring on Postoperative Outcome in Patients Undergoing Major Abdominal Surgery: A Systematic Review of Controlled Trials. J. Telemed. Telecare 2021. [Google Scholar] [CrossRef]
  13. Leenen, J.P.L.; Leerentveld, C.; van Dijk, J.D.; van Westreenen, H.L.; Schoonhoven, L.; Patijn, G.A. Current Evidence for Continuous Vital Signs Monitoring by Wearable Wireless Devices in Hospitalized Adults: Systematic Review. J. Med. Internet Res. 2020, 22, e18636. [Google Scholar] [CrossRef]
  14. Areia, C.; Biggs, C.; Santos, M.; Thurley, N.; Gerry, S.; Tarassenko, L.; Watkinson, P.; Vollam, S. The Impact of Wearable Continuous Vital Sign Monitoring on Deterioration Detection and Clinical Outcomes in Hospitalised Patients: A Systematic Review and Meta-Analysis. Crit. Care 2021, 25, 351. [Google Scholar] [CrossRef]
  15. Greenhalgh, T.; Wherton, J.; Papoutsi, C.; Lynch, J.; Hughes, G.; A’Court, C.; Hinder, S.; Fahy, N.; Procter, R.; Shaw, S. Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies. J. Med. Internet Res. 2017, 19, e8775. [Google Scholar] [CrossRef] [Green Version]
  16. Jakobson, T.; Karjagin, J.; Vipp, L.; Padar, M.; Parik, A.H.; Starkopf, L.; Kern, H.; Tammik, O.; Starkopf, J. Postoperative Complications and Mortality after Major Gastrointestinal Surgery. Medicina 2014, 50, 111–117. [Google Scholar] [CrossRef]
  17. Thompson, J.S.; Baxter, B.T.; Allison, J.G.; Johnson, F.E.; Lee, K.K.; Park, W.Y.; Pickleman, J.; Dayton, M.T.; Jurkovich, G.J.; Landercasper, J.; et al. Temporal Patterns of Postoperative Complications. Arch. Surg. 2003, 138, 596–603. [Google Scholar] [CrossRef]
  18. Wells, C.I.; Xu, W.; Penfold, J.A.; Keane, C.; Gharibans, A.A.; Bissett, I.P.; O’Grady, G. Wearable Devices to Monitor Recovery after Abdominal Surgery: Scoping Review. BJS Open 2022, 6, zrac031. [Google Scholar] [CrossRef]
  19. Suzuki, S. Oxygen Administration for Postoperative Surgical Patients: A Narrative Review. J. Intensiv. Care 2020, 8, 4–9. [Google Scholar] [CrossRef] [PubMed]
  20. Bouwsma, E.V.A.; Huirne, J.A.F.; Van De Ven, P.M.; Vonk Noordegraaf, A.; Schaafsma, F.G.; Schraffordt Koops, S.E.; Van Kesteren, P.J.M.; Brölmann, H.A.M.; Anema, J.R. Effectiveness of an Internet-Based Perioperative Care Programme to Enhance Postoperative Recovery in Gynaecological Patients: Cluster Controlled Trial with Randomised Stepped-Wedge Implementation. BMJ Open 2018, 8, e017781. [Google Scholar] [CrossRef] [PubMed]
  21. Jonker, L.T.; Lahr, M.M.H.; Festen, S.; Oonk, M.H.M.; de Bock, G.H.; van Leeuwen, B.L. Perioperative Telemonitoring of Older Adults with Cancer: Can We Connect Them All? J. Geriatr. Oncol. 2020, 11, 1244–1249. [Google Scholar] [CrossRef] [PubMed]
  22. Haveman, M.E.; van Melzen, R.; Schuurmann, R.C.L.; Hermens, H.J.; Tabak, M.; Vries, J.-P.P.M. de Feasibility and Patient’s Experiences of Perioperative Telemonitoring in Major Abdominal Surgery: An Observational Pilot Study. Expert Rev. Med. Devices 2022, 19, 515–523. [Google Scholar] [CrossRef]
  23. Jiang, Y.; West, B.T.; Barton, D.L.; Harris, M.R. Acceptance and Use of EHealth/MHealth Applications for Self-Management Among Cancer Survivors. Stud. Health Technol. Inform. 2017, 245, 131. [Google Scholar] [CrossRef]
  24. Jokinen, J.D.V.; Carlsson, C.J.; Rasmussen, S.M.; Nielsen, O.W.; Winkel, B.G.; Jorgensen, L.N.; Achiam, M.P.; Mølgaard, J.; Sørensen, H.B.D.; Aasvang, E.K.; et al. Wireless Single-Lead ECG Monitoring to Detect New-Onset Postoperative Atrial Fibrillation in Patients After Major Noncardiac Surgery: A Prospective Observational Study. Anesth. Analg. 2022, 135, 100–109. [Google Scholar] [CrossRef]
  25. Van der Stam, J.A.; Mestrom, E.H.J.; Scheerhoorn, J.; Jacobs, F.; de Hingh, I.H.J.T.; van Riel, N.A.W.; Boer, A.K.; Scharnhorst, V.; Nienhuijs, S.W.; Bouwman, R.A. Accuracy of Vital Parameters Measured by a Wearable Patch Following Major Abdominal Cancer Surgery. Eur. J. Surg. Oncol. 2022, 48, 917–923. [Google Scholar] [CrossRef]
  26. Nilsson, L.; Goscinski, T.; Kalman, S.; Lindberg, L.-G.; Johansson, A. Combined Photoplethysmographic Monitoring of Respiration Rate and Pulse: A Comparison between Different Measurement Sites in Spontaneously Breathing Subjects. Acta Anaesthesiol. Scand. 2007, 51, 1250–1257. [Google Scholar] [CrossRef]
  27. Tamura, T. Current Progress of Photoplethysmography and SPO2 for Health Monitoring. Biomed. Eng. Lett. 2019, 9, 21–36. [Google Scholar] [CrossRef]
  28. Downey, C.; Ng, S.; Jayne, D.; Wong, D. Reliability of a Wearable Wireless Patch for Continuous Remote Monitoring of Vital Signs in Patients Recovering from Major Surgery: A Clinical Validation Study from the TRaCINg Trial. BMJ Open 2019, 9, e031150. [Google Scholar] [CrossRef] [Green Version]
  29. Stellpflug, C.; Pierson, L.; Roloff, D.; Mosman, E.; Gross, T.; Marsh, S.; Willis, V.; Gabrielson, D. Continuous Physiological Monitoring Improves Patient Outcomes. Am. J. Nurs. 2021, 121, 40–46. [Google Scholar] [CrossRef]
  30. Eddahchouri, Y.; Peelen, R.V.; Koeneman, M.; van Veenendaal, A.; van Goor, H.; Bredie, S.J.H.; Touw, H. The Effect of Continuous Versus Periodic Vital Sign Monitoring on Disease Severity of Patients with an Unplanned ICU Transfer. J. Med. Syst. 2023, 47, 43. [Google Scholar] [CrossRef]
  31. Skraastad, E.J.; Borchgrevink, P.C.; Nilsen, T.I.L.; Ræder, J. Postoperative Quality and Safety Using Efficacy Safety Score (ESS) and a Wireless Patient Monitoring System at the Ward: A Randomised Controlled Study. Acta Anaesthesiol. Scand. 2020, 64, 301–308. [Google Scholar] [CrossRef]
  32. Weenk, M.; Koeneman, M.; Van De Belt, T.H.; Engelen, L.J.L.P.G.; Van Goor, H.; Bredie, S.J.H. Wireless and Continuous Monitoring of Vital Signs in Patients at the General Ward. Resuscitation 2019, 136, 47–53. [Google Scholar] [CrossRef] [PubMed]
  33. van Rossum, M.C.; Vlaskamp, L.B.; Posthuma, L.M.; Visscher, M.J.; Breteler, M.J.M.; Hermens, H.J.; Kalkman, C.J.; Preckel, B. Adaptive Threshold-Based Alarm Strategies for Continuous Vital Signs Monitoring. J. Clin. Monit. Comput. 2022, 36, 407. [Google Scholar] [CrossRef] [PubMed]
  34. Leenen, J.P.L.; Dijkman, E.M.; van Hout, A.; Kalkman, C.J.; Schoonhoven, L.; Patijn, G.A. Nurses’ Experiences with Continuous Vital Sign Monitoring on the General Surgical Ward: A Qualitative Study Based on the Behaviour Change Wheel. BMC Nurs. 2022, 21, 60. [Google Scholar] [CrossRef] [PubMed]
  35. Haahr-Raunkjaer, C.; Mølgaard, J.; Elvekjaer, M.; Rasmussen, S.M.; Achiam, M.P.; Jorgensen, L.N.; Søgaard, M.I.V.; Grønbæk, K.K.; Oxbøll, A.B.; Sørensen, H.B.D.; et al. Continuous Monitoring of Vital Sign Abnormalities; Association to Clinical Complications in 500 Postoperative Patients. Acta Anaesthesiol. Scand. 2022, 66, 552. [Google Scholar] [CrossRef] [PubMed]
  36. Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. Manag. Inf. Syst. 1989, 13, 319–339. [Google Scholar] [CrossRef] [Green Version]
  37. Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User Acceptance of Information Technology: Toward a Unified View. MIS Q. Manag. Inf. Syst. 2003, 27, 425–478. [Google Scholar] [CrossRef] [Green Version]
  38. Huis in’t Veld, R.M.H.A.; Kosterink, S.M.; Barbe, T.; Lindegård, A.; Marecek, T.; Vollenbroek-Hutten, M.M.R. Relation between Patient Satisfaction, Compliance and the Clinical Benefit of a Teletreatment Application for Chronic Pain. J. Telemed. Telecare 2010, 16, 322–328. [Google Scholar] [CrossRef] [Green Version]
  39. Aagaard, N.; Larsen, A.T.; Aasvang, E.K.; Meyhoff, C.S. The Impact of Continuous Wireless Monitoring on Adverse Device Effects in Medical and Surgical Wards: A Review of Current Evidence. J. Clin. Monit. Comput. 2023, 37, 7–17. [Google Scholar] [CrossRef]
  40. Leenen, J.P.L.; Rasing, H.J.M.; Kalkman, C.J.; Schoonhoven, L.; Patijn, G.A. Process Evaluation of a Wireless Wearable Continuous Vital Signs Monitoring Intervention in 2 General Hospital Wards: Mixed Methods Study. JMIR Nurs. 2023, 6, e44061. [Google Scholar] [CrossRef]
  41. Eddahchouri, Y.; Peelen, R.V.; Koeneman, M.; Touw, H.R.W.; van Goor, H.; Bredie, S.J.H. Effect of Continuous Wireless Vital Sign Monitoring on Unplanned ICU Admissions and Rapid Response Team Calls: A before-and-after Study. Br. J. Anaesth. 2022, 128, 857–863. [Google Scholar] [CrossRef]
  42. May, C.R.; Eton, D.T.; Boehmer, K.; Gallacher, K.; Hunt, K.; MacDonald, S.; Mair, F.S.; May, C.M.; Montori, V.M.; Richardson, A.; et al. Rethinking the Patient: Using Burden of Treatment Theory to Understand the Changing Dynamics of Illness. BMC Health Serv. Res. 2014, 14, 281. [Google Scholar] [CrossRef]
  43. Leenen Id, J.P.L.; Tte, H.; Rasing, J.M.; Van Dijk, J.D.; Kalkman, C.J.; Schoonhoven, L.; Patijn, G.A. Feasibility of Wireless Continuous Monitoring of Vital Signs without Using Alarms on a General Surgical Ward: A Mixed Methods Study. PLoS ONE 2022, 17, e0265435. [Google Scholar] [CrossRef]
  44. RIVM. E-Healthmonitor 2021: Stand van Zaken Digitale Zorg. Available online: https://www.rivm.nl/bibliotheek/rapporten/2022-0153.pdf (accessed on 31 January 2022).
  45. Dawes, A.J.; Lin, A.Y.; Varghese, C.; Russell, M.M.; Lin, A.Y. Mobile Health Technology for Remote Home Monitoring after Surgery: A Meta-Analysis. Br. J. Surg. 2021, 108, 1304–1314. [Google Scholar] [CrossRef]
  46. MedMij. Afsprakenstelsel 1.5.0-MedMij Afsprakenstelsel 1.5.0-MedMij Afsprakenstelsel. Available online: https://afsprakenstelsel.medmij.nl/display/medmijafsprakenstelsel150 (accessed on 16 February 2022).
  47. Hughes, J.; Lennon, M.; Rogerson, R.J.; Crooks, G. Scaling Digital Health Innovation: Developing a New ‘Service Readiness Level’ Framework of Evidence. Int. J. Environ. Res. Public Health 2021, 18, 12575. [Google Scholar] [CrossRef]
  48. Holle, R.; Zahlmann, G. Evaluation of Telemedical Services. IEEE Trans. Inf. Technol. Biomed. 1999, 3, 84–91. [Google Scholar] [CrossRef]
  49. Relton, C.; Torgerson, D.; O’Cathain, A.; Nicholl, J. Rethinking Pragmatic Randomised Controlled Trials: Introducing the “Cohort Multiple Randomised Controlled Trial” Design. BMJ 2010, 340, 963–967. [Google Scholar] [CrossRef]
Sensors 23 06736 g001 550
Figure 1. Vital signs and physical activity measurements of a 20-year-old female patient during the first four postoperative days after open fixation of the thoracic spine following multitrauma. Top to bottom: raw measurements of four vital signs (heart rate, respiration rate, temperature, and blood oxygen saturation [SpO2]) measured by two wearable sensors, an ECG-based sensor (blue) and a PPG-based sensor (orange), by a bedside monitor on the recovery unit (yellow) and by nurses on the surgical ward (black dots). Colored areas represent the limits for points in the Modified Early Warning Score (MEWS) per vital sign. An elevated MEWS (≥4) requires more frequent patient surveillance by hospital protocol (light grey dots). Bottom: physical activity measured as a type of activity and step count by the ECG-based sensor in light blue and dark blue, respectively. Nighttime (11:00 p.m. to 07:00 a.m.) is depicted by grey areas. Data were extracted from an ongoing project in the University Medical Center Groningen (approved by the medical ethical committee, METc 2021/440) for which the patient signed informed consent.
Figure 1. Vital signs and physical activity measurements of a 20-year-old female patient during the first four postoperative days after open fixation of the thoracic spine following multitrauma. Top to bottom: raw measurements of four vital signs (heart rate, respiration rate, temperature, and blood oxygen saturation [SpO2]) measured by two wearable sensors, an ECG-based sensor (blue) and a PPG-based sensor (orange), by a bedside monitor on the recovery unit (yellow) and by nurses on the surgical ward (black dots). Colored areas represent the limits for points in the Modified Early Warning Score (MEWS) per vital sign. An elevated MEWS (≥4) requires more frequent patient surveillance by hospital protocol (light grey dots). Bottom: physical activity measured as a type of activity and step count by the ECG-based sensor in light blue and dark blue, respectively. Nighttime (11:00 p.m. to 07:00 a.m.) is depicted by grey areas. Data were extracted from an ongoing project in the University Medical Center Groningen (approved by the medical ethical committee, METc 2021/440) for which the patient signed informed consent.
Sensors 23 06736 g001
Table
Table 1. Cutoff values of acceptable difference between wearable sensor and gold standard reference measurements.
Table 1. Cutoff values of acceptable difference between wearable sensor and gold standard reference measurements.
Vital SignAcceptable Difference
Heart rate±5 beats per minute
Respiration rate±2 breaths per minute
Temperature±0.5 °C
Blood oxygen saturation (SpO2)±2%
Table
Table 2. Key lessons per NASSS domain to consider before getting started with clinical application of wearable sensors on the surgical ward.
Table 2. Key lessons per NASSS domain to consider before getting started with clinical application of wearable sensors on the surgical ward.
DomainKey Lessons
Condition
  • Determine the clinical goal(s)
  • Specify the characteristics of the patient population
  • Make a trade-off between the impact of wearing the sensor for the patient and continuous monitoring for the healthcare professional versus the intended goal
Technology
  • Define what to monitor based on the clinical purpose
  • Decide on (and evaluate) the appropriate measurement quality
  • Understand the additional properties of the wearable sensor
Value proposition
  • Set relevant outcome measures
  • Develop strategies for feedback of the data
  • Prepare a business case
Adopter system
  • Assess the usability for end users
  • Allocate time to solve technological problems
  • Involve end users in the implementation
Healthcare organization
Wider system
Embedding and adaptation over time
  • Discuss the ability of data integration at an early stage
  • Find support to comply with law and regulation
  • Build sustainable information technology infrastructure for future developments
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

van Melzen, R.; Haveman, M.E.; Schuurmann, R.C.L.; Struys, M.M.R.F.; de Vries, J.-P.P.M. Implementing Wearable Sensors for Clinical Application at a Surgical Ward: Points to Consider before Starting. Sensors 2023, 23, 6736. https://doi.org/10.3390/s23156736

AMA Style

van Melzen R, Haveman ME, Schuurmann RCL, Struys MMRF, de Vries J-PPM. Implementing Wearable Sensors for Clinical Application at a Surgical Ward: Points to Consider before Starting. Sensors. 2023; 23(15):6736. https://doi.org/10.3390/s23156736

Chicago/Turabian Style

van Melzen, Rianne, Marjolein E. Haveman, Richte C. L. Schuurmann, Michel M. R. F. Struys, and Jean-Paul P. M. de Vries. 2023. "Implementing Wearable Sensors for Clinical Application at a Surgical Ward: Points to Consider before Starting" Sensors 23, no. 15: 6736. https://doi.org/10.3390/s23156736

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop