Next Article in Journal
Research on Deep Reinforcement Learning Control Algorithm for Active Suspension Considering Uncertain Time Delay
Next Article in Special Issue
On Indoor Localization Using WiFi, BLE, UWB, and IMU Technologies
Previous Article in Journal
A Highly Sensitive and Selective Optical Sensor for the On-Line Detection of Cesium in Water
Previous Article in Special Issue
A Modular Framework for Data Processing at the Edge: Design and Implementation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Time-Sensitive Networking to Improve the Performance of Distributed Functional Safety Systems Implemented over Wi-Fi

1
National Research Council of Italy, CNR-IEIIT, 35131 Padova, Italy
2
Department of Engineering “Enzo Ferrari”, University of Modena and Reggio Emilia, 41125 Modena, Italy
3
National Research Council of Italy, CNR-IEIIT, 10129 Torino, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Sensors 2023, 23(18), 7825; https://doi.org/10.3390/s23187825
Submission received: 3 August 2023 / Revised: 4 September 2023 / Accepted: 7 September 2023 / Published: 12 September 2023
(This article belongs to the Special Issue Feature Papers in Communications Section 2023)

Abstract

:
Industry 4.0 has significantly improved the industrial manufacturing scenario in recent years. The Industrial Internet of Things (IIoT) enables the creation of globally interconnected smart factories, where constituent elements seamlessly exchange information. Industry 5.0 has further complemented these achievements, as it focuses on a human-centric approach where humans become part of this network of things, leading to a robust human–machine interaction. In this distributed, dynamic, and highly interconnected environment, functional safety is essential for adequately protecting people and machinery. The increasing availability of wireless networks makes it possible to implement distributed and flexible functional safety systems. However, such networks are known for introducing unwanted delays that can lead to safety performance degradation due to their inherent uncertainty. In this context, the Time-Sensitive Networking (TSN) standards present an attractive prospect for enhancing and ensuring acceptable behaviors. The research presented in this paper deals with the introduction of TSN to implement functional safety protocols for wireless networks. Among the available solutions, we selected Wi-Fi since it is a widespread network, often considered and deployed for industrial applications. The introduction of a reference functional safety protocol is detailed, along with an analysis of how TSN can enhance its behavior by evaluating relevant performance indexes. The evaluation pertains to a standard case study of an industrial warehouse, tested through practical simulations. The results demonstrate that TSN provides notable advantages, but it requires meticulous coordination with the Wi-Fi MAC layer protocol to guarantee improved performance.

1. Introduction

Factory automation has undergone a profound revolution thanks to the introduction of the Industrial Internet of Things (IIoT) concept. In this context, information and communication technologies (ICT) are ever more used to create smart factory ecosystems comprising distributed networks of objects capable of seamlessly interacting. Since the introduction of such technologies, the push for innovation has continued to grow, as witnessed by the industrial revolution, referred to as Industry 4.0 [1], which has been recently followed by Industry 5.0 [2,3].
Basically, Industry 4.0 is a concept introduced about a decade ago which relies on the intelligent networking among machines, controllers, sensors and actuators, and processes in general, to implement digitized production systems [4]. This technology-driven paradigm enhances the manufacturing capabilities, improving production efficiency and flexibility, while ensuring energy efficiency, rational use of resources, and environmental sustainability.
Industry 5.0 is a value-driven paradigm that is designed to complement and enhance the aforementioned features. Its origin can be traced back to pioneering works, such as [5], and has since been adopted by the European Commission [6]. Industry 5.0 focuses on three main concepts, namely, the human-centric approach, sustainability, and resilience [7]. Particularly, the human-centric approach involves the direct participation of humans in the production processes to facilitate robust, profound, and fruitful cooperation with machines. In this respect, a common example involves the interaction between humans and collaborative robots (CoBots).
The innovative context described above poses further requirements for the communication systems deployed in the industrial scenario [8]. Two fundamental issues need to be addressed: (i) the pervasive use of industrial wireless networks and (ii) the implementation of robust and effective distributed functional safety systems. In this regard, as collaboration between individuals and machines is essential, ensuring a high level of protection is crucial for both operators and the surrounding environment. Therefore, functional safety systems are of the utmost importance [9]. Thus, in the Industry 4.0–5.0 scenarios, it is necessary to implement robust, reliable, and safe communication protocols over wireless networks. The benefits of this implementation are manifold. Notably, eliminating cabling results in significant cost-savings and greatly enhances the flexibility and scalability of networks.
In this direction, the IEC 61784–3 International Standard [10] defined some effective protocols such as Fail Safe over EtherCAT (FSoE), ProfiSAFE, and OpenSafety that, however, were primarily conceived to work with wired communication systems. Nevertheless, thanks to the “Black Channel Approach” introduced by IEC 61784–3, they can be implemented on wireless networks as well. Unfortunately, the introduction of wireless systems may negatively impact the behavior of the plants that use the functional safety networks, due to the implicit uncertainty of the communication medium. As an example, impairments like a delay in delivery a packet or, worse, a lost packet that occur during the operation of a functional safety network may trigger the intervention of the safety stop function, with the consequent shutdown of the plant.
In this scenario, however, the opportunities offered by Time-Sensitive Networking (TSN) [11,12] may represent a valuable and significant step forward. TSN is a family of standards originally conceived for Ethernet networks that has recently started to be considered for industrial wireless communication systems as well. It includes protocols for distributed device synchronization, traffic shaping and scheduling, and network redundancy (to mention some) that can be profitably used to dramatically improve communication performance, particularly in terms of timeliness and reliability [13].
To the best of the authors’ knowledge, TSN has never been considered to implement functional safety networks, whether wired or wireless. Based on this consideration, this paper addresses the adoption of TSN for functional safety protocols implemented over wireless networks, specifically Wi-Fi. In light of the current state of the art, and particularly with reference to the contribution described in [14], this paper presents some novel elements, as follows:
  • A reference functional safety protocol is introduced to make the analysis more general;
  • Various Wi-Fi modulation and coding schemes (MCSs) are used;
  • Different channel models are taken into account;
  • Two TSN protocols, namely, IEEE 802.1AS and IEEE 802.1Qbv, over Wi-Fi are employed.
The analysis is based on the specific case study of an automated warehouse in which robots and humans cooperate to transfer goods from/to different areas of the plant. It is carried out through numerical simulations and focuses on the behavior of two meaningful performance indexes, namely, the safety function response time (SFRT) and the percentage of failed pollings (PFP), which will be formally defined in the following. The final goal is to assess whether TSN can bring significant performance improvements, as well as to investigate the most suitable configurations of Wi-Fi and TSN in this challenging field of application.
In detail, the rest of the paper is organized as follows. Section 2 reports some related work. Section 3 introduces the model of functional safety protocol which is used as reference protocol throughout the paper. Section 4 provides the theoretical characterization of both SRT and PFP. Section 5 describes the automated warehouse used as case study. Section 6 presents the results of the assessment carried out to evaluate the behaviors of SFRT and PFP. The simulations refer to a functional safety network that adopts the aforementioned reference protocol over Wi-Fi, with or without the use of TSN. Finally, Section 7 concludes the paper.

2. Related Work

Functional safety, in general, has been largely addressed by the scientific literature in the past years. However, the contributions in this context are significantly reduced if we refer to functional safety networks, and in particular to those based on wireless communication systems.
In [15], the authors describe the implementation of a proprietary protocol for real-time Ethernet networks that includes safety and security mechanisms. Although the protocol is not among those standardized by IEC 61784-3 [10], the paper provides significant and interesting results obtained from practical tests carried out on a real system implementation. The relationship between functional safety and dependability for industrial electronics system is dealt with in [16]. In addition to presenting a theoretical survey, the paper introduces two interesting case studies. The paper [17] proposes a modification of the popular WirelessHART protocol to introduce security and safety properties. Notably, the authors carried out a practical implementation of the modified protocol for a commercial distributed control system (the 800xA DCS by ABB) and showed the outcome of some experimental sessions conducted to measure the SFRT. WirelessHART is addressed also by [18]. The authors introduce an event–triggered mechanism to transmit safety-related information aimed at limiting the bandwidth requested by the typical functional safety protocols that are based on master–slave techniques. The paper includes an analytical description of SFRT, as well as its experimental evaluation carried out for a prototype network. In [19], the authors focus on the description of SFRT for safety protocols based on wireless networks. Specifically, they consider the IEEE 802.15.4e standard [20] and propose a theoretical model to determine the SFRT. The effectiveness of the model is demonstrated by means of a numerical example. The implementations of two different functional safety protocols on Wi-Fi are proposed in [14,21], respectively. In [21], the authors refer to openSAFETY and introduce an implementation that makes use of UDP and MQTT (Message Queuing Telemetry Transport) in combination with TCP. Then, they present a set of experimental tests to measure the safe response time (SRT, which accounts for the SFRT). In [14], the authors address another popular functional safety protocol, namely, Fail Safe over EtherCAT (FSoE). After providing the analytical description of SFRT, they report the results of an experimental assessment in which, mainly, they evaluate the polling time of the slaves, which contributes to determine the SFRT.
The analysis shows that the adoption of wireless networks by functional safety protocols presents an interesting opportunity for current and future industrial systems, even though it poses significant and diverse challenges that the scientific community has only recently started to tackle.

3. Reference Functional Safety Protocol

The proposed reference protocol is based on a master/slave technique that resembles those adopted by the protocols of the IEC 61784-3. Basically, a master device cyclically polls a set of slave devices to exchange safety PDUs (SPDUs), which contain safety-related data. In detail, such a polling operation can be either continuous or slotted. In the continuous polling, the master starts querying the first slave and, upon completion of the polling operation, sequentially moves to the following ones. When the last slave has been polled, the master returns immediately to the first one and starts a new cycle.
In the slotted polling, slots of fixed duration are assigned to master and slaves. The polling cycle is determined by the sequence of the slots. The master starts the cycle by sending the SPDUs to the slaves in its slot. Subsequently, each slave is granted to transmit its SFPU in the slot assigned to it. When the slot of the last slave has expired, a new cycle is started with the slot of the master. Clearly, TSN features are particularly helpful to implement such a technique since they allow (i) strict synchronization of the nodes and (ii) assigning of the time slots to the nodes.
In agreement with IEC 61784-3, the reference functional safety protocol implements some countermeasures against communication errors. They are listed in Table 1 and briefly described in the following. The safety CRC is an additional CRC, with respect to that of the underlying communication system, calculated only on the safety PDU. The PDU numbering is a technique that assigns a sequential number to each safety PDU exchanged between master and slave. It is calculated by the protocol and inserted on a specific field of the safety PDUs. The watchdog is a procedure that allows the checking of whether or not a device is alive. Finally, the slave authentication is a further safety technique that allows the master to constantly know the list of slaves authorized to exchange safety information.
The countermeasures described so far are able to detect some specific communication errors, as listed in Table 2 (the detailed description of the communication errors can be found in the IEC 61784-3 International Standard). When one of such errors occurs, if it is detected by the master, this device issues a safe state transition request to all the slaves and then enters the safe state by itself. Conversely, if the error is detected by a slave, this device sends the request to the master, which in turn dispatches it to all the other slaves and then enters the safe state by itself.

4. Performance Indexes

This section deals with the definition of the performance indexes addressed in this paper, namely, SFRT and PFP.

4.1. Safety Function Response Time

SFRT was defined by IEC 61784-3 as the “worst case elapsed time following an actuation of a safety sensor connected to a network before the corresponding safe state of its safety actuator(s) is achieved in the presence of errors or failures in the safety function channel”. In practice, SFRT is the worst-case time needed by a plant to reach a state in which, typically, actuators are no longer powered as the consequence of a request issued by a safety sensor. Notably, the standard specifies that the SFRT definition includes errors or failures in the communication channel. This leads to the equations provided in [10,19].
Although SFRT is defined for wired systems, it can be seamlessly extended to safety systems implemented over wireless networks. In this case, the uncertainty of the communication medium may add considerable variability to the aforementioned equations.
As a matter of fact, the definition of SFRT does not specify the number of “errors or failures in the safety function channel”. Thus, in some contributions (e.g., [17,18]), the calculation is made considering a single failure, whereas [19] extends the analysis including multiple error sources.
Focusing on the reference functional safety protocol, in case of a single failure, for the continuous polling, the SFRT can be expressed as
S F R T C = 2 T c m a x + max i = 1 , 2 , , n ( T O i T p i )
whereas, for the slotted polling, it results
S F R T S = 2 P
The meaning of the variables used in (1), (2), and those which will follow is reported in Table 3.
Both (1) and (2) were derived considering that a safety issue detected by a slave needs at most one cycle to be notified to the master, and that another cycle is necessary for the master to send the relevant reactions to the slaves. In this interval of time, an error in the safety function channel reflects in a failed polling of a slave, i.e., in a timeout. Consequently, for the continuous polling case, the duration of one of the two cycles is increased by max i = 1 , 2 , , n ( T O i T p i ) . In the slotted polling, conversely, the polling time of a slave is constant, even in case of a failure; hence, the cycle time is not increased.
The calculation of SFRT can be extended to the case of multifailures in the safety function channel. Indeed, for the continuous polling, the failure of the i-th slave causes an increment of SFRT of T O i T p i . The limit situation occurs when all the links between master and slaves are interrupted. In this case, SFRT for the continuous polling results
S F R T m a x C = 2 i = 1 n T O i
whereas SFRT does not change for the slotted polling ( S F R T m a x S = 2 P ). Notably, in this situation, due to the failures, there is no communication between master and slaves. This is very unlikely to happen for wired networks, since it would imply that all the cables connecting the devices are damaged. Conversely, it can not be excluded a priori for wireless systems. Indeed, for example, the communication could be temporary interrupted due to an in-band interference from different systems. It is worth observing that in this situation the slaves are not updated by the master. Nevertheless, they are forced into a safe state by the watchdog function of the functional safety protocol.

4.2. Failed Pollings

Both the polling techniques defined for the reference functional safety protocol may be severely impaired by the occurrence of failed pollings. This kind of problem, with reference to Table 2, is caused by errors like corruption, loss, and delay, and may be effectively detected by the watchdog countermeasure defined by IEC 61784–3. Notably, failed pollings assume particular relevance when wireless networks are adopted, since the implicit uncertainty of the physical medium and the possible interference from other wireless communication systems may severely impact the cyclic exchange of SPDUs between master and slaves. Consequently, it was decided to address the percentage of failed pollings (PFP) as a meaningful performance index for the reference functional safety protocol. It is defined as
P F P = N f p N c y c × 100
where N c y c is the total number of cycles executed in a given interval of time, and N f p is the number of failed pollings occurred within that interval of time.
For both the techniques adopted by the reference functional safety protocol (continuous and slotted), timeouts are used to implement the watchdog function and, hence, to detect failed pollings. In detail, for the continuous polling they are detected either by a master which does not receive the answer from a queried slave within a given interval of time, or by a slave which does not receive the expected poll request from the master. For the slotted polling, a master detects a failed polling when a slave does not send the SPDU in the slot assigned to it. Similarly, a slave detects a failure if it does not receive the SPDU from the master.

5. Case Study

The need for functional safety networks based on wireless communication stems from diverse industrial use cases in which mobile devices, for example, robots and AGVs, cooperate among each other and/or with humans in environments where very strict safety requirements are imposed to protect people and machinery. The case study presented in this paper refers to a semiautomated warehouse, schematically represented in Figure 1, that resembles those presented in [22,23], that actually deal with warehouse systems characterized by the contemporaneous presence of mobile devices and humans working in collaboration. The plant includes two distinct workspaces. The first one, highlighted in red, is the loading bay where both the unloading and loading of goods from trucks by human personnel take place manually. The second workspace, highlighted in green, is a fully automated area where mobile robots move goods to/from storage areas for further processing. In this workspace, the access of human personnel is forbidden.
The transfer of goods between the two workspaces takes place through a common area, shown in orange in Figure 1. During operation, human personnel move goods from the red area to the orange one, which are subsequently picked up by robots and brought to the green area. The inverse operation is also possible, with humans operators who pick up goods placed by robots in the orange area and move them to the red one.
Four autonomous mobile robots operate in the automated area. They represent mobile safety slaves connected to a safety master located at the center, 5 m above the ground, of the automated area in order to provide an effective coverage. The connection takes place via a safety network based on the reference protocol introduced in Section 3, and implemented over Wi-Fi. A further safety slave device, in this case static, is represented by the barriers placed at the entrance to the automated area. One of the safety requirements is that when the safety barriers are opened, the Safe Stop 1 (SS1) [24] safety function must be activated in the mobile robots, which consists of a controlled braking procedure followed by the deactivation of the power supply to the electric drives that allow the robots to move. Moreover, there is a keep-out area close to the entrance (the orange rectangle in Figure 1) where robots are are not allowed to move. This area has been designed in such a way that, in case of failure, it is sufficiently large to stop a robot before it reaches the entrance.
The automatic warehouse presented in this section is an appropriate case study to address the topics dealt with by this paper. Indeed, the interaction between humans and robots is explicitly mentioned among the features of Industry 5.0. Thus, the adoption of TSN for the implementation of the functional safety reference protocol, in the context of the warehouse, can be adequately investigated and, in particular, a comparison can be made with the case in which TSN is not used.

6. Experimental Assessment

6.1. Simulation Setup

The communication among nodes in the environment represented in Figure 1 was simulated using ns3. The nodes were set to operate with the IEEE802.11ac standard [25], which actually supports the TSN features, in the 5 G Hz band.
Every node is equipped with a single antenna and uses a fixed modulation and coding scheme (MCS), ranging from MCS0 to MCS7, thus allowing a single spatial stream both in Tx and Rx. For the propagation loss model, we considered the TGn channel models [26]. This standard proposes a set of 6 profiles, referred to as A to F. In this model, as described by Equation (5), the loss L at the distance d is given by a two-slope model where the first part is the free space loss L F S up to a breakpoint distance d B P and slope of 3.5 after the d B P , where d B P is defined according to the specific profile.
L ( d ) = L F S + 0 , d < d B P 35 · l o g ( d / d B P ) d d B P
In the simulation setup, we considered both the TGn model D ( d B P = 10 m) and TGn model E ( d B P = 20 m), since, according to their specifications, they appear to be the most suitable to describe the application environment. Indeed, the TGn model D is typically used in the design and optimization of indoor wireless networks, whereas TGn model E refers to wireless networks that cover both indoor and outdoor environments [26].
In agreement with the description of the reference safety protocol provided in Section 3, we considered the two polling techniques, namely, continuous and slotted. The continuous polling was implemented by using request and response frames issued, respectively, by the master and the slaves. The slotted polling was implemented by exploiting the TSN features defined by IEEE 802.1AS and IEEE 802.1Qbv [27,28], respectively. IEEE 802.1AS is a standard that allows us to achieve time synchronization among distributed nodes, whereas the IEEE 802.1Qbv standard defines a mechanism for the reservation of bandwidth for time-sensitive traffic. It is based on the concept of gates, which are time intervals during which only a specific class of traffic is allowed to be transmitted. With IEEE 802.1Qbv, time-sensitive devices implement their own schedules according to the network requirements, so that data can be timely delivered without collisions with other transmissions.
The duration of the slots was determined considering two different constraints. On the one hand, the duration has to be as small as possible to achieve very low safety response times. On the other hand, the slots have to be big enough to ensure the transmission of the frames. This led to the schedule shown in Figure 2. In practice, the time necessary to safely transmit an SPDU was set to 200 μ s . This value was calculated considering the actual time necessary to transmit the SPDU (that carries 8 bytes of safety data and is encapsulated in a User Datagram Protocol (UDP) PDU) over Wi-Fi, and adding a further security margin. Consequently, the master has a slot of duration 2 m s , whereas each slave has 200 μ s . The cycle starts with the master slot, in which the SPDUs are sequentially transmitted to the slaves, followed by the slots in which each slave transmits its own SPDU, for a total cycle duration of 2 m s . The watchdog timer was set to 10 m s for all the simulations [29,30].
During operation, the transition of the plant to a safe state can be due to two different causes:
(i)
Activation of a safety function by any of the nodes that detects a fault (e.g., a problem of one of the robots);
(ii)
Detection of any of the errors reported in Table 2.
Both such causes were considered in the proposed experimental analysis. The SFRT was then measured as the time elapsed between the detection of either a fault in the node or the communication error and the achievement of the safe state by all nodes.
In total, 32 different scenarios were analyzed, since for each MCS the behavior of the two polling techniques were simulated for the two channel models.
For every scenario, 30 simulations were performed, where the initial positions of the AGVs, as well as their trajectories, were set randomly.
For every simulation, we collected data about the round trip time and cycle time of SPDUs, SFRT, and the cause of transition to the safe state. A recap of meaningful simulation parameters is reported in Table 4.

6.2. Behavior of the Two Polling Techniques

Before addressing the performance of the functional safety protocol, the behavior of the two polling techniques was assessed. In this direction, we investigated the cycle time, T c , of the network, defined as the time that elapses between the transmission of two subsequent SPDUs from the master to the same slave. Results are provided in both Figure 3 and Table 5 that report, respectively, the probability density and the statistics of T c . As a first comment, the cycle time is not significantly influenced by the selected channel model. This result is not surprising, since the two models are similar and the effects of channel attenuation tend to be more noticeable away from the breakpoint distance, i.e., when the distance between master and slave is significantly greater than d B P . Focusing on the actual behavior of T c , it may be noticed that, as expected, the continuous technique is characterized by a considerable randomness caused by the lack of an ordered access to the transmission channel. Indeed, with this technique, the master polls the slave without a precise timing and such an operation is heavily influenced by packet losses, retransmissions, random backoff times, etc. Conversely, with the slotted polling, all transmissions are precisely scheduled and the aforementioned problems are mitigated, with the evident benefits on the behavior of T c . However, as can be seen, there is still a non-negligible variability. Particularly, the probability density in Figure 3 evidences three bars at 2, 4, and 6 m s , reflecting the fact that some devices (either master or slaves) do not conclude their transmissions in the assigned slot, but require one or two additional slots.
This is due to the fact that the time-aware scheduler (TAS) of IEEE 802.1Qbv, in some cases, is not able to guarantee the collision-free transmission of SPDUs. Indeed, when a frame is delivered to the MAC layer, the TAS loses control over it. Thus, if the MAC layer delays the transmission of that frame for some reason (e.g., the presence of other transmissions or a random backoff), such a transmission may actually take place in the window reserved by the TAS to another device, compromising the schedule and likely causing additional delays and collisions. Figure 4 shows two possible cases of delays that affect the transmission of SPDUs. In Figure 4a, the missing of an ACK frame causes the retransmission after a random backoff time, whereas in Figure 4b, the window assigned to an SPDU is occupied by the (unexpected) transmission of a beacon frame. A straightforward way to mitigate such a problem is to increase the TAS window duration (i.e., the duration of the slot assigned to safety devices), so that the transmission of SPDUs may take place in the assigned slot, even in the presence of unexpected delays or other inconveniences. Clearly, this solution increases the cycle time and, consequently, reduces the timeliness of the slotted technique. A more preferable solution is to neutralize the causes of delays whenever possible, for example, disabling the sending of beacon frames and preventing Wi-Fi cards from entering idle states such as power save, which has the effect of queuing frame transmission at the MAC layer.

6.3. SFRT

The empirical probability density function (EPDF) of the SFRT is shown in Figure 5, while its statistics are reported in Table 6. In both cases, to improve readability, the presented results are cumulative for all the considered MCSs.
The maximum expected values were calculated according to Equations (2) and (3). We set the cycle time to 2 m s (the watchdog, as mentioned, was 20 m s ), resulting in an expected maximum SFRT of 200 m s for continuous polling and 4 m s for slotted polling. We separately analyzed the cases in which the safe state transition request is originated either by the master or by a slave. Also, we considered two possible causes of safe state transitions, namely, a trigger issued by any of the devices (typically an emergency request) and the detection of a failed polling by the watchdog countermeasure. As can be seen in Figure 5, when the transition is originated by the master, the safety function response time is lower in comparison with the case in which the transition is originated by a slave. This is understandable since, if the transition is started by the master, ideally, only one network cycle is necessary to activate the safety function on all the slaves. On the other hand, if the transition is originated by a slave, the master has to receive the trigger and then send the transition request to all the other slaves. This requires more than one network cycle.
The analysis of the results shows that the slotted technique (that relies on TSN) performs better than the continuous one, since it allows us to obtain faster SFRT values. However, it is interesting to note in Table 6 that, for the slotted technique with the transition to the safe state triggered by a slave, the maximum SFRT value overcomes the theoretically calculated one. This is a consequence of the problem evidenced in Section 6.2, where it was observed that in some cases the transmission of SPDUs was delayed with respect to the slots in which it was expected to take place. Clearly, this aspect represents an issue, since ensuring that the safety function response time can be calculated a priori is crucial for a functional safety network. Finally, it has to be mentioned that the missed values in the last row of Table 6 reflect the fact that, for the slotted technique, the slaves did not detect any failed polling.

6.4. Percentage of Failed Pollings

The statistics of the percentage of failed pollings (PCP) are reported in Table 7. The presented results are relevant to the whole set of simulations that were executed.
As can be seen, the benefits derived by the adoption of the slotted polling, supported by the TSN features, are evident. Indeed, with the slotted technique, there is a dramatic reduction in the failed pollings. This is an important achievement, since an event of this type causes the transition to the safe state that, as observed in the Introduction, typically implies the shutdown of the plant.
A further analysis was carried out in order to investigate the possible impact of both the channel loss model and the different MCSs on PCP. Results are presented in Figure 6. It can be observed that PFP has a slightly better behavior for the IEEE TGn E loss model. Also, for both channel models, MCS0 performs worse than the other modulation and coding schemes. This is likely due to the long polling times (that are a consequence of the low bit rate) that, in case of additional communication delays, may exceed the timeout.
Generally speaking, as can be seen in Figure 6, the number of failed pollings seems to not have any particular correlation with the MCS and the loss model.

6.5. Simulations with a Longer Cycle Time

A second session of simulations was carried out in which a longer duration of the slots was adopted for the slotted technique even if, clearly, this resulted in a longer cycle time. In detail, we assigned a transmission window of 1 m s to each slave, resulting in a cycle time of 10 m s (with the slot of the master set to 5 m s ). These simulations were carried out to assess whether increasing the duration of the slots is an effective solution to ensure that devices transmit their SPDUs in the assigned slots without additional delays.
Since in the previous experiments no significant differences were observed in the results obtained for the two propagation-loss models, in this new simulation, only the IEEE TGn D model was used.
The obtained results confirmed the effectiveness of the choice. Actually, for the slotted technique, all the SPDUs were transmitted in the assigned slots; hence, no failed pollings were observed. This was obtained, clearly, at the expense of longer SFRT values, as shown in Table 8. For the continuous technique, as expected, no significant performance changes were observed. Indeed, both SFRT and PFP values were substantially the same as the previous experiment.

6.6. Simulations with Best Effort Traffic

A final set of simulations was carried out, introducing another type of traffic, namely, best effort (BE), in addition to that relevant to the safety protocol. As in the previous section, we conducted simulations based solely on the IEEE TGn D standard. The BE traffic comprises five TCP streams at a constant rate of 5 Mbps each, simulating video streams transmitted by the slaves to the master during each cycle. Clearly, for the continuous polling technique, since the access to the physical medium is completely unregulated, the safety traffic will result as mixed up with the BE one. Conversely, the slotted technique allows us to add a further window reserved for the BE traffic that, in such a way, becomes separated by the safety one. Figure 7 illustrates the new traffic schedule. As can be seen, in addition to the BE window a new one was added, namely, guard band, that realizes a separation between the two types of traffic, with the aim of ensuring the BE traffic will not influence the safety one. In these experiments, we set the watchdog timeout to 30 m s .
Table 9 presents the statistics of SFRT.
As expected, when using continuous polling, SFRT shows a significant degradation compared to the case without BE traffic. Both the standard deviation and the maximum values are considerably higher and, in most cases, are well beyond the maximum expected upper bound. However, also the slotted polling shows a degradation, as is evidenced by the behavior of the PFP reported, respectively, in Table 10 and Figure 8.
In actuality, the PFP is considerably increased in comparison with the previous cases. The analysis we carried out showed that the problem is caused by the traffic congestion in the BE window. Thus, similarly to the phenomenon described in Section 6.2, packets delivered to the MAC layer to be transmitted in the BE window were moved ahead, overlapping the slots assigned to the safety traffic. An in-depth analysis of the experimental outcomes revealed that the problem is more evident for low MCSs. This is understandable, since the use of low MCSs reflects in longer polling times that are, clearly, more prone to exceeding the timeout and, hence, to causing a polling failure.
Obviously, increasing the size of the guard band windows (and possibly that of all the other windows as well) could represent an immediate solution to the problem; however, this solution has the evident drawback of reducing performance and efficiency. Indeed, as shown in Section 6.5, this causes a worsened behavior of the SFRT. Also, the efficiency of the protocol is lowered because it is likely that windows might remain unused for long times.

7. Conclusions

In this paper, we conducted an in-depth analysis regarding the possibility of adopting the Time-Sensitive Networking (TSN) family of standards for functional safety networks implemented over wireless systems. The assessment started with the definition a functional safety reference protocol and was followed by an extensive campaign of simulations aimed at investigating the behavior of some meaningful performance indexes. The outcomes demonstrated the indubitable benefits that can be achieved with the adoption of TSN, even if, due to the unavoidable limitations of an analysis based on simulations, some more in-depth studies are necessary to achieve a completely satisfactory assessment.
A very important aspect that emerged from the simulation campaign is that TSN features need to be adequately harmonized with the behavior of the underlying MAC layer to obtain effective results. Indeed, it was shown that frames delivered by TSN to the MAC layer may be actually transmitted with unexpected delays, due to the occurrence of retransmissions of formerly queued frames, random backoff times, and beacons. Such delays have a negative impact on the behavior of the functional safety protocols since both the considered performance indexes (SFRT and PFP) are worsened. Thus, it is of prominent importance to ensure that frames delivered by TSN to the MAC layer are transmitted while maintaining the specified timing.
Further future activities are expected to extensively address the aforementioned issues. It is envisaged that they will refer to real prototype systems, as well as to simulated environments and theoretical analyses. The implementation of the functional safety reference protocol on real devices is expected to be straightforward, provided that the TSN stack is available for such devices. To this regard, in [31], some preliminary results are provided that report on the implementation of the TSN IEEE 802.1 AS protocol on Intel NUCs (Next Unit Computers). Experiments on real systems will be useful, in particular, to take into account and evaluate additional delays and latency introduced by real components that cannot be determined in other ways. Simulations and theoretical analyses will allow researchers to address more complex systems that typically cannot implemented in practice. Also, the results obtained on the real prototypes can be used to better tune simulation and theoretical models so that they can provide more realistic results.

Author Contributions

Conceptualization, A.M. and S.V.; data curation, C.Z. and A.M.; funding acquisition, S.V.; investigation, F.T. and S.V.; methodology, F.T. and S.V.; supervision, F.T. and S.V.; visualization, A.M. and M.C.; writing—original draft, A.M., M.C., F.T., S.V. and C.Z.; writing—review and editing, A.M., M.C., F.T., S.V. and C.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This study was carried out within the PNRR research activities of the consortium iNEST (Interconnected Nord-Est Innovation Ecosystem) funded by the European Union Next-GenerationEU (Piano Nazionale di Ripresa e Resilienza (PNRR) – Missione 4 Componente 2, Investimento 1.5—D.D. 1058, 23–06–2022, ECS_00000043). This manuscript reflects only the authors’ views and opinions; neither the European Union nor the European Commission can be considered responsible for them.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rikalovic, A.; Suzic, N.; Bajic, B.; Piuri, V. Industry 4.0 Implementation Challenges and Opportunities: A Technological Perspective. IEEE Syst. J. 2022, 16, 2797–2810. [Google Scholar] [CrossRef]
  2. Xian, W.; Yu, K.; Han, F.; Fang, L.; He, D.; Han, Q.L. Advanced Manufacturing in Industry 5.0: A Survey of Key Enabling Technologies and Future Trends. IEEE Trans. Ind. Inform. 2023; 1–15. [Google Scholar] [CrossRef]
  3. Nahavandi, S. Industry 5.0—A human-centric solution. Sustainability 2019, 11, 4371. [Google Scholar] [CrossRef]
  4. Platform Industrie 4.0. Available online: https://www.plattform-i40.de (accessed on 28 August 2023).
  5. Longo, F.; Padovano, A.; Umbrello, S. Value-Oriented and Ethical Technology Engineering in Industry 5.0: A Human-Centric Perspective for the Design of the Factory of the Future. Appl. Sci. 2020, 10, 4182. [Google Scholar] [CrossRef]
  6. Breque, M.; De Nul, L.; Petridis, A. Industry 5.0—Towards a Sustainable, Human-Centric and Resilient European Industry; Publications Office of the European Union: Brussels, Belgium, 2021. [Google Scholar] [CrossRef]
  7. Xu, X.; Lu, Y.; Vogel-Heuser, B.; Wang, L. Industry 4.0 and Industry 5.0—Inception, conception and perception. J. Manuf. Syst. 2021, 61, 530–535. [Google Scholar] [CrossRef]
  8. Vitturi, S.; Zunino, C.; Sauter, T. Industrial Communication Systems and Their Future Challenges: Next-Generation Ethernet, IIoT, and 5G. Proc. IEEE 2019, 107, 944–961. [Google Scholar] [CrossRef]
  9. Bicaku, A.; Schmittner, C.; Tauber, M.; Delsing, J. Monitoring industry 4.0 applications for security and safety standard compliance. In Proceedings of the 2018 IEEE Industrial Cyber-Physical Systems (ICPS), St. Petersburg, Russia, 15–18 May 2018; pp. 749–754. [Google Scholar]
  10. IEC 61784-3; Industrial Communication Networks–Profiles—Part 3: Functional Safety Fieldbuses—General Rules and Profile Definitions. Technical Report; International Electrotechnical Commission: Geneva, Switzerland, 2021.
  11. Lo Bello, L.; Steiner, W. A Perspective on IEEE Time-Sensitive Networking for Industrial Communication and Automation Systems. Proc. IEEE 2019, 107, 1094–1120. [Google Scholar] [CrossRef]
  12. Fedullo, T.; Morato, A.; Tramarin, F.; Rovati, L.; Vitturi, S. A Comprehensive Review on Time Sensitive Networks with a Special Focus on Its Applicability to Industrial Smart and Distributed Measurement Systems. Sensors 2022, 22, 1638. [Google Scholar] [CrossRef]
  13. Cavalcanti, D.; Perez-Ramirez, J.; Rashid, M.M.; Fang, J.; Galeev, M.; Stanton, K.B. Extending Accurate Time Distribution and Timeliness Capabilities Over the Air to Enable Future Wireless Industrial Automation Systems. Proc. IEEE 2019, 107, 1132–1152. [Google Scholar] [CrossRef]
  14. Peserico, G.; Morato, A.; Tramarin, F.; Vitturi, S. Functional Safety Networks and Protocols in the Industrial Internet of Things Era. Sensors 2021, 21, 6073. [Google Scholar] [CrossRef]
  15. Huang, Z.; Jiang, X.; Chen, L.; Fan, D. Research on Safe Communication Architecture for Real-Time Ethernet Distributed Control System. IEEE Access 2019, 7, 89821–89832. [Google Scholar] [CrossRef]
  16. Buja, G.; Menis, R. Dependability and Functional Safety: Applications in Industrial Electronics Systems. IEEE Ind. Electron. Mag. 2012, 6, 4–12. [Google Scholar] [CrossRef]
  17. Åkerberg, J.; Gidlund, M.; Lennvall, T.; Neander, J.; Björkman, M. Efficient Integration of Secure and Safety Critical Industrial Wireless Sensor Networks. EURASIP J. Wirel. Commun. Netw. 2011, 2011, 100. [Google Scholar] [CrossRef]
  18. Yang, D.; Ma, J.; Xu, Y.; Gidlund, M. Safe-WirelessHART: A Novel Framework Enabling Safety-Critical Applications Over Industrial WSNs. IEEE Trans. Ind. Inform. 2018, 14, 3513–3523. [Google Scholar] [CrossRef]
  19. Pimentel, V.; Nickerson, B.G. A Safety Function Response Time Model for Wireless Industrial Control. In Proceedings of the IECON 2014—40th Annual Conference of the IEEE Industrial Electronics Society, Dallas, TX, USA, 29 October–1 November 2014; pp. 3878–3884. [Google Scholar] [CrossRef]
  20. IEEE 802.15.4; IEEE Standard for Low–Rate Wireless Networks. Technical Report; IEEE: Piscataway, NJ, USA, 2020.
  21. Hadziaganović, A.; Atiq, M.K.; Blazek, T.; Bernhard, H.P.; Springer, A. The performance of openSAFETY protocol via IEEE 802.11 wireless communication. In Proceedings of the 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vasteras, Sweden, 7–10 September 2021; pp. 1–8. [Google Scholar] [CrossRef]
  22. Liu, Z.; Wang, H.; Wei, H.; Liu, M.; Liu, Y.H. Prediction, Planning, and Coordination of Thousand-Warehousing-Robot Networks With Motion and Communication Uncertainties. IEEE Trans. Autom. Sci. Eng. 2021, 18, 1705–1717. [Google Scholar] [CrossRef]
  23. Zhang, Z.; Guo, Q.; Chen, J.; Yuan, P. Collision-Free Route Planning for Multiple AGVs in an Automated Warehouse Based on Collision Classification. IEEE Access 2018, 6, 26022–26035. [Google Scholar] [CrossRef]
  24. IEC 61800 Standard; Adjustable Speed Electrical Power Drive Systems—Part 5-2: Safety Requirements-Functional. International Electrotechnical Commission: Geneva, Switzerland, 2016.
  25. IEEE 802.11; IEEE Standard for Information Technology—Telecommunications and Information Exchange between Systems Local and Metropolitan Area Networks—Specific Requirements—Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications. IEEE: Piscataway, NJ, USA,, 2016; pp. 1–3534. [CrossRef]
  26. Erceg, V.; Schumacher, L.; Kyritsi, P.; Molisch, A.; Baum, D.S.; Gorokhov, A.Y.; Oestges, C.; Li, Q.; Yu, K.; Tal, N.; et al. IEEE 802.11-03/0940-01-000n, Std.; TGn Channel Models. Technical Report; IEEE: Piscataway, NJ, USA, 2004.
  27. IEEE Std 802.1AS-2020 (Revision of IEEE Std 802.1AS-2011); IEEE Standard for Local and Metropolitan Area Networks–Timing and Synchronization for Time-Sensitive Applications. IEEE: Piscataway, NJ, USA, 2020; pp. 1–421. [CrossRef]
  28. IEEE Std 802.1Qbv-2015 (Amendment to IEEE Std 802.1Q-2014 as amended by IEEE Std 802.1Qca-2015, IEEE Std 802.1Qcd-2015, and IEEE Std 802.1Q-2014/Cor 1-2015); IEEE Standard for Local and Metropolitan Area Networks—Bridges and Bridged Networks—Amendment 25: Enhancements for Scheduled Traffic. IEEE: Piscataway, NJ, USA, 2016; pp. 1–57. [CrossRef]
  29. Montgomery, K.; Candell, R.; Hany, M.; Liu, Y.; Montgomery, K. Wireless User Requirements for the Factory Workcell; Technical Report NIST AMS 300-8r1-upd; National Institute of Standards and Technology (U.S.): Gaithersburg, MD, USA, 2021. [Google Scholar] [CrossRef]
  30. Sofia, R.C.; Kovatsch, M.; Mendes, P. Requirements for Reliable Wireless Industrial Services. 2021. Available online: https://datatracker.ietf.org/doc/draft-sofia-raw-industrialreq-00 (accessed on 31 July 2023).
  31. Morato, M.; Zunino, C.; Cheminod, M.; Vitturi, S.; Cavalcanti, D.; Sudhakaran, S.; Tramarin, F. Evaluating the Integration of Wireless Time-Sensitive Networking with Software-Defined Networking for Dynamic Network Configuration. In Proceedings of the 28th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Sinaia, Romania, 12–15 September 2023; IEEE: Sinaia, Romania, 2023. [Google Scholar]
Figure 1. Example of semiautomated warehouse.
Figure 1. Example of semiautomated warehouse.
Sensors 23 07825 g001
Figure 2. IEEE 802.1Qbv gates schedule.
Figure 2. IEEE 802.1Qbv gates schedule.
Sensors 23 07825 g002
Figure 3. Cycle time densities.
Figure 3. Cycle time densities.
Sensors 23 07825 g003
Figure 4. Scheduling problems caused by the MAC layer. Panel (a) shows the retransmission of a frame due to the missing ACK; (b) shows the presence of a beacon frame that causes the delay of the transmission of a frame. (a) The missing ACK of the frame at 4.347003 s causes the retransmission of the frame after a random backoff at 4.347194 s. The transmission overlaps with the window reserved to the device with IP address 0.0.0.2 which is delayed, and in turn compromises the scheduling of the other devices. (b) The presence of the beacon frame at 4.397513 s causes the delay of the frame from the device with IP address 0.0.0.5, which performs the transmission in the window reserved for the master.
Figure 4. Scheduling problems caused by the MAC layer. Panel (a) shows the retransmission of a frame due to the missing ACK; (b) shows the presence of a beacon frame that causes the delay of the transmission of a frame. (a) The missing ACK of the frame at 4.347003 s causes the retransmission of the frame after a random backoff at 4.347194 s. The transmission overlaps with the window reserved to the device with IP address 0.0.0.2 which is delayed, and in turn compromises the scheduling of the other devices. (b) The presence of the beacon frame at 4.397513 s causes the delay of the frame from the device with IP address 0.0.0.5, which performs the transmission in the window reserved for the master.
Sensors 23 07825 g004
Figure 5. SFRT densities.
Figure 5. SFRT densities.
Sensors 23 07825 g005
Figure 6. Comparison of failed pollings occurrence.
Figure 6. Comparison of failed pollings occurrence.
Sensors 23 07825 g006
Figure 7. IEEE 802.1Qbv gates schedule with BE traffic.
Figure 7. IEEE 802.1Qbv gates schedule with BE traffic.
Sensors 23 07825 g007
Figure 8. Comparison of failed polling occurrence with BE traffic.
Figure 8. Comparison of failed polling occurrence with BE traffic.
Sensors 23 07825 g008
Table 1. Countermeasures implemented by the functional safety reference protocol.
Table 1. Countermeasures implemented by the functional safety reference protocol.
Countermeasure Description
Safety cyclic redundancy check (CRC)Additional safety-related CRC
PDU numberingNumbering of safety PDUs exchanged between master and slaves
WatchdogTime-out associated with each device
Slave authenticationUnique address assigned to each slave and stored by the master
Table 2. Error detection by the functional safety reference protocol.
Table 2. Error detection by the functional safety reference protocol.
ErrorCountermeasures
CorruptionCRC and watchdog
RepetitionPDU numbering
Incorrect sequencePDU numbering
LossPDU numbering and watchdog
DelayWatchdog
InsertionSlave authentication
MasqueradeCRC and slave authentication
AddressingSlave authentication
Table 3. Variables for SFRT calculation.
Table 3. Variables for SFRT calculation.
VariableMeaning
T p i Polling time of Slave i
T p i m a x Maximum polling time of Slave i
T O i Timeout Slave i
T c Cycle time of the network (continuous polling)
T c m a x Maximum cycle time of the network
T s l i Slot time of Slave i
PPeriod of the network (slotted polling)
Table 4. Simulation parameters.
Table 4. Simulation parameters.
ParameterValue
Environment area50 m × 43 m
AP transmission power16.0206 dBm
STA transmission power16.0206 dBm
Number of antennas1
Spatial streams1
MCS0 to 7
Frequency5 GHz
Number of APs1 (Master)
Number of STAs5 (Slaves)
Traffic typeUDP
Propagation loss modelIEEE TGn D and IEEE TGn E
Propagation delay modelConstant speed delay model
Table 5. Cycle time statistics.
Table 5. Cycle time statistics.
TSN d BP MCSMean ( μ s)Std ( μ s)Min ( μ s)Max ( μ s)
False1001934.76468.14389.0015,749.00
11680.99441.00386.0015,774.00
21650.95424.41387.0015,781.00
31629.19400.15388.0015,689.00
41629.31374.46390.0015,776.00
51634.01375.94400.0015,764.00
61630.92371.12390.0015,647.00
71618.29377.75390.0015,746.00
2001967.58462.97389.0015,736.00
11706.94426.94386.0015,711.00
21656.86429.96387.0015,738.00
31635.75408.02388.0015,734.00
41624.73381.28390.0015,367.00
51638.84362.99390.0015,716.00
61626.05368.42390.0015,656.00
71639.32370.15399.0015,695.00
True1002103.99452.232000.006000.00
12009.13136.942000.006000.00
22005.95111.072000.006000.00
32003.9890.712000.006000.00
42002.3669.502000.006000.00
52002.6673.882000.006000.00
62003.0780.442000.006000.00
72002.9477.652000.006000.00
2002108.28460.592000.006000.00
12009.87142.352000.006000.00
22006.34114.782000.006000.00
32004.5897.292000.006000.00
42002.8076.092000.006000.00
52003.1480.652000.006000.00
62003.1280.112000.006000.00
72003.1581.012000.006000.00
Table 6. SFRT statistics.
Table 6. SFRT statistics.
PollingReasonSourceMean ( μ s)Std ( μ s)Min ( μ s)Max ( μ s)Expected Maximum ( μ s)
ContinuousTriggerMaster3170.77473.632529.005670.00200,000.00
Slave4104.051134.602753.0014,424.00200,000.00
WDTMaster2808.301528.691619.0020,197.00200,000.00
Slave4941.504512.012878.0014,143.00200,000.00
SlottedTriggerMaster1700.57545.05922.003832.004000.00
Slave3488.00828.131845.006677.004000.00
WDTMaster2015.002015.002015.004000.00
Slave
Table 7. Failed polling statistics.
Table 7. Failed polling statistics.
PollingFailed PollingsTotal CyclesTotal PFP (%)
Continuous67012,522,4530.005350
Slotted410,569,2650.000038
Table 8. SFRT statistics for the scenario with 10 ms cycle time.
Table 8. SFRT statistics for the scenario with 10 ms cycle time.
PollingReasonSourceMean ( μ s)Std ( μ s)Min ( μ s)Max ( μ s)Expected Maximum ( μ s)
ContinuousTriggerMaster3147.93750.232585.007685.00200,000.00
Slave4129.081134.982342.0015,408.00200,000.00
WDTMaster2705.951002.931812.0011,806.00200,000.00
Slave3449.00554.373057.003841.00200,000.00
SlottedTriggerMaster7871.211890.234129.009863.0020,000.00
Slave15,524.012711.759020.0019,990.0020,000.00
WDTMaster
Slave
Table 9. SFRT statistics for the scenario with BE traffic.
Table 9. SFRT statistics for the scenario with BE traffic.
PollingReasonSourceMean ( μ s)Std ( μ s)Min ( μ s)Max ( μ s)Expected Maximum ( μ s)
ContinuousTriggerMaster
Slave
WDTMaster45,948.13155,899.954196.001,072,153.00300,000.00
Slave38,611.4371,221.217597.00580,603.00300,000.00
SlottedTriggerMaster11,850.793830.295183.0017,949.0030,000.00
Slave24,534.184592.1114,690.0033,752.0030,000.00
WDTMaster76,212.50221,582.994047.00933,050.0030,000.00
Slave46,704.63127,422.1714,188.00900,138.0030,000.00
Table 10. Failed polling statistics with BE traffic.
Table 10. Failed polling statistics with BE traffic.
PollingFailed PollingsTotal CyclesTotal PFP (%)
Continuous17,6291,506,4781.170213
Slotted1753613,4170.285776
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Morato, A.; Vitturi, S.; Tramarin, F.; Zunino, C.; Cheminod, M. Time-Sensitive Networking to Improve the Performance of Distributed Functional Safety Systems Implemented over Wi-Fi. Sensors 2023, 23, 7825. https://doi.org/10.3390/s23187825

AMA Style

Morato A, Vitturi S, Tramarin F, Zunino C, Cheminod M. Time-Sensitive Networking to Improve the Performance of Distributed Functional Safety Systems Implemented over Wi-Fi. Sensors. 2023; 23(18):7825. https://doi.org/10.3390/s23187825

Chicago/Turabian Style

Morato, Alberto, Stefano Vitturi, Federico Tramarin, Claudio Zunino, and Manuel Cheminod. 2023. "Time-Sensitive Networking to Improve the Performance of Distributed Functional Safety Systems Implemented over Wi-Fi" Sensors 23, no. 18: 7825. https://doi.org/10.3390/s23187825

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop