Next Article in Journal
Cognitive States Matter: Design Guidelines for Driving Situation Awareness in Smart Vehicles
Previous Article in Journal
Skip Re-Entry Trajectory Detection and Guidance for Maneuvering Vehicles
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Detection of Abnormal Respiration from Multiple-Input Respiratory Signals

Department of Computer Engineering, Keimyung University, Daegu 42601, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(10), 2977; https://doi.org/10.3390/s20102977
Submission received: 13 April 2020 / Revised: 22 May 2020 / Accepted: 22 May 2020 / Published: 24 May 2020
(This article belongs to the Section Communications)

Abstract

:
In this paper, we propose a novel approach for the detection of abnormal signals from multiple respiration signals. An ultrawide-band (UWB) radar was used to acquire respiration signals that represent a distance from the chest to the radar sensor, i.e., shape variation of the chest due to breathing (inhaling or exhaling) activity provides quantitative information (distance values) about respiratory status. Distribution, shape, and variation of values across time provide information to determine respiratory status, one of the most important indicators of human health. In this paper, respiratory status was categorized into two classes, normal and abnormal. Abnormal respiration (apnea in this paper) was emulated by interrupting breathing activity because it is difficult to acquire real apnea from patients in hospital wards. This paper considered two cases, single and multiple respiration. In the first case, a single normal- or abnormal-respiration signal was used as input, and output was the classified status of respiration. In the second case, multiple respiration signals were simultaneously used as inputs, and we focused on determining the existence of abnormal signals in multiple respiration signals. In the case of multiple inputs, filters with varying cut-off frequency were applied to input signals followed by the analysis of output signals in response to the filters. To substantiate the proposed method, experiment results are provided. In this paper, classification results showed 93 % of the successful rate in the case of multiple inputs, and results are promising for applications to monitoring systems of human respiration.

1. Introduction

Rates or states of respiration are considered one of the most important indicators to evaluate the physical, physiological, and psychological state of human health because breathing activity is the most important and crucial task for humans. According to a significant growth of demand for monitoring human vital signs (or other appropriate indicators that provide information about human health), numerous research activities have been performed in practical areas to yield the comfortable, simple, and accurate measurement of vital signs. Failure of adequate respiration can lead to critical and risky health status in a few minutes, so continuously monitoring respiratory status is crucial and mandatory in clinical fields. To acquire vital signals from a person, there are various types of instruments, but in general, the measuring method is categorized into two classes, contact and noncontact. As both methods utilize data acquired from organs related to breathing activity, instrument sensitivity affects the quality of the acquired respiration data. In contact-based methods, sensing devices (e.g., sensors) are generally attached to the human body to acquire vital signals. Noncontact based methods also employ sensing devices, but those are not attached to the human body. Contact-based methods are usually considered more reliable and accurate than noncontact-based ones. In hospital wards, by using contact-based methods, vital signals are measured on a daily basis, but patients suffer from discomfort or difficulties in the use of the instruments or devices while being measured, especially child patients or burn victims. Thus, contact-based methods have limitations in the long-term use for continuous monitoring, and once measurement starts, movement or other activities except for breathing are not accepted, and this restriction can distress patients or other tested persons. Despite the limitations, contact-based methods are widely employed for clinical evaluation because hospital environments are almost perfectly settled up so that respiration data can be acquired and stored with reliable and stable accuracy. Contact-based methods usually evaluate respiratory status on the basis of the sounds, movements, or temperature of the human body (positions of the parts are usually close to respiratory organs). As breathing activity (inhalation and exhalation) induces variation or movement of respiration-related organs, the technology of respiratory measurement focuses on the movement or variation of those parts where the devices are attached. Airflow-based methods detect respiration status on the basis of the characteristics of inhalation and exhalation. Widely used flow-sensing techniques are differential flowmeters (DF), turbine flowmeters (TF), hot-wire anemometers (HWA), and fiberoptic sensors (FOS). Variations of humidity, velocity, or temperature appear differently in phases of inhalation and exhalation, and the distribution of acquired respiratory data enables us to estimate respiratory rate. Air temperature or volume (or their variations) during exhalation and inhalation or nasal pressure also provides data to be analyzed to monitor respiratory status. To achieve accurate results in airflow-based methods, measurements need to be performed in a controlled environment [1]. In addition to using temperature or volume, movements of the chest or the abdominal wall can also be used to monitor respiratory status, and the device is attached to a position near the chest. Fiberoptic-based measurement employs a photodetector to measure light power that estimates the variation of intensity caused by inhalation and exhalation [2]. To utilize airflow data to predict or indicate respiratory status, high sensitivity of equipment, accurate postprocessing, and perfect experiment setup are required, and to be monitored in a real-time manner, the sensor must always be exposed to inhaling and exhaling activities. Acoustics-based methods utilize respiratory patterns such as variation, loudness, or the frequency spectrum of a measured signal to assess respiratory status with sensors or microphones. Microphones, considered a simple method to implement, are usually located in the front of the neck or nose to acquire breathing sounds during sleep or regular activities. Analysis of the measured respiration signals is carried out in various domains such as frequency, time, Z, and wavelet [3]. Acoustics-based methods (usually focusing on the detection and classification of respiration phases) have gained attention as an alternative to airflow-based methods due to their simplicity and convenience [4,5,6]. However, as devices need to be placed close to or attached to the throat, respiration airways, or in front of the nose, or be attached to the neck, the measurement methods are prone to discomfort. In addition to discomfort, if external noise signals are added to the respiration signals, measurement accuracy is degraded, leading to a demand for the preprocessing of acquired signals [7]. Electrocardiogram (ECG) signals have been widely used to measure the electrical activity of the heart from where respiration signals can be separated, and the separated signal is called ECG-derived respiration (EDR) [8]. Once anECG signal is acquired, it consists of the heart rate, respiratory rate, and an additive noise signal, and the mixture of all signals leads to needing to extract respiration data with techniques of signal processing. In contact- or noncontact-based methods, numerous algorithms have been proposed to accurately estimate the respiratory rate from an electrocardiogram (ECG) on the basis of information about chest movements (this is related to heart rate and lung volume) indicating human respiratory status. In ECG-derived methods, approaches to the decomposition of target data were proposed such as component analysis (principal-component analysis (PCA), independent component analysis, kernel PCA, adapted PCA, and canonical CA), decomposition (empirical-mode decomposition, wavelet decomposition), and correlation analysis or learning-based classification [9,10,11,12]. ECG signals are acquired and recorded by the movement of electrodes attached to the chest surface, having relative positions to the heart during respiratory activity. Once the acquisition process starts, P, QRS, and T waves are carefully observed and analyzed. The P wave is associated with right and left atrial depolarization, QRS (called the QRS complex) is associated with right and left ventricular depolarization, and the T wave represents ventricular repolarization. ECG-derived respiration analyzes these waves, and this is a very well known simple method to monitor respiratory status unless motion artefacts are eliminated [13,14]. In optical-fiber-based measurements, the polymeric optical fiber sensitively responds to the applied pressure, enabling to monitor respiratory status and manufacture wearable devices for measurements [15]. If a statistical assumption about respiration signals does not hold in realistic environment (for example, an ICA (independent component analysis)-based method tries to decompose ECG signals into independent components, so statistical independence is assumed between the subcomponents of the ECG signal), it does not guarantee the accurate measurement of respiratory status.
Recently, noncontact (noninvasive)-based respiration measurement has been of interest because of the development of wearable devices and the increasing demand for the convenient and long-term continuous monitoring of the physiological status of patients [16]. Thus, noncontact-based methods are considered an alternative to contact-based ones, practically providing convenience and simplicity to monitor respiratory status because sensing devices do not have to be attached to the human body. Sensing devices are usually at a distant position so that a person can perform their usual activities while real-time and long-term measurement is in process. The range of working distance between device and human body depends on the hardware performance of the device, which is not discussed in this paper. The methods monitor respiratory states on the basis of variations of the morphology, geometry, intensity, or temperature of target areas such as the chest or throat. Although noncontact-based methods provide convenience, a controlled experiment setup is still required, similarly to contact-based ones, because the existence of external noise can degrade measurement performance. Among many noncontact-based methods, radar-based ones are of the most widely used, minimizing discomfort with low cost; their basic principle is to measure the distance between sensor and human body (especially part of the chest) using transmitted and received radar signals. Inhalation and exhalation generate chest-shape variations, leading to a change of distance from the radar to the chest surface and respiratory status can be indirectly estimated. A Doppler radar detects respiratory patterns in addition to measuring respiratory rate, facilitating the real-time monitoring of respiratory status [17]. A combination of vibration and pyroelectric infrared (PIR) sensors is a noncontact-based method; the former detects and measures vibrations and the latter detects thoracic movements resulted from breathing activity. Vibration sensors detect the motion of a target and convert mechanic motions to electrical signals. Both sensors are located at distant positions from the human body, and multimodal signal processing is conducted (wavelet and empirical-mode decomposition) using the periodicity of breathing activity [18]. Doppler radars also measure respiration signals composed of harmonic interference, the movements of any part of human body, clutter noise, etc. Respiration signals are measured and analyzed on the basis of the difference of phases between transmitted and received signals that are represented in harmonic basis. The movement of the nasal part of the human body affects phase changes [19]. A received respiration signal is analyzed in the frequency domain, and respiratory status, such as normal breathing, inhalation, exhalation, or sleep apnea, is estimated for classification. Estimation of respiration in the time domain employs a correlation model to measure respiratory rate [20]. As the Doppler radar measures phase changes to measure the displacement of a chest surface, measurement setup should be carefully carried out so that other activities (called motion artefacts) except for respiration are not measured by the radar. In addition to the noise, the bandwidth of the heartbeat signal overlaps with that of the respiration signal, so concerning the above problems, the classification or separation of respiration signals from motion artefacts is desired. To remove or minimize artefacts, algorithms were proposed to process input signals, such as denoising, signal separation (e.g., blind-source separation), and the decomposition of signals [21]. Optical-imaging systems are another way of noncontact-based monitoring by detecting or observing respiratory patterns such as movements of the chest or thorax during breathing [22]. This method chiefly deals with static or dynamic images so it can track motions induced by breathing activities or track changes of the chest or abdominal surface. Accurate motion tracking (related to breathing activity) is required in optical-imaging-based methods so that the system can register the deformed shape of a body part while removing motion artefacts and determine respiratory status [23]. According to the development of imaging technology, the image-based estimation of respiratory status is considered another popular method. Thermal sensors or images can provide information to monitor respiratory status, and a commercial digital camera with low cost can be used. Detection of the warmest and coolest area in the human face is carried out with high accuracy, and measurement of thermal changes is performed with high accuracy. Thermal image (or infrared thermography)-based methods monitor respiration profiles by measuring thermal variations and hyperventilation, detecting or tracking target areas related to breathing activity (e.g., nose, throat, or chest) to detect unusual respiratory patterns [24]. There is no absolute solution to achieve to most accurately register respiratory status. However, with significant progress in measuring technology, respiration signals play a key role in the prediction and estimation of human health. However, as measurement convenience and simplicity, respiration-based estimation of health status is a crucial part in healthcare fields. Abnormal respiration can be an indicator of a chronic condition such as physiological instability, pneumonia, chronic obstructive pulmonary disease (COPD), or chronic obstructive lung disease, so real-time and continuous long-term monitoring with a relatively low cost of respiration measurement is very important in practice. In the course of the respiration-based estimation of health status, there are two main approaches. One is to measure the respiratory rate, and the other is to detect and classify respiratory patterns. Conventional works focus more on the former, and recent work has begun to focus on the latter.
In this paper, we chiefly focus on the detection and classification of respiratory status that is categorized into two classes, normal and abnormal respiration. Previous work on the processing and analysis of respiration signals has chiefly dealt with measuring the respiratory rate rather than providing information about respiratory status. Using an ultrawide-band (UWB) radar, exhalation and inhalation generate a waveform that represents the distance between radar and chest surface. Distance varies with exhalation and inhalation, and different respiration statuses generate different waveforms. This paper chiefly deals with two cases: single- and multiple-respiration signals. The former used one respiration signal and the latter multiple (two or three) signals as input. In the case of the single input, the received signal was analyzed in the Z-domain given one known respiration datum, particularly using pole and zero positions. In the cases of multiple inputs, under the assumption that inputs are simultaneously received, the proposed approach detected the existence of abnormal respiration. The proposed approach, to summarize, aimed at detecting and classifying respiratory status. The proposed approach classifies respiration status considering two main environments. The first is classifying respiratory status using a single-input signal. The second uses multiple (more than two)-input respiration signals as inputs; then, inputs containing at least one abnormal respiration signal are distinguished from those that do not contain abnormal signals. In a real environment, such as vehicles (driver and passengers in a car), this leads to increased necessity to propose an approach for the detection of abnormal respiration from multiple inputs. To substantiate the proposed approach, real respiration signals were acquired using a radar sensor, and respiratory status was classified. The rest of the paper is organized as follows. Section 2 describes the respiration acquisition using a radar sensor. Section 3 presents the proposed approach for the detection of abnormal respiration in the case of single and multiple inputs. Section 4 shows the experiment results of respiratory-status classification, and concludes this paper.

2. Acquisition of Respiration Signals

This work is on the detection of abnormal respiration signals in more practical environments rather than environments in hospital wards. In other words, the acquisition of respiration signals is carried out on the basis of usual conditions in daily-life spaces (house or study rooms). In previous or currently existing works on respiration signal, it chiefly deals with the accurate measurement of the respiratory rate because it (or the number of inhalations and exhalations) is a very important indicator to evaluate human health. However, accuracy highly depends on hardware performance. However, we focused on more practical cases, such as outdoor and indoor environments (e.g., inside a car) rather than the environment in hospital wards. We chiefly focused on monitoring the state of human respiration, and investigated whether abnormal respiration existed so that pre-emptive actions could be taken in practical conditions. We dealt with two cases. First, we used two respiration signals to determine the abnormal status of a single respiration (Section 3.1 details this case). In particular, given one respiration signal whose status is already known, it is investigated whether the next input respiration is normal or abnormal. In this case, we investigated the pole-zero plot of the data transformed to the Z domain, and the status of the next respiration affected the distribution of the locations of poles and zeros. Second, we used multiple respiration signals simultaneously; then, the existence of abnormal respiration was detected using a high pass filter by varying cut-off frequency (Section 3.2 details this case). This paper utilized an ultrawide-band (UWB) radar sensor to acquire the respiration signal, and the received waveform reflected the shape variation of the chest surface. The UWB radar has also been used for gesture or motion recognition or detection because it transmits and receives high-frequency signals with high speed and resolution, and low-power consumption [25]. Novelda X4 (Novelda, Oslo, Norway) shows better performance than a traditional radar sensor due to its compact size, efficient power consumption, accuracy, and speed. It has better performance than that of a microwave radar (e.g., Doppler) because it is robust to interference and has high resolving power. In general, if a UWB radar is used, the frequency band is in the range of 3.1–10.6 GHz. This frequency band is robust to interference, has high-speed communication, and coverage is from 2 to 10 m. According to the policy of distribution of the frequency band, 3.1–4.8 GHz (low band) and 7.2–10.2 GHz (high band) are assigned; this work used 8.2 GHz for the experiments. This was a single small chip that detected small changes or movements of a chest surface during breathing. Novellda X4 is also considered suitable for monitoring heart rate in hospitals. In areas of motion or gesture recognition, image-based algorithms have gained more attention than other ones. However, image-based algorithms that usually acquire data using a photo or video camera have drawbacks in environments with ambient light, low light, fog, smoke, etc. UWB radars are robust to noise factors as those mentioned above, particularly having accurate measurements in low-light conditions (this is important because respiration is monitored during sleep in medical fields), making it suitable for measuring human respiration [26]. The sensor was located about 30–50 cm from the chest surface. Shape variations come from the movement of the chest surface with breathing. Exhalation and inhalation generate distance variation between radar sensor and chest surface. The present work with the noncontact-based measurement of respiration employed UWB EVM (BR-EVM-2000) Novellda X4, and signal acquisition was done by adults in a real environment (Figure 1).
Once the radar detects a movement of the chest surface from inhalation and exhalation, the distance between radar and chest surface is generated as a waveform that can provide crucial information about respiratory status. In this work, we aimed at classifying respiratory status into two categories, normal and abnormal respiration. Normal respiration generates a waveform that is similar to sinusoidal; in abnormal respiration, the waveform shape is different than that of the normal. In this paper, apnea is considered abnormal respiration, and other kinds of abnormal-respiration signals are not discussed in the paper because it is difficult to acquire diverse abnormal-respiration signals unless they are collected in hospital wards. Normal-respiration signals are acquired in the following conditions:
  • stable pose without any other activities,
  • breathing with speaking activities, and
  • breathing with small movements (walking or after exercise).
Abnormal respiration in this paper is generated by pausing breathing for a few seconds to emulate apnea because real apnea/abnormal respiration is difficult to acquire. Respiration data are represented as a waveform for one minute. Sampling rate was ten per second, so 600 points were sampled for one minute. Once respiration signals were received, and waveforms were generated, analysis and extraction of respiratory status were conducted for detection and classification. Figure 2 shows examples of plots depicting distances varying by inhalation and exhalation. In the case of normal respiration, the plot is very similar to the sinusoidal form, and it also seemed that the waveform showed gradual (or smooth) variation of distance values between radar and chest. However, in the case of abnormal respiration, there existed sharp variation (or high-frequency components) in the acquired data. The frequency components of the acquired signal provided information to classify respiration status. Thus, Fourier transform or short-term Fourier transform (STFT) can be employed to analyze the characteristics of the acquired respiration signals.

3. Detection of Existence of Abnormal Status

This section details the proposed approach for detecting and classifying abnormal respiration. The overall flow of detection of abnormal respiration is depicted in Figure 3. Human respiration was measured using a UWB radar, and signal analysis could be performed in diverse domains (in this paper, in the case of a single input, Z-domain was used for analysis on the basis of a pole-zero plot. Locations of poles and zeros provided information to analyze and classify characteristics of received data). On the basis of analysis results in various domains, determination of the existence of abnormal respiration was carried out. This is different from other work that chiefly dealt with the accurate measurement of the respiratory rate itself.
In this work, similar to other work dealing with respiration data, the UWB radar received a respiration signal from a human, and the varying distance by inhalation and exhalation visualized the state of respiration. In the case of normal respiration, human breathing generally has a low-frequency component because the movement of the chest surface from respiration is gradually performed. Contrary to normal respiration, abnormal (apnea) may include a high-frequency component due to the rapid movement of the chest surface, i.e., exhalation and inhalation (including no exhalation or inhalation) being carried out over a very short period. The proposed approaches are discussed with two cases, with a single and with multiple respiration signals. The former deals with the classification of respiratory status given one respiration signal. In other words, given a respiration signal, the respiration status of the next input can be determined. Section 3.1 focuses on the determination of respiratory status given a respiration signal, and status estimation is based on Z-transform, i.e., positions of zeros and poles. In Section 3.2, we estimate respiration status with multiple-input respiration signals that are simultaneously used as inputs. Among multiple-input signals, we assumed that any input information was not provided, and the existence of abnormal respiration was detected using high-pass filter by varying the cut-off frequency. The high pass filter with cut-off frequency f c is written as
H h p f ( f ) = 1 , ( f c f f c ) ,
where H h p f ( f ) is the Fourier transform of the high-pass filter. In this paper, we used different notations for signals in the cases of a single and of multiple inputs because the proposed approaches for the detection of abnormal respiration are different from each other. In the case of a single input, to clarify input contributions, A j ( t ) or B i ( t ) was used. In the case of multiple inputs, R i ( t ) was used to represent respiration signals ( i N in both cases). Respiration data were written as
A j ( t ) = [ A j ( 1 ) , A j ( 2 ) , , A j ( N 1 ) , A j ( N ) ] , B i ( t ) = [ B i ( 1 ) , B i ( 2 ) , , B i ( N 1 ) , B i ( N ) ] , R i ( t ) = [ R i ( 1 ) , R i ( 2 ) , , R i ( N 1 ) , R i ( N ) ] ,
In this paper, input respiration data were analyzed in the Z -domain when a single respiration signal was classified. In other cases, multiple-input respiration signals were used as input, and data were analyzed in the time domain by applying a high pass filter with varying cut-off frequency.

3.1. Case 1: Single Respiration Signal

Respiration signals are represented as A i ( t ) or B i ( t ) in this section (in the time domain), and the Z transform of the signals was assumed to exist. t is defined as an index of discrete time, and x ( t ) is defined as a signal in the time domain (t is considered discrete time). Then, we can write the equation as follows.
Σ t = + | x ( t ) r t | < ,
where r represents the region of convergence (ROC) of X ( z ) , which is a Z transform of x ( t ) . Then, respiration data A j ( t ) and B i ( t ) , each of which can be analyzed in the Z domain, and their Z transform is A j ( z ) and B i ( z ) , respectively. In this section, we propose the approach for detecting the existence of apnea given a known respiratory status that is normal or abnormal. In other words, this section deals with the detection of apnea (abnormal respiration) when single-input respiration is used as input. Figure 4 depicts the flow diagram of the proposed approach to classifying respiratory status to detect the existence of abnormal respiration in the Z domain. Given respiration B i ( t ) , the proposed approach determines the status of next-input respiration A j ( t ) (either normal or abnormal status).
In particular, the proposed approach provides information about the respiratory status of A i ( t ) given B j ( t ) by analyzing the signals in Z domain. ( A i ( z ) and B j ( z ) are the Z transform of A i ( t ) given B j ( t ) , respectively). Classification of respiratory status is performed on the basis of the locations of the poles and zeros of H i j ( z ) that depend on whether A i ( z ) and B j ( z ) are in the same status or not. If respiration is normal, the shape of a signal is similar to a sinusoidal waveform; if not, the shape of a signal has constant (or rapid variation of signal values) values for a few seconds. Since the states of signals directly affect the locations of poles and zeros, we fully exploited the characteristics of H i j ( z ) .
H i j ( z ) = B i ( z ) A j ( z ) , i = 0 , 1 , j = 0 , 1 .
Given B i ( z ) , the characteristics of A j ( z ) enable us to classify the respiratory status of A j ( z ) . In practice, in a vehicle, the respiratory status of a driver is given, and the respiration of another person (this person is usually located next to the driver) can be monitored in real time. If both A i ( z ) and B j ( z ) have the same status, the pole-zero plot of A i ( z ) B j ( z ) , ( i = j ) is significantly different than that of A i ( z ) B j ( z ) , ( i j ) . Thus, it is sufficient to classify the respiratory status between two input respiration signals. However, this approach enables us to know discrepancies of respiratory status and whether a new input is abnormal respiratory status based on signal analysis in Z domain. This result is, hence, enough to provide information about the existence of abnormal status in a real environment and enables us to prepare or properly manage critical or dangerous conditions a priori. In Equation (3), A 0 ( z ) and A 1 ( z ) were interpreted as normal and abnormal respiration signals, respectively, and B 0 ( z ) and B 1 ( z ) were also interpreted as normal and abnormal, respectively. A set of input signals are any combination of respiratory status, i.e., there are four possible inputs, as shown in Table 1.
The detection of the existence of abnormal respiration is performed by analyzing the pole-zero plot of B i ( z ) A j ( z ) . Location distributions of poles and zeros vary corresponding to the different conditions of A j ( z ) and B i ( z ) . In the present work, i = j means two inputs are in the same respiratory status, and i j means two inputs are in different status. Given a respiratory status, e.g., B i ( z ) , the status of input respiration A j ( z ) generates different pole-zero distribution of H i j ( z ) , as shown in Section 4. For instance, given normal respiratory status B 0 ( z ) , the pole-zero distributions of B 0 ( z ) A 0 ( z ) and B 0 ( z ) A 1 ( z ) showed significant differences in pole-zero distribution. Similarly, given B 1 ( z ) , B 1 ( z ) A 0 ( z ) and B 1 ( z ) A 1 ( z ) showed different distributions of pole-zero plots.

3.2. Case 2: Multiple Respiration Signals

This section discusses more complicated and practical aspects in terms of the number of input respiration signals. Multiple respiration signals were used as input, and the existence of an abnormal respiratory state was then detected. This section considers two cases, of two and of three respiration signals as inputs. Figure 5 shows the overall work flow for the determination of respiratory status with multiple inputs.
The jth original respiration signal and the summation of all original signals are represented as R i j ( t ) ; ( i ( 0 , 1 ) represents indices of normal ( i = 0 ) or abnormal ( i = 1 ) respiration) and S N ( t ) , respectively. N is the number of input respiration signals, each of which is either normal or abnormal. S N ( t ) was used as input, and the observed output was y ( t ) , written by
y ( t ) = S N ( t ) h c ( t ) | f c ,
where x y is the convolution of x and y that can be any type of datum, h c ( t ) | f c represents a filter with cut-off frequency f c (Hz). In this paper, we employed a high-pass filter, and unit (Hz), which is not important here, was omitted. If analyzed in the frequency domain, Equation (4) can be rewritten as
Y ( f ) = S N ( f ) × H c ( f ) | f = f c ,
where Y ( f ) , S N ( f ) , and H c ( f ) | f = f c are the Fourier transform of y ( t ) , S N ( t ) , and h c ( t ) | f c , respectively. S N ( t ) contains high-frequency components if at least one instance of apnea (abnormal respiration) is included. As shown in Figure 8, there are parts that have rapid variations of signal amplitude. By varying the cut-off frequency of h c ( t ) | f c , corresponding output y ( t ) has distinguishable characteristics in time domain. The case of N = 2 generated three combination of inputs, i.e., normal- and normal-, normal- and abnormal-, and abnormal- and abnormal-respiration signals. The case of N = 3 generated four different combinations, i.e., containing one, two. or three abnormal-respiration signals.

4. Simulation Results

This section presents simulation results to substantiate the proposed approach. Simulations were conducted using a UWB radar that was connected to a PC, monitoring and measuring the shape or positional variation of the chest surface owing to respiration (inhalation and exhalation). Respiration signals were acquired by adults (ages from 20 to 40). The radar operated at 8.2 GHz, sampling rate was 10 (per second), and respiration was measured in an iterative manner (30 iterations). Specifications of the UWB radar used for the experiments are described in Table 2.
In the experiments, the UWB radar was on a desk, and the tested person, who was breathing normally, was about 30 cm from the radar sensor. In the case of normal and abnormal respiration, a person was breathing sitting on a chair, and the radar was in front of them. This pose was for all cases, stable, speaking, and apnea environments. Particularly in the case of normal respiration while speaking, a person was reading a book, located near the radar, and respiration was acquired by the radar. For the experiments, seven people (male and female) whose ages were in the range from twenty to forty conducted breathing activities. Figure 6 depicts the experiment setup and the scenario of acquisition, analysis, processing, and decision.
Examples of respiration signals are depicted in Figure 7 and Figure 8. The examples are composed of normal- and abnormal-respiration signals. An abnormal-respiration signal showed a partial constant of the magnitude representing nonvarying distance between radar and chest surface. Normal respiration included normal respiratory status in a stable environment (no activity and sitting on a chair) while speaking or sleeping.
In the case of a single input, i.e., input was either a normal- or an abnormal-respiration signal, and each signal was analyzed in Z-domain. The positions of zeros and poles provided information to classify respiratory status. This approach is very simple because normal- and abnormal-respiration signals have different positions of zeros and poles leading to clear classification from mathematical and visual perspectives. Results of the Z-transform of A i ( z ) B j ( z ) for four cases are shown in Figure 9.
In the cases of multiple respiration, experiments were conducted using two and three respiration signals, respectively. The former used input signals as a summation of two respiration signals, and the latter used input as the summation of three respiration signals. The addition was not conducted online due to difficulties of the experiment setup and of the simultaneous acquisition of multiple signals. When using two signals as inputs, we had three possible cases of summation:
S 1 2 ( t ) = R 0 1 ( t ) + R 0 2 ( t ) ,
S 2 2 ( t ) = R 0 1 ( t ) + R 1 2 ( t ) ,
S 3 2 ( t ) = R 1 1 ( t ) + R 1 2 ( t ) ,
where S j 2 ( t ) , ( i = 1 , 2 , 3 ), R 0 1 ( t ) , and R 1 2 ( t ) represent the summation of respiration signals, and normal- and abnormal-respiration signals, respectively (to avoid confusion with the case of single respiration, we used R j i ( t ) to represent a signal here, and R 0 1 ( t ) and R 1 2 ( t ) to represent normal and abnormal signals. Equations (9)–(12) could be similarly interpreted as Equation (6) is. Inputs were either normal or abnormal respiration as shown in Figure 7 and Figure 8. Any two respiration signals were used as input, and R i 1 ( t ) and R i 2 ( t ) ( i [ 0 , 1 ] ) were added. Examples of S j 2 ( t ) ( j [ 1 , 2 , 3 ] ) are shown in Figure 10.
Once input S N ( t ) was acquired, high-pass filter (HPF) with varying cut-off frequency applied to the input, and responses to the filter, S N ( t ) h c ( t ) | f c provided information to determine the existence of an abnormal-respiration signal between the two signals. Plots of S N ( t ) h c ( t ) | f c are shown in Figure 11.
Abnormal respiration could be detected when a combination of three respiration signals were used:
S 1 3 ( t ) = R 0 1 ( t ) + R 0 2 ( t ) + R 0 3 ( t ) ,
S 2 3 ( t ) = R 0 1 ( t ) + R 0 2 ( t ) + R 1 3 ( t ) ,
S 3 3 ( t ) = R 0 1 ( t ) + R 1 2 ( t ) + R 1 3 ( t ) ,
S 4 3 ( t ) = R 1 1 ( t ) + R 1 2 ( t ) + R 1 3 ( t ) ,
where R 0 j ( t ) and R 1 j ( t ) ( j ( 1 , 2 , 3 ) )represent normal and abnormal respiration, respectively, and S 1 3 ( t ) and S 4 3 ( t ) include all normal- and abnormal-respiration signals, respectively. S 2 3 ( t ) and S 3 3 ( t ) include one and two abnormal respiration signal(s), respectively. Detection of abnormal signals was desired in S 2 3 ( t ) , S 3 3 ( t ) , and S 4 3 ( t ) . Figure 12 shows input signals as described in Equations (9)–(12).
Similar to the case of two inputs, once input S i j ( t ) was acquired, a high-pass filter (HPF) with varying cut-off frequency was applied to the input, and responses to the filter, S i j ( t ) h c ( t ) provided information to determine the existence of an abnormal-respiration signal between the two signals. Plots of S i j ( t ) h c ( t ) are shown in Figure 13.
Accuracy of classification was calculated as classification-success rate as follows.
R A = N R A N A ,
R N = N R N N N ,
where R A and R N represent the accurate detection of existence of abnormal and normal signals (the case of Equations (8) and (12), respectively). N A is the total number of input signals ( S i j ( t ) ) that included at least one instance of abnormal respiration, and N R A is the number of results that accurately detected the existence of abnormal-respiration signals (not the number of abnormal signals). Similarly, N N and N R N are the total number of input signals that included only normal respiration, and the number of accurate determinations of the existence of normal-respiration signals (not the number of normal-respiration signals), respectively. For example, in the case of Equation (13), let us consider three inputs, one abnormal- and two normal-respiration signals. If the result of the algorithm says "abnormal respiration exists in the input", the algorithm was considered to be correct, i.e., N R A = N R A + 1 . Accuracy is shown in Table 3. Previous work on investigating respiratory status usually focused on the accurate measurement of respiratory rate, and the detection of respiratory patterns usually deals with a single respiration signal. Although it is difficult to directly compare the proposed work to existing work, we compared the detection success rate of abnormal respiration signals in the case of a single input.

5. Conclusions

This paper presented approaches for the detection of abnormal respiration. Human respiration states are a good predictor and indicator to assess physical and physiological status. In particular, this paper dealt with cases of single- and multiple-input respiration signals on the basis of noncontact-based measurements. In the case of single-input respiration, signals were analyzed in the Z domain, and the locations of poles and zeros provided information about respiration status, enabling us to classify respiration status. Given one respiration signal that was already acquired by UWB radar, the status of the next input respiration could be determined by analyzing the locations of poles and zeros. Multiple inputs were used, namely, two and three respiration signals, and the summation of all of the inputs was used as input to our system. A high-pass filter was applied to the input, varying cut-off frequency, and output was a response to the filter to provide information about the existence of an abnormal-respiration signal. The proposed approach showed promising results for the determination of respiratory status in multiple-input signals. The present work can be applied to vehicular environments or other ones that require real-time and long-term continuous monitoring and estimation of human respiratory status. In the future, the number of abnormal signals included in the multiple inputs will be estimated on the basis of signal-processing techniques with machine-learning (including neural-network) algorithms.

Author Contributions

Formal analysis, J.O.K.; Funding acquisition, D.L.; Project administration, D.L.; Supervision, D.L.; Validation, J.O.K.; Writing—original draft, J.O.K.; Writing—review & editing, D.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Bisa research grant of Keimyung University in 2019.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Daw, W.; Kingshott, R.; Saatchi, R.; Burke, D.; Holloway, A.; Travis, J.; Evans, R.; Jones, A.; Hughes, B.; Elphick, H. Medical Devices for Measuring Respiratory Rate in Children: A Review. J. Adv. Biomed. Eng. Tech. 2016, 3, 21–27. [Google Scholar] [CrossRef]
  2. Massaroni, C.; Nicolo, A.; Lo Pesti, D.; Sacchetti, M.; Silvestri, S.; Schena, E. Contact-Based Methods for Measuring Respiratory Rate. Sensors 2019, 19, 908. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Bernjak, A.; Stefanovska, A. Importance of wavelet analysis in laser Doppler flowmetry time series. In Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France, 22–26 August 2007; pp. 4064–4067. [Google Scholar]
  4. Yahya, O.; Faezipour, M. Automatic detection and classification of acoustic breathing cycles. In Proceedings of the 2014 Zone 1 Conference of the American Society for Engineering Education, Bridgeport, CT, USA, 3–5 April 2014; pp. 1–5. [Google Scholar]
  5. Nam, Y.; Reyes, B.A.; Chon, K. Estimation of Respiratory Rates Using the Built-in Microphone of a Smartphone or Headset. IEEE J. Biomed. Health Inform. 2016, 20, 1493–1501. [Google Scholar] [CrossRef] [PubMed]
  6. Dafna, E.; Rosenwein, T.; Tarasiuk, A.; Zigel, Y. Breathing rate estimation during sleep using audio signal analysis. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 25–29 August 2015; pp. 5981–5984. [Google Scholar]
  7. Al-khalidi, F.; Saatchi, R.; Burke, D.; Ephick, H.; Tan, S. Respiration rate monitoring methods: A review. Pediatr. Pulmonol. 2011, 46, 523–529. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Janbakhshi, P.; Shanmsollahi, M.B. ECG-derived respiration estimation from single-lead ECG using gaussian process and phase space reconstruction methods. Biomed. Signal Process. Control 2018, 45, 80–90. [Google Scholar] [CrossRef]
  9. Kumarand, V.; Singh, G. Estimation of Respiration rate from ECG Using Canonical Components Analysis and Ensemble Empirical Mode Decomposition. Int. J. Bio-Sci. Bio-Tech. 2015, 7, 139–146. [Google Scholar]
  10. Tiinanen, S.; Noponen, K.; Tulppo, M.; Kiviniemi, A.; Seppänen, T. ECG-derived respiration methods: Adapted ICA and PCA. Med. Eng. Phys. 2015, 37, 512–517. [Google Scholar] [CrossRef] [PubMed]
  11. Labate, D.; Foresta, F.L.; Occhiuto, G.; Morabito, F.C.; Lay-Ekuakille, A.; Vergallo, P. Empirical Mode Decomposition vs. Wavelet Decomposition for the Extraction of Respiratory Signal From Single-Channel ECG: A Comparison. IEEE Sens. J. 2014, 13, 2666–2674. [Google Scholar] [CrossRef]
  12. Chazal, P.; Sadr, N. Sleep apnoea classification using heart rate variability, ECG derived respiration and cardiopulmonary coupling parameters. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 3203–3206. [Google Scholar]
  13. Lázaro, J.; Alcaine, A.; Romero, D.; Gil, E.; Laguna, P.; Pueyo, E.; Bailón, R. Electrocardiogram Derived Respiratory Rate from QRS Slopes and R-Wave Angle. Ann. Biomed. Eng. 2014, 42, 2072–2083. [Google Scholar] [CrossRef] [PubMed]
  14. Mirmohamadsadeghi, L.; Vesin, J.-M. Respiratory rate estimation from the ECG using an instantaneous frequency tracking algorithm. Biomed. Signal Process. Control 2014, 14, 66–72. [Google Scholar] [CrossRef]
  15. Krehel, M.; Schmid, M.; Rossi, R.M.; Boesel, L.F.; Bona, G.-L.; Scherer, L.J. An Optical Fibre-Based Sensor for Respiratory Monitoring. Sensors 2014, 14, 13088–13101. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Min, S.D.; Kim, J.W.; Shin, H.S.; Youn, Y.H.; Lee, C.K.; Lee, M. Noncontact Respiration Rate Measurement System Using an Ultrasonic Proximity Sensor. IEEE Sens. J. 2010, 10, 1732–1739. [Google Scholar]
  17. Lee, Y.S.; Pathirana, P.N.; Steinfort, C.L.; Caelli, T. Monitoring and Analysis of Respiratory Patterns Using Microwave Doppler Radar. J. Transl. Eng. Health Med. 2014, 2, 1–12. [Google Scholar] [CrossRef] [PubMed]
  18. Erden, F.; Alkar, A.Z.; Cetin, A.E. Contact-free measurement of respiratory rate using infrared and vibration sensors. Infrared. Phys. Technol. 2015, 73, 88–94. [Google Scholar] [CrossRef]
  19. Lee, Y.S.; Pathirana, P.N.; Evans, R.J.; Steinfort, C.L. Noncontact Detection and Analysis of Respiratory Function Using Microwave Doppler Radar. J. Sensors 2015, 2015, 1–14. [Google Scholar] [CrossRef]
  20. Sun, G.; Matsui, T. Rapid and stable measurement of respiratory rate from Doppler radar signals using time domain autocorrelation model. In Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 25–29 August 2015; pp. 5985–5988. [Google Scholar]
  21. Lee, Y.S.; Pathirana, P.N. Motion artefact separation in single channel Doppler radar respiration measurement. In Proceedings of the 2015 International Symposium on Bioelectronics and Bioinformatics (ISBB), Milan, Italy, 25–29 August 2015; pp. 79–82. [Google Scholar]
  22. Schaerer, J.; Fassi, A.; Riboldi, M.; Cerveri, P.; Baroni, G.; Sarrut, D. Multi-dimensional respiratory motion tracking from markerless optical surface imaging based on deformable mesh registration. Phys. Med. Biol. 2012, 57, 357–374. [Google Scholar] [CrossRef] [PubMed]
  23. Shao, D.; Yang, Y.; Liu, C.; Tsow, F.; Yu, H.; Tao, N. Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time. IEEE. Trans. Biomed. Eng. 2014, 61, 2760–2767. [Google Scholar] [CrossRef] [PubMed]
  24. Basu, A.; Routray, A.; Mukherjee, R.; Shit, S. Infrared imaging based hyperventilation monitoring through respiration rate estimation. Infrared Phys. Technol. 2016, 77, 382–390. [Google Scholar] [CrossRef]
  25. Khan, F.; Leem, S.K.; Cho, S.H. Hand-Based Gesture Recognition for Vehicular Applications Using IR-UWB Radar. Sensors 2017, 17, 833. [Google Scholar] [CrossRef] [PubMed]
  26. Park, J.; Cho, S. IR-UWB Radar Sensor for Human Gesture Recognition by Using Machine Learning. In Proceedings of the 2016 IEEE 18th International Conference on High Performance Computing and Communications; IEEE 14th International Conference on Smart City; IEEE 2nd International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Sydney, NSW, Australia, 12–14 December 2016; pp. 1246–1249. [Google Scholar]
  27. Novelda X4. Available online: www.xethru.com or https://www.xethru.com/x4-soc.html (accessed on 2 May 2020).
  28. Kim, S.-H.; Geem, Z.W.; Han, G.-T. A Novel Human Respiration Pattern Recognition Using Signals of Ultra-Wideband Radar Sensor. Sensors 2019, 19, 3340. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Miao, D.; Zhao, H.; Hong, H.; Zhu, X.; Li, C. Doppler radar-based human breathing patterns classification using Support Vector Machine. In Proceedings of the IEEE Radar Conference (RadarConf), Seattle, WA, USA, 8–12 May 2017; pp. 456–459. [Google Scholar]
Figure 1. Experiment setup for signal acquisition.
Figure 1. Experiment setup for signal acquisition.
Sensors 20 02977 g001
Figure 2. Ultrawide-band (UWB) radar detect motion of chest surface and generates quantitative data that describe distance variation during exhalation and inhalation.
Figure 2. Ultrawide-band (UWB) radar detect motion of chest surface and generates quantitative data that describe distance variation during exhalation and inhalation.
Sensors 20 02977 g002
Figure 3. This paper’s goal was to provide a method to detect human respiratory status using a UWB radar sensor.
Figure 3. This paper’s goal was to provide a method to detect human respiratory status using a UWB radar sensor.
Sensors 20 02977 g003
Figure 4. Overall flow of approach to detect respiratory status ( A j ( z ) ) given one respiration ( B i ( z ) ).
Figure 4. Overall flow of approach to detect respiratory status ( A j ( z ) ) given one respiration ( B i ( z ) ).
Sensors 20 02977 g004
Figure 5. Overall work flow for detecting existence of abnormal respiration with multiple inputs.
Figure 5. Overall work flow for detecting existence of abnormal respiration with multiple inputs.
Sensors 20 02977 g005
Figure 6. Overall experiment procedures of data acquisition, analysis, processing, and decision for existence of abnormal respiration.
Figure 6. Overall experiment procedures of data acquisition, analysis, processing, and decision for existence of abnormal respiration.
Sensors 20 02977 g006
Figure 7. Examples of normal respiration signals. (a) Normal respiration in stable environment. (b) Normal respiration while sleeping. (c,d) Normal respiration while speaking.
Figure 7. Examples of normal respiration signals. (a) Normal respiration in stable environment. (b) Normal respiration while sleeping. (c,d) Normal respiration while speaking.
Sensors 20 02977 g007
Figure 8. (a,b) Two examples of abnormal respiration, apnea status.
Figure 8. (a,b) Two examples of abnormal respiration, apnea status.
Sensors 20 02977 g008
Figure 9. Examples of classification of respiratory status of A j ( t ) given B i ( t ) using Z-transform. (a,c) Respiratory status of A j ( z ) given abnormal respiration B 1 ( z ) . (b,d) Respiratory status of A j ( z ) given normal respiration B 0 ( z ) .
Figure 9. Examples of classification of respiratory status of A j ( t ) given B i ( t ) using Z-transform. (a,c) Respiratory status of A j ( z ) given abnormal respiration B 1 ( z ) . (b,d) Respiratory status of A j ( z ) given normal respiration B 0 ( z ) .
Sensors 20 02977 g009
Figure 10. Examples of input signals—addition of two respiration signals. (a) S 1 2 ( t ) ; (b) S 2 2 ( t ) ; (c) S 3 2 ( t ) .
Figure 10. Examples of input signals—addition of two respiration signals. (a) S 1 2 ( t ) ; (b) S 2 2 ( t ) ; (c) S 3 2 ( t ) .
Sensors 20 02977 g010
Figure 11. Responses to filter with varying cut-off frequency providing information about existence of abnormal respiration. (a) S 1 ( t ) h c ( t ) . (b) S 2 ( t ) h c ( t ) . (c) S 3 ( t ) h c ( t ) .
Figure 11. Responses to filter with varying cut-off frequency providing information about existence of abnormal respiration. (a) S 1 ( t ) h c ( t ) . (b) S 2 ( t ) h c ( t ) . (c) S 3 ( t ) h c ( t ) .
Sensors 20 02977 g011
Figure 12. Examples of input signals—addition of three input respiration signals. (a) S 1 3 ( t ) ; (b) S 2 3 ( t ) ; (c) S 3 3 ( t ) ; (d) S 4 3 ( t ) .
Figure 12. Examples of input signals—addition of three input respiration signals. (a) S 1 3 ( t ) ; (b) S 2 3 ( t ) ; (c) S 3 3 ( t ) ; (d) S 4 3 ( t ) .
Sensors 20 02977 g012
Figure 13. Examples of outputs that were filtered responses by varying cut-off frequency of high-pass filter. (a) S 1 3 h c ( t ) . (b) S 2 3 h c ( t ) . (c) S 3 3 h c ( t ) . (d) S 4 3 h c ( t )
Figure 13. Examples of outputs that were filtered responses by varying cut-off frequency of high-pass filter. (a) S 1 3 h c ( t ) . (b) S 2 3 h c ( t ) . (c) S 3 3 h c ( t ) . (d) S 4 3 h c ( t )
Sensors 20 02977 g013
Table 1. Notations used to categorize respiratory status.
Table 1. Notations used to categorize respiratory status.
A j ( z ) B i ( z )
Normal ( A 0 ( z ) )Normal ( B 0 ( z ) )
Normal ( A 0 ( z ) )Abnormal ( B 1 ( z ) )
Abnormal ( A 1 ( z ) )Normal ( B 0 ( z ) )
Abnormal ( A 1 ( z ) )Abnormal ( B 1 ( z ) )
Table 2. Specification of UWB radar [27].
Table 2. Specification of UWB radar [27].
ComponentsSpecification
Frequency4.1–10.3 GHz
Bandwidth1.7–3.1 GHz
TX peak power−40 dBm/50 MHz
TX min power−60 dBm/MHz
Power consumption180 mA
Package 40 × 45 mm
Motion range10 m
Respiration range5 m
Table 3. Accuracy of detection and classification.
Table 3. Accuracy of detection and classification.
CategoryAccuracy (Proposed) (%)Kim et al. [28]Miao et al. [29]
Single input67%93%85.8%
Two inputs87%93%85.8%
Three inputs93%93%85.8%

Share and Cite

MDPI and ACS Style

Kim, J.O.; Lee, D. Detection of Abnormal Respiration from Multiple-Input Respiratory Signals. Sensors 2020, 20, 2977. https://doi.org/10.3390/s20102977

AMA Style

Kim JO, Lee D. Detection of Abnormal Respiration from Multiple-Input Respiratory Signals. Sensors. 2020; 20(10):2977. https://doi.org/10.3390/s20102977

Chicago/Turabian Style

Kim, Ju O, and Deokwoo Lee. 2020. "Detection of Abnormal Respiration from Multiple-Input Respiratory Signals" Sensors 20, no. 10: 2977. https://doi.org/10.3390/s20102977

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop