Next Article in Journal
Motion Video Recognition in Speeded-Up Robust Features Tracking
Next Article in Special Issue
Deep-Learning-Based System for Assisting People with Alzheimer’s Disease
Previous Article in Journal
A Measurement Compensation Method for Electrical Capacitance Tomography Sensors with Inhomogeneous Electrode Parameters
Previous Article in Special Issue
Telemedicine System Applicability Using Drones in Pandemic Emergency Medical Situations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

System for Non-Contact and Multispectral Examination of Blood Supply to Cutaneous Tissue

Department of Electromagnetic and Biomedical Engineering, Faculty of Electrical Engineering and Information Technology, University of Zilina, 010 26 Zilina, Slovakia
*
Author to whom correspondence should be addressed.
Electronics 2022, 11(18), 2958; https://doi.org/10.3390/electronics11182958
Submission received: 21 July 2022 / Revised: 7 September 2022 / Accepted: 14 September 2022 / Published: 18 September 2022
(This article belongs to the Special Issue Electronic Devices and Systems for Biomedical Applications)

Abstract

:
The presented system for non-contact examination of tissue perfusion is one of the tools for complex examination of human body tissues (skin, subcutaneous) and their mutual interactions, including blood flow and activity under various external stimuli. In our system, optical radiation, with wavelengths of 525 nm, 625 nm, and 940 nm, was used to investigate the perfusion and properties of skin tissue. Our work presents that it is possible to obtain comprehensive information about the cardiovascular system and skin tissue perfusion by a suitable combination of wavelengths, light intensity, and homogeneous illumination distribution with a properly chosen sensing device—a camera. The proposed system consists of an illumination device that emits light of the three wavelengths mentioned above and thus makes it possible to investigate the skin tissue structures and their interrelationships in terms of their blood supply and interactions with each other.

1. Introduction

Cutaneous tissue is a complex system composed of multiple layers that are interconnected and contain different compartments [1]. For example, part of the skin is traversed by blood vessels [2], which are also connected to deeper tissue structures [3], which include muscle tissue. Due to the large muscle mass, approximately 25% of cardiac output flows through cutaneous tissue at rest [4]. Therefore, disease-induced changes in this vasculature may contribute significantly to the pathological consequences of systemic disorders [4]. For example, disturbances in the perfusion of skin and muscle tissue can cause diseases such as the development of compartment syndrome [5], chronic venous insufficiency [6], and muscular dystrophy [7]. In addition, pathological changes in the vasculature of skeletal muscle can occur in hypertension [8], hypercholesterolemia [9], obesity [10], diabetes [11], aging, and chronic portal hypertension [12]. Therefore, understanding the function of the cardiovascular and neuromuscular systems and their interconnections is necessary to identify and initiate treatment for each disease [4].
The simultaneous use of an electrocardiogram (ECG) and a photoplethysmogram (PPG), while keeping a distance separating the site of the ejection of the systolic pulse and the site of measuring the PPG signal, can help to determine the pulse wave velocity (PWV) [13]. Optical coherence tomography (OCT) and the method employing the photoacoustic effect (PAT) are also among the methods that use light as a source of information about the patient’s state of health. OCT is a noninvasive high-resolution optical imaging technology based on interference between the signal from the object under investigation and a local reference signal [14]. PAT is cross-sectional or three-dimensional imaging based on the photoacoustic effect. PAT combines high ultrasonic resolution and strong optical contrast in a single modality, capable of providing high-resolution structural, functional, and molecular in vivo imaging in optically scattering biological tissue at new depths [15].
In our work, we focused on the novel application of PPG and its non-contact unobtrusive form [16,17,18]. An illumination source and a sensing device, a camera, are used as the standards for the non-contact examination of subcutaneous blood flow [19]. In addition, white light generated by light-emitting diode (LED) technology or monochromatic light is most often used as the light source [20].
As an innovative method of non-contact investigation of cutaneous perfusion in different tissue layers, we can consider the use of light with selected wavelengths. The use of multiple wavelengths affects the depth of light penetration into the tissue. At the same time, this approach can provide a better picture of what is happening in different cutaneous layers in terms of perfusion in different parts of the arterial tree. Such a technical solution can, e.g., examine the blood supply to the cutaneous tissue and its adjacent layers.
There are several scenarios in the literature where authors have used an illumination source with different wavelengths. In [21], they used a system combining the laser Doppler flow method (LDF), working with a HeNe laser with a wavelength of 632.8 nm, and non-contact PPG based on 560 nm and 810 nm. This study revealed that using several wavelengths is important in terms of their penetration to different layers of the tissue, allowing for their individual investigation. In [22,23], they studied the rhythmic phenomena in skin perfusion using a near-infrared camera. Blazek and Blazek, in [24], described the evaluation of dermal blood perfusion before and after standardized clinical skin tests were performed under clinical control in the allergology field. This study supported this qualitative evaluation of skin blood perfusion with PPG, using a green light as a monochromatic illumination source. In addition, this study used LED near-infrared light with wavelengths of about 940 nm to reach deeper skin layers. Other authors [25] described the non-contact imaging of arterial oxygen saturation (SpO2) distribution in tissue based on detecting a two-dimensional matrix of spatially resolved PPG signals at different wavelengths. As a first step towards SpO2 imaging, they built a device using a monochrome CMOS camera with an apochromatic lens and a 3-λ illumination device (λ1 = 660 nm, λ2 = 810 nm, λ3 = 940 nm; a total of 100 LEDs).
Our work provides an alternative and affordable solution combining microcontroller-controlled LED panels, which allow for the simultaneous sensing of the PPGI signal with three wavelengths using a machine vision camera, and possibly another external reference in the form of a selected biosignal, according to the desired experiment scenario.

2. Materials and Methods

2.1. System Functional Description

The proposed system consists of a total of eight blocks (Figure 1). The main element of the whole system represents a microcontroller (MCU), which controls the illumination device and the camera. The MCU also determines the exact time to capture the image, so it ensures synchronization between the illumination device and the camera. Thus, the image must be captured at a specific time when the radiation of the desired wavelength is emitted. The rising edge of the control pulse–width modulation (PWM) pulse from the MCU marks the beginning of the camera’s image capture. The captured image is then transferred to a computer via a USB 3.1 interface.
The entire designed system is powered by a DC switching power supply with an output voltage of 24 VDC. A keyboard is used to enter the system inputs. The individual inputs are used for the user configuration of the system. The display can show the current measurement status, including the set system parameters. The display is controlled by the MCU via the I2C communication interface.
The illumination part of the device was designed using a precisely defined number of LEDs. The proposed device uses three wavelengths (525 nm, 625 nm, and 940 nm), so the proposed device can be referred to as “3-λ”. The device also allows for controlling the switching frequency between the individual illumination blocks with different wavelengths and for setting the number of functional standalone blocks formed by the LEDs. The illumination device can work in a sequential pulse mode or a continuous mode. The device also contains a diffusion filter, which ensures a homogeneous distribution of the radiation in the entire beam angle of the illumination device. Ensuring the homogeneity of the irradiation is crucial in terms of eliminating optical artifacts during the measurement.
The images are recorded in the “.raw” format, which ensures that the measured data will not be modified by another method of lossy compression. Finally, individual images are processed and analyzed in a tailor-made application on a computer. The application was designed in MATLAB (Mathworks, Portola Valley, CA, USA).

2.2. System Operation Based on Timing Diagram

The central control unit of the whole device is the ATmega328P (Microchip Technology, Chandler, AZ, USA) MCU, which is part of the Arduino Uno development board (Arduino, Ivrea, Italy). The MCU sends a control pulse to the sensing unit—the camera, which responds by taking a picture when the control pulse is received. The timing diagram of the proposed system is shown in Figure 2. The total image-taking cycle can be divided into 12 equal intervals, Ci. The length of each interval differs depending on the selected frame rate at the device’s initial setup. The mentioned intervals were created for a clearer and more practical timing of the proposed system. The selected task is performed at each interval (e.g., turning on an LED with a specific wavelength or sending a control pulse to the camera).
In this case, we chose the frame rate Fs = 15 Hz per channel, and one interval lasts
T = 1 C i × F s = 1 12   H z × 15   H z = 5555   μ s  
The selected number of intervals was tested as the most suitable for the system reliability and stability. If we look at the timing diagram in Figure 2, it describes the 3-λ mode and the sequential pulse mode. An important part of the control signal ENcap for the camera is the rising edge when the image is captured. The rising edge of the control signal is always brought to the camera synchronously based on how the individual LEDs of the corresponding wavelengths are activated. Subsequently, it takes time for the camera to take an image. Therefore, we had to reserve extra time for the camera to maintain the system’s correct operation. During the image processing, the proposed system also activates a timer for the next control pulse in case of a sampling frequency of 15 Hz per channel, according to:
F s = 1 C i T t = 15   H z  

2.3. Adjustability of Illumination Device

If we look at Figure 3, we can see that the adjustability of the illumination device can be divided into four main blocks. The first and second blocks relate to the light mode of the lighting device, and thus, to the setting of the 1-λ, 2-λ, or 3-λ mode and the operating mode, that is, the continuous or switching mode (repeated switching between different wavelengths). The third block defines the number of active standalone working units; this option can increase the illumination power of the illumination device. The fourth block defines the sampling frequency of the system.
At the system initialization, it is important to select the operating mode of the illumination device (see Figure 3). If only surface, subsurface, or deep structures (cutaneous, subcutaneous tissue) are examined, the 1-λ mode is sufficient. However, the combined 2-λ and 3-λ modes should provide a more detailed picture of the perfusion relationships between the individual tissue structures. The next step is to select the operating mode. Here, it is possible to select the continuous and sequential pulse (switching) modes. The continuous mode is feasible and makes sense only in the 1-λ mode when examining the tissue structures only in one wavelength. On the other hand, the sequential pulse mode can be described as switching between individual wavelengths with a predefined frequency. This mode allows for the use of the 2-λ and 3-λ modes to investigate multiple structures (tissues) simultaneously and under the same measurement conditions. We can call it simultaneous because of the frequency band of the measured signal. The penultimate option is to choose the number of active functional units or standalone working units (SWU), as shown in the adjustability diagram of the illumination device in Figure 3.
The functional standalone working unit (SWU) consists of five LEDs for each wavelength, for a total of 15 LEDs (Figure 4). In Figure 4, the green color corresponds to 525 nm LEDs, the red color corresponds to 625 nm LEDs, and the brown color corresponds to 940 nm LEDs. The LED driver is marked as blue. The technical parameters of the chosen diodes are shown in Table 1.
The illumination device allows for selecting a minimum of 1 active SWU and a maximum of 12 units that create the device (Figure 5). The last adjustable part of the device is the configuration of the frequency of image capture by the camera (sampling frequency), and the following options are offered: 10 Hz, 15 Hz, or 20 Hz per channel. When operating the device in 2-λ or 3-λ in the sequential pulse mode, the microcontroller ensures the synchronicity of the camera and the illumination device.
The device is powered from a switched mode DC power supply, AMES100-24S277NZ (AIMTEC a. s., Pilsen, Czech Republic), with a voltage output of 24 VDC and a maximum guaranteed power of 100 W, Table 2.
When designing the hardware part of the illumination device, it was necessary to consider the time and voltage stability of the device. Therefore, the voltage source mentioned above was chosen. Simultaneously, the operation of this voltage source was transformed into a current source (CL320—3 Channel LED driver). The LEDs are therefore controlled by a current LED driver, which, in the initial tests, showed the best stability required for the operation of our device. The LED diodes for each wavelength are connected in a series and create LED strings (Figure 6). Subsequently, we calculated the electrical parameters of the device:
V cc 625 = V F 625 · N = 2.8   V · 5 = 14   V I c 625 = I F 625 · N SWU = 0.020   A · 12 = 0.24   A P c 625 = I c 625 · V cc 625 = 0.24   A · 14   V = 3.36   W V cc 525 = V F 525 · N = 3.1   V · 5 = 15.5   V I c 525 = I F 525 · N SWU = 0.020   A · 12 = 0.24   A P c 525 = I c 525 · V cc 525 = 0.24   A · 15.5   V = 3.72   W V cc 940 = V F 940 · N = 1.6   V · 5 = 8   V I c 940 = I F 940 · N SWU = 0.020   A · 12 = 0.24   A P c 940 = I c 940 · V c c 940 = 0.24   A · 8   V = 1.92   W  

2.4. Three-Channel Linear LED Driver

Since we chose the current-regulated LEDs connected in a series because they exhibited higher stability and fewer transients than their parallel alternative with voltage regulation, we had to select a suitable constant-current LED driver for the selected voltage source. We used the CL320 integrated circuit (Microchip Technology, Chandler, AZ, USA) designed to control up to three LED strings (3 channels) at a constant electric current of 20 mA. The electric current is constant, with a tolerance of ±6% at the output voltage range, VOUT = 4 V to 15 V [30]. Separate activation inputs for each channel allow for PWM brightness control, linear dimming, or individual disconnection of the LED string (Figure 7).
The CL320 also includes an overheat protection circuit that shuts off all three channels at a nominal temperature of 135 °C. Normal operation resumes when the temperature drops by 30 °C. The CL320 is available as an integrated circuit with an SOIC-8 package [30].
Figure 8 shows a sequentially switched-on device with wavelengths of 940 nm, 625 nm, and 525 nm. A total of 60 LEDs correspond to each wavelength. The device is made up of 180 LEDs. Figure 9 shows the application of diffusion filters—Lee 250 Half White Diffusion Filter and Lee 216 Full White Diffusion filter (Panavision, Los Angeles, CA, USA)—to an illumination device to ensure the homogeneous illumination of the examined region of the human cutaneous and subcutaneous tissue. The Lee 250 Half White Diffusion Filter offers medium diffusion used for soft light effects [31]. The Lee 216 Full White Diffusion Filter offers strong diffusion used for soft light effects [31].
In addition to comparing the radiant properties of the used LEDs, we decided to introduce their radiance since the technical documentation of LED diodes, OSG59A5111P (525 nm) and OS6YKA5201P (625 nm) (Optosupply, Hong Kong, China), contains data only on luminosity.
I = d Φ d Φ λ = k ( λ ) · Φ e I v = 683   y ¯ ( λ ) · I e   ( W · sr 1 ) I e 525 = I v y ¯ ( λ ) = 140000 · 10 3 683 · 0.786 = 260.8   mW · sr 1 I e 625 = I v y ¯ ( λ ) = 120000 · 10 3 683 · 0.323 = 543.9   mW · sr 1 I e 940 = 550   mW · sr 1
where I —radiant intensity (W/sr), Φ λ —spectral flux (W/m), Φ e —radiant flux (W), I e 525 , 625 , 940 —spectral intensity (W/sr   · m ), I v —spectral intensity (W/sr   · Hz ).

2.5. Testing of Illumination Device and Camera Setup

When testing the illumination device, which was described in the previous chapter, it is important to mention the camera used, which will be used to capture images at predefined intervals. Our system uses a camera called BFS-U3-28S5M-C USB 3.1 BlackflyS. It is a monochrome CMOS camera that provides a resolution of 1936 × 1464, 2.8 MP, and a 12-bit AD converter [32]. A fast USB 3.1 interface can be used to communicate with the computer. The quantum efficiency of the camera sensor at selected wavelengths can be seen in Table 3.
The set camera exposure time was 8000 µs during testing. The automatic gamma correction was turned off, and the camera gain was set to 5 dB. The camera’s AD converter was set to the Mono12p mode with a 10-bit resolution. The camera was controlled by a microcontroller, and thus, operated in slave mode. The sampling frequency was 15 Hz per channel. When testing the device, we focused on the forearm area, where we marked the region of interest, Figure 10. The region of interest size was 3 cm × 2 cm, and its distance from the camera lens and the illumination device, located in the plane with the camera, was 20 cm.
The hand, and thus, the region to be examined, was placed on the foam pad, as shown in Figure 11. The foam pad provides a soft surface for the examined area of the human body. A soft surface is important to avoid unwanted effects on the blood supply to the region of interest. Figure 11 shows the illumination device and measuring setup. Figure 11 shows the foam pad, illumination device, camera lens, power supply, tripod, display, and keyboard.

2.6. Software Calibration

To compare the DC levels of the PPGI curves, we had to calibrate them in a certain way. We also wanted to compare the maps after calibration and see the effects of the reflectivity and quantum sensitivity of the camera sensor on different wavelengths. The DC components of the PPGI curves are caused by changes in other tissue components, such as venous and capillary blood, bloodless tissue, muscle, etc. [33]. When measuring the PPGI in this section, we thought about the reasons why the individual DC levels of the measured PPGI curves were different. Thus, the curves were not based on the same initial value. We note that this may have been due to the radiant power of the LEDs, the LED driver used with a constant output current value, the sensitivity of the camera for different wavelengths, the reflectivity of the skin, and the absorbance of the individual skin layers. Therefore, we decided to perform the PPGI measurements using white cellulose paper with a density of 80 g/m2 as a reference for the software calibration (Figure 12). An alternative to white paper could be Spectralon [34], which has a defined reflectance of 2% to 99%.

3. Results

We tested the illumination device in order to determine the effect of transients during the switching of LEDs on the stability of the designed system. Testing was performed on an oscilloscope DS1102E (Rigol, Beijing, China), measuring transients when switching on and off LEDs of specific wavelengths. We investigated the stability in both the time and voltage domains. Deviation in the time domain can affect the device in terms of system stability in ensuring synchronization between the camera and the illumination device. The short deviation in the voltage range can affect the stability of the illumination power. Deviation in the voltage domain can be a source of noise in the measured signal, and the brightness of the LEDs may be affected too.

3.1. Testing the System Timing

Figure 13 shows the measured time diagram of the whole system, and thus, the switching on and off of the illumination device, including the clock signal (capture signal) for the camera. During this measurement, performed on an oscilloscope, we wanted to verify the time sequence of the system events (camera control, illumination device control) and their synchronism. From the point of view of the time diagram, Figure 13, the duration of the sampling period Ts represents the maximum possible time to switch on the illumination device, and thus, the LEDs of the desired wavelength, and at the same time, capture the image and send it to the computer. Tcs is the complete cycle of the sampling period and represents the switching time between all wavelengths of the LEDs to the default state.
T cs = 1 T s   ·   3   channels = 22 , 222   µ s
The rising edge in the camera clock signal represents the beginning of the capture image frame. It is necessary to ensure that the rising edge of the clock signal corresponds to the switched on illumination device with the desired wavelength of the LEDs.
As can be seen in the timing diagram of the illumination device, Figure 13, it is important to correctly select the time required for the LED to settle, T LED SettleTime , after its activation. When using a sampling frequency of Fs = 15 Hz, the LED settle time can be expressed as:
T LED SettleTime = T cs 4 = 22 , 222   μ s 4 = 5555   μ s
Another parameter affecting the functionality of the device is the ideal, T CAM IdealExposureTime , and maximum, T CAM MaxExposureTime , camera exposure time, while it is necessary to ensure the following ratio between the mentioned times at all selectable sampling frequencies:
T CAM IdealExposureTime 2 3 · T CAM MaxExposureTime

3.2. Testing the System Transients

Subsequently, the transients when switching the LEDs from the active to the inactive state and vice versa were also tested. At the same time, the effects of their switching on the overall time and voltage stability of the device were tested.
Figure 14 represents the switching off of the LEDs with a wavelength of 525 nm and the switching on of the LEDs with a wavelength of 940 nm. Figure 14 shows that the measured transients in the time domain were at the following levels: T 625 rise / fall = 67.60 µs, T 525 rise / fall = 61.60 µs, and T 940 rise / fall = 66.00 µs. In the amplitude domain, the overshoot was at the level of V 525 ,   625 , 940 overshoot = 0.77 V. The voltage peak stabilized immediately after stabilizing the deviation in the time domain.
Figure 15 shows the transient when switching off the LEDs with a wavelength of 525 nm. Figure 15 also shows, in the time domain, the interference time of T 625 interference   = 72.4 µs, and in the amplitude domain, the voltage overshoot of T 625 overshoot = 1.68 V of the LEDs with a wavelength of 625 nm. From this measurement, we can say with certainty that by switching off any LEDs with the desired wavelength, the transient is also transferred to the other LEDs with different wavelengths.
Figure 16 shows the transient when switching on the LEDs with a wavelength of 625 nm. Figure 16 also shows, in the time domain, the interference time of T 525 interference = 69.2 µs, and in the amplitude domain, the voltage overshoot of T 525 overshoot = 0.96 V of the LEDs with a wavelength of 525 nm. We can say from the measurement that by switching on any LEDs with the desired wavelength, the transient is also transferred to the other LEDs with different wavelengths. The measured parameters mentioned above affected the design process of the entire device in the time domain.
In Figure 14, Figure 15 and Figure 16, we can see the three measured model situations from the point of view of the transients that occurred when switching on and off the LEDs of the required wavelengths of the illumination device.

3.3. Measuring PPGI Data

The PPG waveform from the region of interest (forearm of the left hand of the measured subject) was measured. Our aim was to capture the AC and DC components of the PPG signal. We used the sequential pulse mode and the 3-λ mode for the measurement. We also applied a vasodilatory cream during the measurement of the region of interest. Finalgon Cream (Boehringer Ingelheim International GmbH, Ingelheim am Rhein, Germany) works by increasing blood circulation to the area of application, hence promoting localized warmth and heat to relieve pain. It is the effect of Finalgon Cream that can be seen on the DC component of the PPG curve. The cream gradually increases the blood supply to the examined area, and thus, increases the rate of light absorption by the tissue, decreasing the magnitude of the resulting PPG signal. Slowly decreasing the DC level over time compared to the initial state can also be called DC drift. The averaged PPG curves from the whole region of interest for the individual wavelengths can be seen in Figure 17a.
The individual waveforms at different wavelengths, Figure 17a, differ in terms of the amplitude level of the signal, which is also related to the sensitivity of the camera to the individual wavelengths of the illumination device and also to the brightness of the selected LEDs that make up the illumination device. At the same time, it is necessary to realize that light with different wavelengths has a different depth of penetration into the tissue, and thus, interacts with different biological structures.
Figure 17b–d shows 5 s details from the measured records, where it is possible to see the PPG waveforms measured at the region of interest. By the test measurement, we wanted to verify the functionality of the illumination device and the entire system when measuring slow and fast changes in the PPG signal. Looking at Figure 17b, it can be seen that the light with a wavelength of 525 nm had the largest magnitude of the AC component of the PPG signal. On the contrary, the light with a wavelength of 940 nm had the smallest magnitude (Figure 17d).
In Figure 18, it is possible to see PPGI maps created from the measured area (forearm). The size of the kernel when creating the amplitude maps was 15 px × 15 px, and the kernel was moved along the data matrix in steps of three. To extract the amplitudes of the perfusion changes, we used fast Fourier transform (FFT) and tracked the decadic logarithmic maxima in the amplitude spectrum in the range from 0.8 Hz to 2.5 Hz. We can see that the AC components of the 525 nm and 625 nm PPGI waveforms had the highest magnitude levels.

3.4. Amplitude Maps after Calibration

We placed the white paper at the same distance from the camera as the measured area of interest. We observed how the DC levels obtained from the area where the paper was located behaved. Figure 19a shows that the maximum DC level on paper was achieved at a wavelength of 525 nm, while the lowest level was reached by radiation at 940 nm. This is due to the mutual influence of the spectral sensitivity of the camera and the radiance power of the LEDs. Therefore, we decided to perform a calibration so that these DC levels could be compared with each other, and so we adjusted the DC level of the red and infrared radiation to the green radiation. Subsequently, we calculated the ratio ( R 625 / 525 ) between the DC levels of red ( L 625 whitepaper ) and green radiation ( L 525 whitepaper ) and divided the obtained value of red radiation ( L 625 skin ), carrying out the same for infrared radiation ( L 940 skin ) .
R 625 / 525 = L 625 whitepaper L 525 whitepaper
R 940 / 525 = L 940 whitepaper L 525 whitepaper
L 625 calibrated _ skin = L 625 skin R 625 / 525
L 940 calibrated _ skin = L 940 skin R 940 / 525
Thus, we obtained the radiation found on the mentioned white paper at the same initial level, which is a software adjustment of the camera sensitivity and the power of the LED diodes. We also applied this calibration process to the measured region of interest, where the obtained PPG curves can be seen in Figure 19b. If we look at the skin reflectance curve [35], and at the same time, consider the absorption of hemoglobin [36], then the DC component of the green radiation should be the lowest, which also agrees with the data obtained after the normalization for the skin (Figure 19c). If we look at the reflectance coefficients, the value of the coefficient is 0.3 for green radiation, 0.6 for red radiation, and 0.65 for infrared radiation. If we also consider the sensitivity of the camera sensor to the radiation of the individual wavelengths, then the mentioned data show that the highest DC level should have red radiation ( L 625 calibrated   skin ), and infrared ( L 940 calibrated   skin ) and green radiation ( L 525 skin ) should have approximately half that of the DC level. We subsequently managed to verify this assumption in Figure 19c.
If we look at Figure 20a,b, we can see that by adjusting the DC level of the PPGI signals, it is possible to compare the created maps from the point of view, for example, of the reflectance of the skin surface. Without the application of calibration, such a comparison would not be possible. According to the created calibrated maps (Figure 20b), the radiation with a wavelength of 625 nm had the greatest reflectance, which also corresponds to the reflectance curve of human skin. On the other hand, the radiation with a wavelength of 525 nm had the lowest reflectivity [35].
In Figure 21a,b we can see that the calibration did affect the AC part of the PPGI signals. This means that the created PPGI maps did not preserve the ratio of the magnitudes of the AC components of the PPGI signals at the selected wavelengths. Therefore, to compare the AC components of the PPGI signals at the selected wavelengths, we had to do so without using the mentioned software calibration or before the applied calibration. The maps were created in the same way as mentioned above when creating the AC PPGI maps without calibration. A vasodilating cream was also used.

4. Discussion and Conclusions

The non-contact monitoring of cutaneous perfusion using PPGI carries information not only about heart activity [33] but also about slow changes in the skin and deeper cutaneous tissue blood flow in the region of interest [37].
Our technical solution allows for choosing the desired wavelengths used in the measurement. Thus, it is possible to focus on different skin tissue compartments based on the used light in the optical and near-infrared spectra. The selected wavelength corresponds to the choice of the examined structure and its anatomical location. The technical solution also allows for changing the intensity and mode of the light source and the parameters of the camera and diffusion filter.
The proposed system, as well as the illumination device, has several limits that do not directly affect the measurement. The first shortcoming is the transients arising from the switching on and off of the illumination device, and thus, the LEDs of the corresponding wavelengths. This shortcoming could be solved in some way by using LEDs with ultra-short switching times and an LED driver with a short on and off time [38,39]. Transients caused by the power supply can be eliminated by using power supplies with high stability when switching the LED load or by designing one’s own power supply according to [40,41,42]. The second shortcoming is related to the camera. Ideally, the image captured by the camera would be processed and sent to a computer immediately. However, because every event of the proposed system, e.g., capturing an image, processing it, and sending it to a computer, takes some time, this can be seen as limiting. This issue can also be solved in a certain way by choosing a suitable camera [43] that shortens the mentioned times.
The advantage of the proposed system is the possibility of choosing the luminosity of the illumination device and the possibility of choosing the specific wavelengths of the LEDs forming the illumination device. The user can select the 1-λ, 2-λ, or 3-λ mode, as well as the sampling frequency of the image capture. It is important to mention that it is possible to chain the illumination device to achieve higher radiant power and a broader illuminated area.
In focusing on the AC components of the measured PPGI signals (Figure 17), we found that the AC components of 525 nm and 625 nm PPGI waveforms had the highest magnitude levels. This is probably because light with a wavelength of 525 nm penetrates to the depth of the skin where the arterial network is located. It is also important to consider the hemoglobin absorption of radiation [37,44]. The large magnitude of light with a wavelength of 625 nm could also be caused, for example, by the reddening of the skin where the dermal ointment was applied.
The DC components of the measured PPGI signals also depend on the skin reflectance [45] and the camera quantum efficiency [32]. In addition, they were modulated due to the different radiation levels of the selected LEDs. Therefore, it was necessary to perform a software calibration. Software calibration is also important from the point of view of evaluating the measured PPGI data. The measured data can be displayed in amplitude maps, where the individual DC levels at different wavelengths matter for comparison [33].
An option for future work is to add a hardware calibration option, where the brightness of the individual LED panels could be directly controlled depending on the quantum efficiency of the camera and the reflectance of the skin surface under investigation. Other possibilities are adding more wavelengths or using RGB LEDs, where it would be possible to create colored illumination according to the target scenario of the experiment.
In addition, multispectral photoplethysmography imaging opens up the possibility of examining different parts of the skin tissue simultaneously. Thus, this method is promising for monitoring phenomena between different layers or physiological systems, such as the cardiovascular or neuromuscular system.

Author Contributions

Conceptualization, S.B.; data curation, S.B.; formal analysis, B.B.; funding acquisition, M.S.; investigation, M.L.; methodology, S.B.; project administration, M.S. and B.B.; resources, M.S.; software, M.L. and S.B.; supervision, S.B.; validation, B.B.; visualization, M.L.; writing—original draft, M.L.; writing—review and editing, S.B. All authors will be informed about each step of the manuscript processing, including submission, revision, revision reminder, etc. via emails from our system or assigned Assistant Editor. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Grant System of the University of Zilina (Project No. O-22-103/0011-03). The APC was funded by University of Zilina: O-22-103/0011-03.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the Department of Health of the Zilina Self-Governing Region, Slovakia (05128/2022/0Z-02, 2 May 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent was obtained from the patient(s) to publish this paper.

Data Availability Statement

The data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Acknowledgments

This work was supported by the Grant System of the University of Zilina (Project No. O-22-103/0011-03).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rushmer, R.F.; Buettner, K.J.K.; Short, J.M.; Odland, G.F. The skin. Science 1966, 80, 343–348. [Google Scholar] [CrossRef] [PubMed]
  2. Moretti, G. The blood vessels of the skin. In Normale und Pathologische Anatomie der Haut I.; Springer: Berlin/Heidelberg, Germany, 1968; pp. 491–623. [Google Scholar]
  3. Wong, R.; Geyer, S.; Weninger, W.; Guimberteau, J.; Wong, J.K. The dynamic anatomy and patterning of skin. Exp. Dermatol. 2016, 25, 92–98. [Google Scholar] [CrossRef]
  4. Korthuis, R.J. Skeletal muscle circulation. Colloq. Ser. Integr. Syst. Physiol. Mol. Funct. 2011, 3, 1–144. [Google Scholar] [CrossRef]
  5. Frink, M.; Hildebrand, F.; Krettek, C.; Brand, J.; Hankemeier, S. Compartment syndrome of the lower leg and foot. Clin. Orthop. Relat. Res. 2010, 468, 940–950. [Google Scholar] [CrossRef] [PubMed]
  6. Eberhardt, R.T.; Raffetto, J.D. Chronic venous insufficiency. Circulation 2014, 130, 333–346. [Google Scholar] [CrossRef] [PubMed]
  7. Yiu, E.M.; Kornberg, A.J. Duchenne muscular dystrophy. J. Paediatr. Child Health 2015, 51, 759–764. [Google Scholar] [CrossRef]
  8. Staessen, J.A.; Wang, J.; Bianchi, G.; Birkenhäger, W.H. Essential hypertension. Lancet 2003, 361, 1629–1641. [Google Scholar] [CrossRef]
  9. Bhatnagar, D.; Soran, H.; Durrington, P.N. Hypercholesterolaemia and its management. BMJ 2008, 337, a993. [Google Scholar] [CrossRef]
  10. Jiang, S.; Lu, W.; Zong, X.; Ruan, H.; Liu, Y. Obesity and hypertension. Exp. Ther. Med. 2016, 12, 2395–2399. [Google Scholar] [CrossRef]
  11. Deshpande, A.D.; Harris-Hayes, M.; Schootman, M. Epidemiology of diabetes and diabetes-related complications. Phys. Ther. 2008, 88, 1254–1264. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Bosch, J.; Garcia-Pagán, J.C.; Feu, F.; Pizcueta, M.P. Portal hypertension. In Hepatobiliary Diseases; Springer: Berlin/Heidelberg, Germany, 1992; pp. 429–463. ISBN 9783642768040. [Google Scholar]
  13. Bereksi-Regiug, M.A.; Bereksi-Reguig, F.; Ali, A.N. A new system for measurement of the pulse transit time, the pulse wave velocity and its analysis. J. Mech. Med. Biol. 2017, 17, 1750010. [Google Scholar] [CrossRef]
  14. Podoleanu, A.G. Optical coherence tomography. J. Microsc. 2012, 247, 209–219. [Google Scholar] [CrossRef] [PubMed]
  15. Wang, L.V. Prospects of photoacoustic tomography. Med. Phys. 2008, 35, 5758–5767. [Google Scholar] [CrossRef]
  16. Such, O.; Acker, S.; Blazek, V. Mapped hemodynamic data acquisition by near infrared CCD imaging. In Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Magnificent Milestones and Emerging Opportunities in Medical Engineering (Cat. No. 97CH36136), Chicago, IL, USA, 30 October–2 November 1997; Volume 2, pp. 637–639. [Google Scholar] [CrossRef]
  17. Wu, T.; Blazek, V.; Schmitt, H.J. Photoplethysmography imaging: A new noninvasive and noncontact method for mapping of the dermal perfusion changes. In Optical Techniques and Instrumentation for the Measurement of Blood Composition, Structure, and Dynamics; SPIE: Cergy, France, 2000; Volume 4163, pp. 62–70. [Google Scholar] [CrossRef]
  18. Hülsbusch, M.; Rembold, B. Ein bildgestütztes, funktionelles Verfahren zur optoelektronischen Erfassung der Hautperfusion. PhD Thesis, Lehrstuhl und Institut für Hochfrequenztechnik, Aachen, Germany, 2008. [Google Scholar]
  19. Borik, S.; Lyra, S.; Paul, M.; Antink, C.H.; Leonhardt, S.; Blazek, V. Photoplethysmography imaging: Camera performance evaluation by means of an optoelectronic skin perfusion phantom. Physiol. Meas. 2020, 41, 54001. [Google Scholar] [CrossRef] [PubMed]
  20. Blazek, V.; Dahlmanns, S.; Pereira, C.B.; Yu, X.; Blanik, N.; Leonhardt, S.; Blazek, C.R. Photoplethysmography Imaging and Common Optical Hybrid Imaging Modalities. In Multi-Modality Imaging; Springer: Cham, Switzerland, 2018; pp. 31–66. [Google Scholar] [CrossRef]
  21. Bergstrand, S.; Lindberg, L.G.; Ek, A.; Lindén, M.; Lindgren, M. Blood flow measurements at different depths using photoplethysmography and laser Doppler techniques. Ski. Res. Technol. 2009, 15, 139–147. [Google Scholar] [CrossRef] [PubMed]
  22. Huelsbusch, M.; Blazek, V. Rhythmical Phenomena in Dermal Perfusion-Proved Assesment Strategies and new Discoveries. Adv. Electr. Electron. Eng. 2011, 4, 112–117. [Google Scholar]
  23. Huelsbusch, M.; Blazek, V. Contactless mapping of rhythmical phenomena in tissue perfusion using PPGI. In Medical Imaging 2002: Physiology and Function from Multidimensional Images; SPIE: Cergy, France, 2002; Volume 4683, pp. 110–117. [Google Scholar] [CrossRef]
  24. Blazek, C.; Blazek, V. Selected Clinical Applications of Functional PPGI Perfusion Mapping in Dermatology. In Studies in Skin Perfusion Dynamics; Springer: Berlin/Heidelberg, Germany, 2021; pp. 207–221. [Google Scholar] [CrossRef]
  25. Wieringa, F.P.; Mastik, F.; van der Steen, A.F.W. Contactless multiple wavelength photoplethysmographic imaging: A first step toward ‘SpO2 camera’ technology. Ann. Biomed. Eng. 2005, 33, 1034–1041. [Google Scholar] [CrossRef]
  26. Optosupply. OSG59A5111P, 525 nm LED. Technology Datasheet, Version. A.0. 2011. Available online: https://www.micros.com.pl/en/optoelectronics/ (accessed on 6 July 2022).
  27. Optosupply. OS6YKA5201P, 625 nm LED. Version A.0. 2011. Available online: http://www.optosupply.com/search/result.asp (accessed on 6 July 2022).
  28. Osram. SFH 4544, 940 nm LED. Version 1.6. 2021. Available online: https://www.osram.com/ecat/com/en/class_pim_web_catalog_103489/prd_pim_device_2219771/ (accessed on 6 July 2022).
  29. AIMTEC. Training Applications AMES100-277NZ Models & Specifications. 2017. Available online: https://aimtec.com/index.aspx?a=SerieUp.List&ConverterTypeId=&undefined_SeriesCurrent=undefined&undefined_SeriesWattage=undefined&SerieSearch=AMES100-277NZ (accessed on 6 July 2022).
  30. Technology, M. 3-Channel, 20mA, Linear LED Driver CL320. Version. DSFP-CL320A091508. 2017. Available online: https://www.microchip.com/en-us/product/CL320 (accessed on 6 July 2022).
  31. Panavision. Lee 250 Half White Diffusion filter & Lee 216 Full White Diffusion Filter. Version 1.0. 2022. Available online: https://leefilters.com/colour/250-half-white-diffusion/ (accessed on 6 July 2022).
  32. Blackfly®s. BFS-U3-28S5. Revised 1/29/2019. 2019. Available online: http://softwareservices.flir.com/BFS-U3-28S5/latest/Model/spec.html (accessed on 6 July 2022).
  33. Abay, T.Y.; Kyriacou, P.A. Photoplethysmography in oxygenation and blood volume measurements. In Photoplethysmography; Academic Press: Cambridge, MA, USA, 2022; pp. 147–188. [Google Scholar] [CrossRef]
  34. Angelopoulou, E. The Reflectance Spectrum of Human Skin. Technical Reports (CIS). MS-CIS-99-29. December 1999. Available online: https://repository.upenn.edu/cis_reports/584 (accessed on 6 July 2022).
  35. Cooksey, C.C.; Allen, D.W.; Tsai, B.K. Reflectance data set and variability study for human skin reflectance. In Proceedings of the 29th Session of the CIE, Washington DC, USA, 14–22 June 2019. [Google Scholar] [CrossRef]
  36. Chatterjee, S.; Budidha, K.; Kyriacou, P.A. Investigating the origin of photoplethysmography using a multiwavelength Monte Carlo model. Physiol. Meas. 2020, 41, 84001. [Google Scholar] [CrossRef]
  37. Kyriacou, P.A.; Allen, J. Photoplethysmography: Technology, Signal Analysis and Applications; Academic Press: Cambridge, MA, USA, 2021. [Google Scholar] [CrossRef]
  38. Halbritter, H.; Jäger, C.; Weber, R.; Schwind, M.; Möllmer, F. High-speed LED driver for ns-pulse switching of high-current LEDs. IEEE Photonics Technol. Lett. 2014, 26, 1871–1873. [Google Scholar] [CrossRef]
  39. Wang, Y.; Alonso, J.M.; Ruan, X. A review of LED drivers and related technologies. IEEE Trans. Ind. Electron. 2017, 64, 5754–5765. [Google Scholar] [CrossRef]
  40. Tian, G.; Qi, W.; Yan, Y.; Jiang, Y.Z. High power factor LED power supply based on SEPIC converter. Electron. Lett. 2014, 50, 1866–1868. [Google Scholar] [CrossRef]
  41. Yeon, J.-E.; Kim, D.-S.; Cho, K.; Kim, H.-J. A single stage flyback power supply unit for LED lighting applications. In Proceedings of the 2009 International Conference on Electrical and Electronics Engineering-ELECO, Bursa, Turkey, 5–8 November 2009; p. I-288. [Google Scholar] [CrossRef]
  42. Pollock, A.; Pollock, H.; Pollock, C. High efficiency LED power supply. IEEE J. Emerg. Sel. Top. Power Electron. 2015, 3, 617–623. [Google Scholar] [CrossRef]
  43. FLIR. FLIR Product Catalog List. Version 17-0713. 2017. Available online: https://www.flir.eu/ (accessed on 6 July 2022).
  44. Liu, H.; Wang, Y.; Wang, L.E.I. The effect of light conditions on photoplethysmographic image acquisition using a commercial camera. IEEE J. Transl. Eng. Health Med. 2014, 2, 1800811. [Google Scholar] [CrossRef] [PubMed]
  45. Cooksey, C.C.; Allen, D.W.; Tsai, B.K. Reference data set of human skin reflectance. J. Res. Natl. Inst. Stand. Technol. 2017, 122, 1. [Google Scholar] [CrossRef]
Figure 1. Block diagram of the proposed system.
Figure 1. Block diagram of the proposed system.
Electronics 11 02958 g001
Figure 2. Timing diagram of the proposed system, rising edges of enable signals EN ¯ 525, EN ¯  625, EN ¯  940, for LEDs with wavelength of 525 nm, 625 nm and 940 nm are highlighted with green, red and brown color. Rising edge of capture frame signal ENcap is highlighted with yellow color.
Figure 2. Timing diagram of the proposed system, rising edges of enable signals EN ¯ 525, EN ¯  625, EN ¯  940, for LEDs with wavelength of 525 nm, 625 nm and 940 nm are highlighted with green, red and brown color. Rising edge of capture frame signal ENcap is highlighted with yellow color.
Electronics 11 02958 g002
Figure 3. Adjustability of illumination device.
Figure 3. Adjustability of illumination device.
Electronics 11 02958 g003
Figure 4. Standalone working unit of the illumination device.
Figure 4. Standalone working unit of the illumination device.
Electronics 11 02958 g004
Figure 5. PCB layout of the illumination device: (a) simplified; (b) physical layout.
Figure 5. PCB layout of the illumination device: (a) simplified; (b) physical layout.
Electronics 11 02958 g005
Figure 6. Connection of one LED string.
Figure 6. Connection of one LED string.
Electronics 11 02958 g006
Figure 7. Wiring diagram of LED driver, CL320, adapted from [30].
Figure 7. Wiring diagram of LED driver, CL320, adapted from [30].
Electronics 11 02958 g007
Figure 8. Illumination device switched on: infrared, red, and green light.
Figure 8. Illumination device switched on: infrared, red, and green light.
Electronics 11 02958 g008
Figure 9. Switched-on illumination device diffusion filter differences: left—no filter applied, middle—Lee 250 Half White Diffusion Filter, right—Lee 216 Full White Diffusion Filter.
Figure 9. Switched-on illumination device diffusion filter differences: left—no filter applied, middle—Lee 250 Half White Diffusion Filter, right—Lee 216 Full White Diffusion Filter.
Electronics 11 02958 g009
Figure 10. Forearm with marked region of interest.
Figure 10. Forearm with marked region of interest.
Electronics 11 02958 g010
Figure 11. Measuring system configuration.
Figure 11. Measuring system configuration.
Electronics 11 02958 g011
Figure 12. Region of interest and white paper for software calibration.
Figure 12. Region of interest and white paper for software calibration.
Electronics 11 02958 g012
Figure 13. Timing diagram of the proposed system, capture signal (blue color), enable signal of LEDs with wavelength of 625 nm (red color), enable signal of LEDs with wavelength of 525 nm (green color), enable signal of LEDs with wavelength of 940 nm (black color).
Figure 13. Timing diagram of the proposed system, capture signal (blue color), enable signal of LEDs with wavelength of 625 nm (red color), enable signal of LEDs with wavelength of 525 nm (green color), enable signal of LEDs with wavelength of 940 nm (black color).
Electronics 11 02958 g013
Figure 14. Recorded transients when the LEDs with a wavelength of 940 nm were switched on and the LEDs with a wavelength of 525 nm were switched off.
Figure 14. Recorded transients when the LEDs with a wavelength of 940 nm were switched on and the LEDs with a wavelength of 525 nm were switched off.
Electronics 11 02958 g014
Figure 15. Recorded transients when the LEDs with a wavelength of 525 nm were switched off and the LEDs with a wavelength of 625 nm remained switched off.
Figure 15. Recorded transients when the LEDs with a wavelength of 525 nm were switched off and the LEDs with a wavelength of 625 nm remained switched off.
Electronics 11 02958 g015
Figure 16. Recorded transients when the LEDs with a wavelength of 625 nm were switched on and the LEDs with a wavelength of 525 nm remained switched off.
Figure 16. Recorded transients when the LEDs with a wavelength of 625 nm were switched on and the LEDs with a wavelength of 525 nm remained switched off.
Electronics 11 02958 g016
Figure 17. Measured PPGI data: (a) measured waveforms at three wavelengths, device set in sequential pulse mode; (b) a five-second detail of 525 nm waveform; (c) a five-second detail of 625 nm waveform; (d) a five-second detail of 940 nm waveform.
Figure 17. Measured PPGI data: (a) measured waveforms at three wavelengths, device set in sequential pulse mode; (b) a five-second detail of 525 nm waveform; (c) a five-second detail of 625 nm waveform; (d) a five-second detail of 940 nm waveform.
Electronics 11 02958 g017
Figure 18. Amplitude AC maps, 3-λ mode.
Figure 18. Amplitude AC maps, 3-λ mode.
Electronics 11 02958 g018
Figure 19. Software calibration process: (a) magnitude of signals observed from white paper; (b) magnitude of signals observed from skin; (c) magnitude of signals observed from skin after calibration process.
Figure 19. Software calibration process: (a) magnitude of signals observed from white paper; (b) magnitude of signals observed from skin; (c) magnitude of signals observed from skin after calibration process.
Electronics 11 02958 g019
Figure 20. Amplitude DC maps, 3-λ mode: (a) before calibration; (b) after calibration.
Figure 20. Amplitude DC maps, 3-λ mode: (a) before calibration; (b) after calibration.
Electronics 11 02958 g020
Figure 21. Amplitude AC maps, 3-λ mode: (a) before calibration; (b) after calibration.
Figure 21. Amplitude AC maps, 3-λ mode: (a) before calibration; (b) after calibration.
Electronics 11 02958 g021
Table 1. Selected technical parameters of used LED diodes [26,27,28].
Table 1. Selected technical parameters of used LED diodes [26,27,28].
TypeWavelength (nm)IF (mA)VF (V)Radiance (mW/sr)Half Angle (°)
OSG59A5111P *(1) 525 (GREEN)503.1260.88
OS6YKA5201P *(2)625 (RED)752.3543.98
SFH4544 *(3)940 (IR)1001.655010
*(1,2) (Optosupply, Hong Kong), *(3) (Osram, München, Germany).
Table 2. Selected technical parameters of the power supply [29].
Table 2. Selected technical parameters of the power supply [29].
Type of Power Supply UsedAMES100-24S277NZ 24V
Recommended AC input voltage85 V–305 V
DC output voltage24 V
Output current4.5 A
Table 3. Quantum efficiency of the BFS-U3-28S5M-C camera, according to [32].
Table 3. Quantum efficiency of the BFS-U3-28S5M-C camera, according to [32].
Wavelength (nm)Quantum Efficiency (%)
52579%
62570%
94010%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Labuda, M.; Smondrk, M.; Babusiak, B.; Borik, S. System for Non-Contact and Multispectral Examination of Blood Supply to Cutaneous Tissue. Electronics 2022, 11, 2958. https://doi.org/10.3390/electronics11182958

AMA Style

Labuda M, Smondrk M, Babusiak B, Borik S. System for Non-Contact and Multispectral Examination of Blood Supply to Cutaneous Tissue. Electronics. 2022; 11(18):2958. https://doi.org/10.3390/electronics11182958

Chicago/Turabian Style

Labuda, Michal, Maros Smondrk, Branko Babusiak, and Stefan Borik. 2022. "System for Non-Contact and Multispectral Examination of Blood Supply to Cutaneous Tissue" Electronics 11, no. 18: 2958. https://doi.org/10.3390/electronics11182958

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop