Next Article in Journal
Oven-Controlled MEMS Oscillator with Integrated Micro-Evaporation Trimming
Next Article in Special Issue
Boxer Underwear Incorporating Textile Moisture Sensor to Prevent Nocturnal Enuresis
Previous Article in Journal
Performance Evaluation of RTS/CTS Scheme in Beacon-Enabled IEEE 802.15.6 MAC Protocol for Wireless Body Area Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of E-Textile Techniques and Materials for 3D Gesture Sensor with Boosted Electrode Design

by
Josue Ferri
1,
Raúl Llinares Llopis
2,
Gabriel Martinez
1,
José Vicente Lidon Roger
3 and
Eduardo Garcia-Breijo
3,*
1
Textile Research Institute (AITEX)-Alicante, 03801 Alcoy, Spain
2
Departamento de Comunicaciones, Universitat Politècnica de València, 03801 Alcoy, Spain
3
Instituto Interuniversitario de Investigación de Reconocimiento Molecular y Desarrollo Tecnológico (IDM), Universitat Politècnica de València, Universitat de València-Valencia, 46022 Valencia, Spain
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(8), 2369; https://doi.org/10.3390/s20082369
Submission received: 5 March 2020 / Revised: 7 April 2020 / Accepted: 15 April 2020 / Published: 22 April 2020
(This article belongs to the Special Issue E-Textiles and Sensors)

Abstract

:
There is an interest in new wearable solutions that can be directly worn on the curved human body or integrated into daily objects. Textiles offer properties that are suitable to be used as holders for electronics or sensors components. Many sensing technologies have been explored considering textiles substrates in combination with conductive materials in the last years. In this work, a novel solution of a gesture recognition touchless sensor is implemented with satisfactory results. Moreover, three manufacturing techniques have been considered as alternatives: screen-printing with conductive ink, embroidery with conductive thread and thermosealing with conductive fabric. The main critical parameters have been analyzed for each prototype including the sensitivity of the sensor, which is an important and specific parameter of this type of sensor. In addition, user validation has been performed, testing several gestures with different subjects. During the tests carried out, flick gestures obtained detection rates from 79% to 89% on average. Finally, in order to evaluate the stability and strength of the solutions, some tests have been performed to assess environmental variations and washability deteriorations. The obtained results are satisfactory regarding temperature and humidity variations. The washability tests revealed that, except for the screen-printing prototype, the sensors can be washed with minimum degradation.

1. Introduction

Textiles are everywhere; used as decoration, worn as protection, assembled as interior components in cars, or structural elements in constructions among others. Although normally, the textile industry is considered a traditional sector, the new market demands innovations to distinguish it from the other competitors and meet the new requests of the market [1]. The evolution of electronics and textile technologies have enabled the combination of their strengths, increasing computing speed, reducing chip size, improving energy autonomies and offering flexible surfaces. There exists an interest in new wearable solutions that can be directly worn on the curved human body or integrated into daily objects. Textiles offer some features appropriate to the human body, such as softness, comfortability and flexibility and others that make them suitable to include electronics, since they can be stretched, compressed, twisted and deformed arbitrarily. In addition, they offer excellent integrity and structural behavior during daily wearing and washing.
One of the most challenging applications of electronic textiles is to analyze postures and gestures for different purposes. The corresponding posture and gesture sensors can be utilized for many applications, such as rehabilitation [2,3,4], sign language recognition [5,6], remote control [7] or medical applications [8] among others.
Many researchers have developed sensing technologies to meet the need of soft wearable devices. Some of them are focused on soft bending sensors based on specific materials to accommodate the flexible and deformable nature of the human body [9]. Elastic conductive webbing solutions [10] or highly flexible fabrics [11] have drawn some interest. These solutions are normally used as small pieces of material attached to clothes in a specific position. Other groups of solutions are embedded in the fabric. These sensors combine different layers of both conductive and non-conductive textiles such as smart sleeves. These smart sleeves with deformable textiles enable the detection of a wide range of deformable gestures [12]. Other approaches present microfiber sensors by means of using fibers, such as dual-core conductive fibers working as a capacitive strain sensor, which can be sewed in a bandage or gloves [13], or more complex materials such as piezoelectric [14,15] or triboelectric [16,17] materials to create fiber strain sensors that can detect bending and torsion deformations. There are also solutions based on stretchable conductive threads that measure variations of resistance using materials such as reduced graphene oxide [18] or PEDOT [19] among others. All these previous solutions need to be attached to clothes or gloves to locate the sensors in specific positions to detect bending movements that sometimes could be obtrusive. As alternative solutions, some authors place the sensor on other external surfaces, obtaining touchless textile sensors used as an input to environmental control for individuals with upper-extremity mobility impairments [20] or multi-electrode capacitive sensors that detect simple control gestures [21] by means of contactless sensing.
Some existing research in textile sensors focuses on the use of capacitive sensors. Textile capacitors can be made combining conductive materials that are acting as conductive plates separated by dielectrics. The conductive plates can be woven, sewn and embroidered with conductive thread/fabrics, or they can be painted, printed, sputtered or screened with conductive inks or conductive polymers. The dielectrics used are typically foams, fabric spacers or non-conductive polymers [22,23]. Some works have achieved capacitive embroidered interdigitated structure used as moisture sensors [24], or conductive-knit fabric used as strain sensors [25]. Recently, RFID antennas have been implemented using embroidery [26]. Other investigation studies the impact of the human body on a capacitive textile sensor concluding how the movement of the body can affect the capacitance [27].
Regarding capacitive textile sensors for gesture recognition, few references can be found in the literature. In [20], 12 textile conductive plates sewn in a fabric implement a textile touchless capacitive sensor. In our previous work, two capacitive sensors for the purpose of gesture recognition were presented [28]. In addition, the behavior and influence of different e-textile materials in the textile sensor were shown. The electrodes that conformed the structure of the standard sensor were printed on textiles substrates using screen-printing technology. The different smart textiles prototypes presented were compared with a reference sensor.
In the present paper, an own boosted sensor design on a textile substrate is developed. It is based on the design recommended by Microchip. This boosted design presents fewer conductive layers and better performance than the standard one [29]. Although the boosted design needs higher voltage and more power than the standard one, it is also sensitive to a greater distance between the hand and the surface of the sensor. Three textile manufacturing technologies are used to implement this type of sensor with satisfactory results. Characterization of the sensors using a static artificial hand was performed. Subsequently, validation was carried out with different subjects, measuring the detection rate after several gesture repetitions. The obtained prototypes present some features such as flexibility that makes them suitable to be attached to clothing or textiles surfaces such as armchairs, curtains or automotive upholstery.

2. Materials and Methods

The research is divided into two main parts, one corresponding to the design and working principles and the other focusing on the development of the prototypes and the obtained results. Four resulting sensors were made considering the design recommendations of Microchip. The corresponding materials and technologies used were conductive ink screen-printed, conductive thread embroidered, conductive fabric thermosealed and conventional printed circuit board (PCB) using a milling machine. The expected theoretical value of the associated capacities is studied considering the permittivity of the materials to be used as dielectric layers. Furthermore, the real capacitance values obtained for each individual electrode are presented and compared with the theoretical ones. Afterward, the sensitivity of each individual development is measured and compared with the standard versions. Next, a characterization of the sensors and a user validation stage was carried out to assess their functioning. Moreover, an additional study of the response considering variations of temperature and humidity is presented. Finally, a complementary study of washability is given.

2.1. Electronic Design

Microchip Technology Inc. developed a new technology for gesture recognition [23]. This feature is carried out by means of some specific devices, named MGC3130 and MGC3030 (Microchip Technology Inc, Chandler, AZ, USA), capable of sensing a series of hand or finger movements. These devices, in combination with some sensing electrodes and a gesture recognition algorithm, compose the GestIC® sensor. This sensor utilizes an electric field for advanced proximity sensing. Usually, this sensor is implemented using a printed circuit board (PCB) technology on a rigid or flexible substrate, normally of polymer materials. The signals provided by the sensor are processed by the MGC3XXX devices. These devices utilize an algorithm to detect the position of the hand with respect to the sensor and the following gestures: approach detection, position tracking in 3D, sensor touch (touch, multitouch, tap and double-tap), flick gestures, circle gestures and air wheel.
The basic sensor design consists of 4 or 5 receiving electrodes (Rx) connected to the MGC3XXX Rx pins, 1 transmitting electrode (Tx) connected to the MCG3XXX Tx pin and an isolation layer between Rx and Tx electrodes. Both electrodes, Rx and Tx, are implemented with a conductive material such as copper, silver, etc. Regarding the isolation layer, it is made of any non-conductive material (FR4, glass, PET, etc.).
The sensor is based on the use of an electric field to sense proximity. The lines of the electric field are distorted when a hand or finger is placed in the free space above the sensor (Figure 1). The registered variation allows the system to detect, track or classify the motion resulting in a gesture visualized in a user interface application. The electrical field is generated by the application of an alternating signal conducted by an electrode that acts as an antenna. This produces an electrical field that propagates three-dimensionally around the surface. This electrode is considered the transmission electrode or Tx electrode. Its geometry is much smaller than the used wavelength, forcing the magnetic component to be practically zero with no wave propagation. Thus, quasi-static electrical near field is found, allowing the system to sense conductive objects, such as the human body. When a person places a finger on the sensor, it intrudes into the electrical field. The field lines are drawn to the finger and shunted to the ground using the intrinsic conductivity of the human body. This produces a distortion of the electrical field that is detected using some reception electrodes named Rx electrodes. Different Rx electrodes at different positions enable one to determine the origin of the perturbation and its value.
Microchip proposes two designs for the GestIC® sensors (Figure 1).
Standard sensor (Tx signal amplitude of 2.85 V). It is used in small or medium-sized devices (between 20 and 140 mm of width or length of the sensor). It is mandatory for devices with a weak connection to ground, that is, with battery. This Standard sensor consists of a top layer where four Rx electrodes are located on each of the cardinal points as well as a central Rx electrode. This layer is separated from the bottom layer, which contains the Tx electrode, by a dielectric. The ground plane layer is optional and would be located below the Tx electrode layer.
Boosted sensor (Tx signal amplitude between 5 and 18 V). It is used in systems with a large sensor size (even more than 200 mm of width or length of the sensor). In this case, the system must necessarily be grounded. This Boosted sensor consists of a top layer where four Rx electrodes are located on each of the cardinal points and a central Tx electrode. This layer is separated from the bottom layer that contains the Ground (GND) plane by a dielectric. The sensitive area is just delimited by the four perimeter Rx sensors.
The design of the boosted sensor is based on the structure of the Standard sensor with some modifications (Figure 2). More information on the working principle and the design of the Standard sensor can be found in the study by Ferri [22].
The main difference between the standard and the boosted sensor consists of the location of the Tx electrode. Boosted Tx electrodes are not placed underneath the Rx electrodes. Instead, the Tx electrode is laid out in the same layer as the Rx electrodes, substituting the central Rx electrode. Microchip recommends placing a GND plane in the bottom layer.
The design of the Rx electrodes is identical to the Standard sensor. For a sensor length of <140 mm, the electrode’s width must be between 4% and 7% of its electrode’s length whereas for a sensor length of >140 mm, it is recommended to use a width between 5 and 7 mm. As aforementioned, there is no Rx center electrode, since the center is dedicated to the Tx electrode.
Regarding the Tx electrode, it is not placed on another layer, but in the center of the Rx frame. This change, with respect to the standard design, forces a minimum distance between the Rx and Tx electrodes to limit the noise coupling between them. This distance is about 3 and 5 mm.
The Rx feeding lines must be kept apart from the Tx electrode. They must be routed next to the Rx electrodes or inside the GND plane. In addition, it is necessary to keep a distance of about 0.3 or 0.5 mm between GND and the Rx feeding lines.
Regarding the number of layers, the Standard sensor can be designed with a 2- or 3-layer stack, usually with 3 layers. On the other hand, the Boosted sensor consists of a 2-layer stack, a top layer with the Rx and Tx electrodes and a bottom layer with the GND plane. The optimum distance between these two layers (t) will depend on the relative permittivity (εr) of the isolation material between both layers. Microchip recommends t > εr/5. Hence, for an FR4 material (glass-reinforced epoxy laminate material with εr = 5), the thickness can be of 1 mm, whereas for plastic (εr = 3), it can be of 0.6 mm.
With respect to the circuitry for the boosted sensor, it is necessary a Tx level shifter since the Tx output voltage from MGC3XXX is 2.85 V. Microchip recommends the use of an MCP1416 power driver which allows one to increase the amplitude to values of up to 18 V. Hence, an additional DC input voltage must be used, or it must be generated by a DC–DC boost converter such as the MCP1661 converter.

2.2. Materials

With the aim of finding a textile with good characteristics to obtain capacitances of the order of 20 pF (capacitance recommended by Microchip), different cotton, polyester and mixed fabrics with different fabric densities, yarn diameter and weave were studied in the study by Ferri [22,30]. According to these studies, a polyurethane fabric with excellent characteristics was found. Table 1 shows the main characteristics of that fabric.
The conductive ink used was nano-silver DGP–NO from ANP (Table 2) for screen-printing technology, silver-coated polyamide/polyester hybrid thread (Silvertech 120) from AMANN Group (Table 3) for E-broidery and conductive woven fabric plain Shieldex® Zell from STATEX (Table 4) for the direct application of conductive textiles.

2.3. Manufacturing

In this research, an own boosted sensor design has been developed to be applied to a textile substrate. It is based on the design recommended by Microchip and applied to different manufacturing technologies, such as screen-printing technology, E-broidery and direct application of conductive textiles.
The screen-printing process consists of forcing pastes of different characteristics over a substrate through some screens using squeegees. Openings in the screen define the pattern that will be printed on the substrate by serigraphy. Conductive silver ink has been employed to make the electrodes and the GND plane.
E-broidery consists of patterning of conductive textiles by numerically controlled sewing or weaving processes. Conductive silver-coated threads have been used to embroider the electrodes and the GND plane.
Direct application of conductive textiles consists of adhering conductive textiles on the textile to create the electrodes and the GND plane.
The capacitances associated with the architecture design are fundamental in the operation of the sensor and, therefore, in its design. The CTxRx (capacitance between the Tx and the Rx electrodes), CRxGND (capacitance between the Rx electrodes and GND) and CTxGND (capacitance between the Tx electrodes and GND) associated capacitances are the ones that must be considered for the design. More information about these capacitances can be found in the study by Ferri [22]. Microchip recommends a value lower than 20 pF for the CTxRx and CRxGND capacitances, and lower than 1 pF for the CTxGND capacitance in the case of Standard sensor, whereas for a Boosted sensor, the values will depend on the booster driving circuit capabilities.
The proposed design is shown in Figure 3. It consists of a ground plane layer (Figure 3a) and a layer containing the Tx electrode, the four Rx electrodes and their connection lines with the MGC3XXX device (Figure 3b). The dimensions are shown in the same Figure. The electrode size is 80 × 80 mm and the sensing area is 66 × 66 mm.
The resulting sensors have been named as 3DBS_Screen, 3DBS_Embroidery and 3DBS_Fabric in the case of those made with the aforementioned e-textile technologies. For comparison purposes, a fourth boosted sensor made with a PCB technology, named 3DBS_PCB, was made. Moreover, two additional Standard sensors have also been analyzed in order to compare the standard and the boosted response. These standard sensors can be found in in the study by Ferri [28]. The names used for them in the paper are 3DS_Screen and 3DS_PCB.

2.4. Sensor Development

The same pattern design (Figure 3) has been applied to the three e-textile technologies and, in addition, to a PCB sensor in order to be able to carry out a comparison (Figure 4).
Screen-printing technology (Figure 4a): as previously mentioned, screen-printing technology uses a mesh to transfer ink onto a substrate, openings in the screen defining the pattern that will be printed on the substrate. The rest of the screen is made impermeable to the ink by a blocking stencil. The thickness of the screen, among other parameters, defines the final thickness of the ink. When screen-printing technology is used, it is necessary to manufacture frames with the screen mesh for the design. The screen for the conductors was a 230-mesh polyester material (PET 1500 90/230-48 from Sefar). Afterwards, to transfer the pattern to a screen mesh, a UV film Dirasol 132 from Fujifilm was used. The final screen thickness was 74 μm for the screen for conductors. The patterns were transferred to the screen by using a UV light source unit IC-5000 from BCB. Printing was carried out by using E2XL from EKRA screen-printer with a shore 75° hardness squeegee, 60° squeegee angle, 1 mm snap-off, 3.5 bar force and 100 mm/s. After the deposition of the inks, these were cured in an air oven FED-115 from BINDER at 130° C for 15 min.
E-broidery technology (Figure 4b): An embroidery process whereby an embroidery machine is used to create electrical patterns on textiles. One type of silver-coated polyamide/polyester hybrid threads was used with 28 Tex properties on the textile substrate selected. An embroidery machine was preferred instead of a normal stitching machine due to the fact that it has a better stitch quality and a vast range of design possibilities. The process was carried out by using an embroidery machine from ZSK with an F Head, with a 1.5 mm/stitch configuration. The conductive design has been accomplished with 7350 stitches in all.
Direct application of conductive textiles technology (Figure 4c): The textile conductor Shieldex® Zell was placed on a MACbond 0.5 mil PET double-sided coated adhesive tape from MACTAC. A desktop cutting machine Cameo3 from SILHOUETTE was used to make the pattern cut. Subsequently, the different parts of the electrode were peeled off and adhered to the fabric using the other adhesive side of the film.
PCB technology (Figure 4d): A double-sided PCB was made with a ProtoMat S63 from LPKF. The main characteristics of the PCB are 1.6 mm of thickness, 15 μm of copper thickness and the use of FR4 as the isolation material.

2.5. Measurement

The relative permittivity measures were carried out with a BK PRECISION 895 LCR meter. The following measurement accessories were used: BK PRECISION TL89K1 Kelvin Clips Leads and a Yokogawa-Hewlett Packard 16451A Dielectric Test Adaptor. The LCR meter was configured to measure a tension level of 1 V, with an average of 64 samples and a low read rate (Level = 1 V, Avg = 64, Mean Time = Low). The measurement mode was Cp and D (parallel capacitance and loss tangent). The capacitance measurements were taken at three different parts of the fabric with a 5-frequency scan (0.1 kHz, 1 kHz, 10 kHz, 100 kHz and 1000 kHz). The εr value was obtained directly from the Cp value.
The capacitance values were measured with the same equipment but in mode Cp-Rp (parallel capacitance and resistance) and Z-d (impedance and phase). The capacitance measurements were taken at three different parts of the fabric with a 9-frequency scan (0.1 kHz, 0.5 kHz, 1 kHz, 5 kHz, 10 kHz, 50 kHz, 100 kHz, 500 kHz and 100 kHz).

3. Results and Discussion

Figure 5 shows the relative permittivity values (εr) of the fabric which acts as a dielectric of the capacitor. This value is important since it defines the values of the capacitances of the electrodes. As can be seen, its value remains stable from 104 Hz. Since the working frequency of MGC3XXX is situated between 40 kHz and 100 kHz, the relative permittivity remains constant and does not contribute to a variation of the capacity value in this working range [30].
The relative permittivity allows one to calculate the expected theoretical value of the associated capacities. The edge effect capacitance value (Cedge) has been taken as the theoretical value since it considers the effect of the field lines around the edges of the capacitor. It is estimated using Equations (1) and (2):
C e d g e = ε 0 · ε r · L + Δ f · w + Δ f t
Δ f = t + ε 0 · t · 10 · ln L + w + 1 π
where Cedge is the value of the capacitance in pF, L is the length in cm, w is the width in cm, t is the thickness in cm, εr is the relative permittivity and ε0 is the vacuum permittivity (8.85 × 10−12 F/m). The capacitance value (CRxGND) of the North electrode has been calculated since this electrode is the one with less influence of the capacitances associated with the Rx conduction lines to the connector. The calculated value is 10.9 pF at 104 Hz.
For each manufacturing technology and type of textile, the following measures of their electrical parameters have been taken: the CTxRx, CRxGND and CTxGND capacitances. Figure 6 shows the Cp and Rp values of the parallel equivalent circuit as well as the impedance and phase values. The frequency response of the capacity value remains constant in the working range of MGC3XXX, ensuring the correct configuration of the device regardless of the frequency value. The Rp value is low enough to not have significant loss current. The impedance and phase correspond to the expected ones in a pure capacitor and there is no resonance up to the studied frequency (106 kHz).
Table 5 shows only the values of the capacitances (Cp) associated with each one of the types of developed sensors. All the boosted sensors have a capacitance lower or close to 20 pF. 3DBS_Fabric presents the lowest capacitances, followed by 3DBS_Screen. 3DBS_Embroidery and 3DBS_PCB have capacitances around 20 pF and a CTxGND noticeably greater than 3DBS_Fabric and 3DBS_Screen; this difference may be what leads to a different sensitivity of these sensors can be seen later. In the case of the standard versions, 3DS_Screen presents a capacitance lower than 20 pF, except in the case of CTxGND. For this reason, an operational amplifier (op-amp) must be inserted between the Tx pin and the Tx electrode as Microchip recommends. Finally, 3DS_PCB presents the greatest capacitances, above 20 pF.
When comparing the theoretical CRxGND_North value (10.9 pF) with the real one (CRxGND_Screen = 12.5 ± 0.9 pF, CRxGND_Embroidery = 22.7 ± 1.1 pF and CRxGND_Fabric = 9.9 ± 0.1 pF), it can be observed that the theoretical approximation is very reliable. It is practically identical in the case of using fabric, very approximate in the case of using ink and it moves away significantly in the case of using embroidery. In the latter case, it can be considered that there is an added effect in the dielectric caused by the air that exists between the fabric and the threads and among the threads themselves.
The sensitivity was measured with software provided by Microchip, the AUREA graphical user interface. The sensitivity allows one to characterize the sensors, being, maybe, the most important parameter of these sensors. Microchip [31] provides an “artificial hand”, a 40 × 40 × 70 mm Styrofoam (εr ≈ 1) cube covered with an adhesive copper sheet (Figure 7). This block must be connected to the ground to simulate the conditions of the human body. To determine the sensitivity at different heights from the surface of the sensor, the block is placed on blocks of Styrofoam (with no copper cover) of different thicknesses (1, 2, …, cm). AUREA allows one to read the obtained data.
Figure 8 shows a representation of the sensitivity in terms of the signal deviation. Microchip references the signal deviation obtained in MGC3XXX with respect to the distance of the hand compared with the width of the Rx electrodes. The 3DBS_Screen and 3DBS_Fabric sensors present the best sensitivity with similar capacitances to the 3DBS_Embroidery and 3DBS_PCB sensors. The difference may be due to the fact that in the latter, the CTxGND is greater. The standard version, 3DS_Screen, presents a similar sensitivity to the 3DBS_Embroidery and 3DBS_PCB sensors. However, the 3DS_Screen design manufacturing needs one more layer, which is a disadvantage, despite having similar capacitances. Another factor to consider is that the boosted sensor uses a Tx output voltage increasing the amplitude up to 18 V. As expected, the PCB standard version presents the lowest sensitivity.
As aforementioned, the sensor is initially designed to be attached to clothing or textiles surfaces such as armchairs, curtains or automotive upholstery. In this case, the most important textile feature is flexibility. Several bend radiuses were proved and the response was successful up to radiuses lower than 3 cm. The driver had to be calibrated for every test. Figure 9 shows the flexibility of the resulting 3DBS_Embroidery sensor, assessing the flexibility feature of the e-textile sensor.
A study of the response of the electrode based on the variation of temperature and humidity has been carried out to determine their influence under different operating conditions with a climatic test chamber CTS C70/300 from Controltecnia-CTS. Figure 10 shows how these variations have a low influence on the associated capacitance.
Finally, a study of the variation in conductivity versus washing processes has been carried out. The characteristics of the wash have been one hour of delicate wash at 30 °C with a spin cycle of 700 rpm. Figure 11 shows the result of the normalized resistance variation, from initial resistance value, in a conductor pattern used in the three technologies (fabric, thread and ink).
The best behavior to washing is offered by the conductive thread, maintaining its characteristics after 100 washes. The silver ink deteriorates rapidly after 5 washes, losing conductivity, (Figure 12) and the conductive fabric supports 100 washes but its electrical characteristics varied during the process.
For the silver ink case, it could have chosen to cover the sensor with a heat-sealable film, but after the washing test with this type of film, problems of adhesion between the film and the conductors also arise after few washes (Figure 13). With this background, the best option is to use a conductive thread.
For the characterization of the sensors, the following protocol has been established. An artificial hand has been placed at different positions on the X-, Y- and Z-axis with respect to the center of the sensor. For each position, the signal deviation data provided by the device has been registered. For the sake of simplicity, only the measurements taken from the PCB sensor and the screen-printed sensor (3DBS_Screen) are shown in Figure 14. It shows the curves obtained by moving the artificial hand in the X-axis in the [–5 cm, 5 cm] interval in 1 cm steps for the following values of Z: 1 cm, 3 cm and 5 cm. In all cases, the value of Y = 0.
As can be seen, the results for the textile sensor are not as smooth as in the PCB sensor due to the textile structure itself. On the other hand, a conductivity variation is observed in the textile sensor, as opposed to the case of the PCB sensor. This behavior is due to the asymmetry of the east and the west sensor. The design of the east sensor tracks is shifted to the left favoring a shorter track for the west sensor. The different tests carried out showed the same behavior. Despite this, the functioning of the gesture recognition is not affected, since the variations are high enough to be detected in the five sensors. The rest of the sensors showed similar behavior.
Next, a validation of the sensors was carried out with different subjects. The objective was to measure the detection rate of several gestures. Figure 15 shows two of the gestures used in the validation procedure. The software used, AUREA, was supplied by Microchip.
In the validation procedure, 10 subjects participated in the experiment. Initially, they were completely unaware of the operation of the sensor. They were allowed to interact with the sensor for 10 minutes. Afterwards, they were asked to perform different gestures detectable by the sensor. After calibration, the subjects were asked to make 10 repetitions of the following movement types: flick from west to east, flick from east to west, flick from north to south, flick from south to north, clockwise circular and counterclockwise circular. The results of the detection rate for the 3DBS_Screen sensor are shown in Table 6.
The results show that most of the gestures are detected successfully. All the flick-type gestures were detected with a percentage higher than 75%. In contrast, the clockwise and counterclockwise gestures have a lower detection rate. This is due to the higher complexity of the circular movement. Besides, the counterclockwise is more difficult to detect than the clockwise movement.
It can be observed (Table 7) that although the three proposed sensors have slightly worse performance than the PCB sensor, most of the gestures were detected successfully. The proposed sensors have better performance with flick gestures rather than with counterclockwise and clockwise gestures. Among the proposed sensors, the 3DBS_Embroidery showed the best performance.

4. Conclusions

The aim of this work was to obtain a textile 3D gesture recognition sensor based on the Microchip 3D GestIC® sensor design. A boosted sensor was used allowing greater sensing distances with respect to the standard sensor. Three manufacturing techniques were considered as alternatives: screen-printing with conductive ink, embroidery with conductive thread and thermosealing with conductive fabric. The theoretical capacitance study was very reliable when compared with the real measurements. The prototypes were validated with respect to the detection of gestures with successful results. In the base of the studies of sensitivity, response to humidity and temperature, and resistance to washing, it can be concluded that the technique of embroidery with conductive thread is a good solution to incorporate into the e-textile industry.

Author Contributions

Conceptualization, J.F.; methodology, R.L.L.; validation, J.V.L.R.; formal analysis, J.V.L.R.; investigation, J.F., E.G.-B. and G.M.; writing—original draft preparation, J.F. and E.G.-B.; writing—review and editing, R.L.L.; supervision, E.G.-B.; project administration, R.L.L.; funding acquisition, J.F and E.G.-B. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Spanish Government/FEDER funds (RTI2018-100910-B-C43) (MINECO/FEDER). The work presented is also funded by the Conselleria d’Economia Sostenible, Sectors Productius i Treball, through IVACE (Instituto Valenciano de Competitividad Empresarial) and cofounded by ERDF funding from the EU. Application No.: IMAMCI/2020/1.

Conflicts of Interest

The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

References

  1. Cherenack, K.; Van Pieterson, L. Smart textiles: Challenges and opportunities. J. Appl. Phys. 2012, 112, 091301. [Google Scholar] [CrossRef] [Green Version]
  2. Yang, G.; Deng, J.; Pang, G.; Zhang, H.; Li, J.; Deng, B.; Pang, Z.; Xu, J.; Jiang, M.; Liljeberg, P.; et al. An IoT-Enabled Stroke Rehabilitation System Based on Smart Wearable Armband and Machine Learning. IEEE J. Transl. Eng. Heal. Med. 2018, 6, 1–10. [Google Scholar] [CrossRef] [PubMed]
  3. Caldani, L.; Pacelli, M.; Farina, D.; Paradiso, R. E-textile platforms for rehabilitation. In Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina, 31 August–4 September 2010; pp. 5181–5184. [Google Scholar] [CrossRef]
  4. Han, S.H.; Ahn, E.J.; Ryu, M.H.; Kim, J.N. Natural hand gesture recognition with an electronic textile goniometer. Sensors Mater. 2019, 31, 1387–1395. [Google Scholar] [CrossRef]
  5. Lorussi, F.; Scilingo, E.P.; Tesconi, M.; Tognetti, A.; De Rossi, D. Strain sensing fabric for hand posture and gesture monitoring. IEEE Trans. Inf. Technol. Biomed. 2005, 9, 372–381. [Google Scholar] [CrossRef] [PubMed]
  6. He, T.; Shi, Q.; Wang, H.; Wen, F.; Chen, T.; Ouyang, J.; Lee, C. Beyond energy harvesting - multi-functional triboelectric nanosensors on a textile. Nano Energy 2019, 57, 338–352. [Google Scholar] [CrossRef]
  7. Kundu, A.S.; Mazumder, O.; Lenka, P.K.; Bhaumik, S. Hand Gesture Recognition Based Omnidirectional Wheelchair Control Using IMU and EMG Sensors. J. Intell. Robot. Syst. Theory Appl. 2018, 91, 529–541. [Google Scholar] [CrossRef]
  8. Santos, L.; Carbonaro, N.; Tognetti, A.; González, J.; de la Fuente, E.; Fraile, J.; Pérez-Turiel, J. Dynamic Gesture Recognition Using a Smart Glove in Hand-Assisted Laparoscopic Surgery. Technologies 2018, 6, 8. [Google Scholar] [CrossRef] [Green Version]
  9. Shen, Z.; Yi, J.; Li, X.; Mark, L.H.P.; Hu, Y.; Wang, Z. A soft stretchable bending sensor and data glove applications. Robot. Biomim. 2016, 3, 88–93. [Google Scholar] [CrossRef] [Green Version]
  10. Shyr, T.-W.; Shie, J.-W.; Jiang, C.-H.; Li, J.-J. A Textile-Based Wearable Sensing Device Designed for Monitoring the Flexion Angle of Elbow and Knee Movements. Sensors 2014, 14, 4050–4059. [Google Scholar] [CrossRef] [Green Version]
  11. Huang, Y.; Gao, L.; Zhao, Y.; Guo, X.; Liu, C.; Liu, P. Highly flexible fabric strain sensor based on graphene nanoplatelet–polyaniline nanocomposites for human gesture recognition. J. Appl. Polym. Sci. 2017, 134, 1–8. [Google Scholar] [CrossRef]
  12. Parzer, P.; Sharma, A.; Vogl, A.; Steimle, J.; Olwal, A.; Haller, M. SmartSleeve: Realtime sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline. In Proceedings of the UIST ’17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Québec, QC, Canada, 22–25 October 2017; pp. 565–577. [Google Scholar] [CrossRef] [Green Version]
  13. Yu, L.; Feng, Y.; Yao, L.; Soon, R.H.; Yeo, J.C.; Lim, C.T. Dual-Core Capacitive Microfiber Sensor for Smart Textile Applications. ACS Appl. Mater. Interfaces 2019, 11, 33347–33355. [Google Scholar] [CrossRef] [PubMed]
  14. Chen, S.; Lou, Z.; Chen, D.; Jiang, K.; Shen, G. Polymer-Enhanced Highly Stretchable Conductive Fiber Strain Sensor Used for Electronic Data Gloves. Adv. Mater. Technol. 2016, 1, 1–9. [Google Scholar] [CrossRef]
  15. Li, Y.-Q.; Huang, P.; Zhu, W.-B.; Fu, S.-Y.; Hu, N.; Liao, K. Flexible wire-shaped strain sensor from cotton thread for human health and motion detection. Sci. Rep. 2017, 7, 45013. [Google Scholar] [CrossRef] [PubMed]
  16. Guo, Y.; Zhang, X.S.; Wang, Y.; Gong, W.; Zhang, Q.; Wang, H.; Brugger, J. All-fiber hybrid piezoelectric-enhanced triboelectric nanogenerator for wearable gesture monitoring. Nano Energy 2018, 48, 152–160. [Google Scholar] [CrossRef]
  17. Haque, R.I.; Farine, P.A.; Briand, D. Soft triboelectric generators by use of cost-effective elastomers and simple casting process. Sens. Actuators A Phys. 2018, 271, 88–95. [Google Scholar] [CrossRef]
  18. Huang, X.; Wang, Q.; Zang, S.; Wan, J.; Yang, G.; Huang, Y.; Ren, X. Tracing the Motion of Finger Joints for Gesture Recognition via Sewing RGO-Coated Fibers onto a Textile Glove. IEEE Sens. J. 2019, 19, 9504–9511. [Google Scholar] [CrossRef]
  19. Eom, J.; Jaisutti, R.; Lee, H.; Lee, W.; Heo, J.; Lee, J.; Park, S.K.; Kim, Y. Highly Sensitive Textile Strain Sensors and Wireless User-Interface Devices Using All-Polymeric Conducting Fibers. ACS Appl. Mater. Interfaces 2017, 9, 10190–10197. [Google Scholar] [CrossRef]
  20. Evaluating Touchless Capacitive GestureRecognition as an Assistive Device for Upper Extremity Mobility Impairment. Available online: https://doi.org/10.1177/2055668318762063. (accessed on 20 April 2020).
  21. Cheng, J.; Bannach, D.; Lukowicz, P. On body capacitive sensing for a simple touchless user interface. In Proceedings of the 2008 5th International Summer School and Symposium on Medical Devices and Biosensors, Hong Kong, China, 1–3 June 2008; pp. 113–116. [Google Scholar] [CrossRef]
  22. Gonçalves, C.; da Silva, A.F.; Gomes, J.; Simoes, R. Wearable e-textile technologies: A review on sensors, actuators and control elements. Inventions 2018, 3, 14. [Google Scholar] [CrossRef] [Green Version]
  23. Mecnika, V.; Hoerr, M.; Krievins, I.; Jockenhoevel, S.; Gries, T. Technical Embroidery for Smart Textiles: Review. Mater. Sci. Text. Cloth. Technol. 2015, 9, 56. [Google Scholar] [CrossRef] [Green Version]
  24. Martínez-Estrada, M.; Moradi, B.; Fernández-Garcia, R.; Gil, I. Impact of conductive yarns on an embroidery textile moisture sensor. Sensors 2019, 19, 1004. [Google Scholar] [CrossRef] [Green Version]
  25. Atalay, O. Textile-based, interdigital, capacitive, soft-strain sensor for wearable applications. Materials 2018, 11, 768. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Liu, Y.; Xu, L.; Li, Y.; Ye, T.T. Textile based embroidery-friendly RFID antenna design techniques. In Proceedings of the 2019 IEEE International Conference on RFID (RFID), Phoenix, AZ, USA, 2–4 April 2019. [Google Scholar]
  27. Iliev, I.T.; Nikolov, G.T.; Tabakov, S.D.; Tzaneva, B.R. Experimental Investigation of Textile Planar Capacitive Sensors. In Proceedings of the 2018 IEEE XXVII International Scientific Conference Electronics—ET, Sozopol, Bulgaria, 13–15 September 2018; pp. 1–4. [Google Scholar]
  28. Ferri, J.; Llopis, R.; Moreno, J.; Ibañez Civera, J.; Garcia-Breijo, E. A Wearable Textile 3D Gesture Recognition Sensor Based on Screen-Printing Technology. Sensors 2019, 19, 5068. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Microchip, GestIC® Design Guide, DS40001716C. 2016. Available online: http://ww1.microchip.com/downloads/en/devicedoc/40001716c.pdf (accessed on 19 April 2020).
  30. Ferri, J.; Llinares Llopis, R.; Moreno, J.; Vicente Lidón-Roger, J.; Garcia-Breijo, E. An investigation into the fabrication parameters of screen-printed capacitive sensors on e-textiles. Text. Res. J. 2020, 0, 1–21. [Google Scholar] [CrossRef]
  31. Microchip, Aurea Graphical User Interface User’s Guide, DS40001681D. 2015. Available online: http://ww1.microchip.com/downloads/en/DeviceDoc/40001681D.pdf (accessed on 19 April 2020).
Figure 1. Standard (left) and Boosted (right) sensors used by Microchip. The standard version consists of 5 RX electrodes on the top layer plus a transmitting electrode (Tx) on an inner layer. The boosted version has 4 receiving electrodes (Rx) and 1 Tx electrodes on the top layer. The sensing space is the same in terms of area but is lower in volume in the case of the standard version. Source: Microchip Technology Inc.
Figure 1. Standard (left) and Boosted (right) sensors used by Microchip. The standard version consists of 5 RX electrodes on the top layer plus a transmitting electrode (Tx) on an inner layer. The boosted version has 4 receiving electrodes (Rx) and 1 Tx electrodes on the top layer. The sensing space is the same in terms of area but is lower in volume in the case of the standard version. Source: Microchip Technology Inc.
Sensors 20 02369 g001
Figure 2. Basic design parameters recommended by Microchip for a (a) Standard sensor and (b) Boosted sensor. Source: Microchip Technology Inc.
Figure 2. Basic design parameters recommended by Microchip for a (a) Standard sensor and (b) Boosted sensor. Source: Microchip Technology Inc.
Sensors 20 02369 g002
Figure 3. Boosted sensor design: ground plane layer (a) and Tx–Rx electrodes (b).
Figure 3. Boosted sensor design: ground plane layer (a) and Tx–Rx electrodes (b).
Sensors 20 02369 g003
Figure 4. Three-dimensional (3D) gesture sensor developments with the three e-textile technologies: (a) screen-printing, (b) embroidery and (c) direct application of conductive textile and with the printed circuit board (PCB) material (d).
Figure 4. Three-dimensional (3D) gesture sensor developments with the three e-textile technologies: (a) screen-printing, (b) embroidery and (c) direct application of conductive textile and with the printed circuit board (PCB) material (d).
Sensors 20 02369 g004
Figure 5. Frequency response of fabric relative permittivity.
Figure 5. Frequency response of fabric relative permittivity.
Sensors 20 02369 g005
Figure 6. Values of the equivalent capacitor circuit: (a) parallel capacitance Cp, (b) parallel resistance Rp, (c) impedance and (d) phase value.
Figure 6. Values of the equivalent capacitor circuit: (a) parallel capacitance Cp, (b) parallel resistance Rp, (c) impedance and (d) phase value.
Sensors 20 02369 g006
Figure 7. “Artificial hand” provided by Microchip made of Styrofoam covered by copper and connected to ground.
Figure 7. “Artificial hand” provided by Microchip made of Styrofoam covered by copper and connected to ground.
Sensors 20 02369 g007
Figure 8. Signal deviation of the different sensors in function of the distance of the hand from the surface of the sensor. The smallest graph is the magnification of the 10 cm limit.
Figure 8. Signal deviation of the different sensors in function of the distance of the hand from the surface of the sensor. The smallest graph is the magnification of the 10 cm limit.
Sensors 20 02369 g008
Figure 9. Flexible 3D Boosted sensor manufactured.
Figure 9. Flexible 3D Boosted sensor manufactured.
Sensors 20 02369 g009
Figure 10. (a) Capacitance variation depending on the humidity at a fixed temperature of 20 °C; (b) capacitance variation depending on the temperature at a fixed humidity of 40% RH.
Figure 10. (a) Capacitance variation depending on the humidity at a fixed temperature of 20 °C; (b) capacitance variation depending on the temperature at a fixed humidity of 40% RH.
Sensors 20 02369 g010
Figure 11. Normalized resistance variation in a conductor pattern used in the three technologies (fabric, thread and ink) versus number of washes.
Figure 11. Normalized resistance variation in a conductor pattern used in the three technologies (fabric, thread and ink) versus number of washes.
Sensors 20 02369 g011
Figure 12. (a) Appearance of the silver ink before washing and (b) after 5 washes.
Figure 12. (a) Appearance of the silver ink before washing and (b) after 5 washes.
Sensors 20 02369 g012
Figure 13. (a) Appearance of the silver ink coated with a heat-sealed film before washing and (b) after 5 washes. The bubbles generated between the substrate and the film and the degeneration of the silver ink are observed.
Figure 13. (a) Appearance of the silver ink coated with a heat-sealed film before washing and (b) after 5 washes. The bubbles generated between the substrate and the film and the degeneration of the silver ink are observed.
Sensors 20 02369 g013
Figure 14. Characterization of the sensors using an artificial hand: (a) PCB reference sensor fixing Z = 0 position. (b) Textile sensor fixing Z = 0 position. (c) PCB reference sensor fixing Z = 3 cm position. (d) Textile sensor fixing Z = 3 cm position. (e) PCB reference sensor fixing Z = 5 cm position. (f) Textile sensor fixing Z = 5 cm position.
Figure 14. Characterization of the sensors using an artificial hand: (a) PCB reference sensor fixing Z = 0 position. (b) Textile sensor fixing Z = 0 position. (c) PCB reference sensor fixing Z = 3 cm position. (d) Textile sensor fixing Z = 3 cm position. (e) PCB reference sensor fixing Z = 5 cm position. (f) Textile sensor fixing Z = 5 cm position.
Sensors 20 02369 g014
Figure 15. Two of the gestures used in the validation: (a) flick from north to south and (b) flick from west to east.
Figure 15. Two of the gestures used in the validation: (a) flick from north to south and (b) flick from west to east.
Sensors 20 02369 g015
Table 1. Fabric characteristics.
Table 1. Fabric characteristics.
FabricPolyurethane
Picture Sensors 20 02369 i001
Weft MaterialPolyurethane
Warp MaterialPolyurethane
LigamentNon-woven
Thickness (µm)1300 ± 16
Grammage (g/m2)152 ± 5
Table 2. Silver ink characteristics.
Table 2. Silver ink characteristics.
DGP-NO
Specific Resistivity (µΩ⋅cm)10–50
Solids (%)70–80
Viscosity (cps)50–150
Curing120 °C–150 °C
PropertiesSilver Nanoparticles
Table 3. Embroidery thread silver characteristics.
Table 3. Embroidery thread silver characteristics.
Silvertech 120
Resistance per Unit Length (Ω/m)<530
Textile No.28
Needle Size (in No.)11–14
MaterialsPolyamide/polyester covered of silver
Properties
  • Skin friendly
  • Biocompatible
  • Antibacterial
  • Antistatic
Table 4. Conductive fabric plain characteristics.
Table 4. Conductive fabric plain characteristics.
Zell RS
Grammage (g/m2)77% ± 15%
Thickness (µm)110% ± 15%
Width (mm)1300% ± 3%
Fabric Density (Thread/cm2)84 ± 2
Sheet Resistivity (Ω/sq)≤0.02
MaterialsTin copper silver plated nylon fabric
PropertiesWashable
Table 5. Capacitance values (pF) at 104 Hz.
Table 5. Capacitance values (pF) at 104 Hz.
3DBS_Screen3DBS_Embroidery3DBS_Fabric3DBS_PCB3DS_Screen3DS_PCB
CTxRxN11.7 ± 0.118.6 ± 0.58.9 ± 0.418.5 ± 0.415.1 ± 10.333.9 ± 10.7
CTxRxS13.5 ± 1.018.1 ± 0.19.8 ± 0.324.1 ± 0.419.3 ± 10.434.6 ± 10.7
CTxRxE13.5 ± 0.619.8 ± 0.111.6 ± 0.622.3 ± 0.815.1 ± 10.330.1 ± 10.6
CTxRxW11.6 ± 0.816.6 ± 0.58.2 ± 0.118.9 ± 0.316.1 ± 10.330.6 ± 10.6
CRxNGND12.5 ± 0.922.7 ± 1.19.9 ± 0.120.7 ± 1.115.1 ± 10.334.3 ± 10.7
CRxSGND16.6 ± 0.821.8 ± 0.911.3 ± 0.229.3 ± 1.019.5 ± 10.433.2 ± 10.7
CRxEGND16.1 ± 0,.524.1 ± 1.212.5 ± 0.227.7 ± 0.915.1 ± 10.330.3 ± 10.6
CRxWGND13.0 ± 0.419.5 ± 0.710.2 ± 0.121.4 ± 1.216.1 ± 10.330.2 ± 10.6
CTxGND56.2 ± 0.5112.6 ± 2.338.1 ± 1.1130.8. ± 5.72327.0 ± 56.5635.0 ± 22.7
Table 6. Gesture conducted test results for the 3DBS_Screen sensor.
Table 6. Gesture conducted test results for the 3DBS_Screen sensor.
Gesture S. 0S. 1S. 2S. 3S. 4S. 5S. 6S. 7S. 8S. 9%
Flick W–E90%90%80%80%90%80%70%90%90%80%84%
Flick S–N80%100%80%100%60%80%70%80%70%70%79%
Flick N–S90%100%90%80%80%90%90%80%70%60%83%
Flick E–W90%90%90%90%90%90%90%90%70%80%87%
Counterclockwise60%70%70%70%70%60%60%70%60%60%65%
Clockwise70%80%70%80%80%70%70%60%70%80%73%
Table 7. Comparison of the results obtained by the three proposed sensors and the PCB sensor.
Table 7. Comparison of the results obtained by the three proposed sensors and the PCB sensor.
Gesture 3DBS_Fabric3DBS_Screen3DBS_EmbroideryPCB
Flick W–E84%84.00%86%89%
Flick S–N81%79.00%81%81%
Flick N–S84%83.00%85%86%
Flick E–W88%87.00%89%90%
Counterclockwise59%65.00%73%86%
Clockwise76%73.00%74%84%

Share and Cite

MDPI and ACS Style

Ferri, J.; Llinares Llopis, R.; Martinez, G.; Lidon Roger, J.V.; Garcia-Breijo, E. Comparison of E-Textile Techniques and Materials for 3D Gesture Sensor with Boosted Electrode Design. Sensors 2020, 20, 2369. https://doi.org/10.3390/s20082369

AMA Style

Ferri J, Llinares Llopis R, Martinez G, Lidon Roger JV, Garcia-Breijo E. Comparison of E-Textile Techniques and Materials for 3D Gesture Sensor with Boosted Electrode Design. Sensors. 2020; 20(8):2369. https://doi.org/10.3390/s20082369

Chicago/Turabian Style

Ferri, Josue, Raúl Llinares Llopis, Gabriel Martinez, José Vicente Lidon Roger, and Eduardo Garcia-Breijo. 2020. "Comparison of E-Textile Techniques and Materials for 3D Gesture Sensor with Boosted Electrode Design" Sensors 20, no. 8: 2369. https://doi.org/10.3390/s20082369

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop