Next Article in Journal
Optimization of Saliva Collection and Immunochromatographic Detection of Salivary Pepsin for Point-of-Care Testing of Laryngopharyngeal Reflux
Previous Article in Journal
High Sensitivity Differential Giant Magnetoresistance (GMR) Based Sensor for Non-Contacting DC/AC Current Measurement
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors

ICT Based Public Transportation Research Team, Korea Railroad Research Institute, Uiwang 16105, Korea
Sensors 2020, 20(1), 324; https://doi.org/10.3390/s20010324
Submission received: 3 December 2019 / Revised: 28 December 2019 / Accepted: 4 January 2020 / Published: 6 January 2020
(This article belongs to the Section Electronic Sensors)

Abstract

:
An advanced driver-assistance system (ADAS), based on lane detection technology, detects dangerous situations through various sensors and either warns the driver or takes over direct control of the vehicle. At present, cameras are commonly used for lane detection; however, their performance varies widely depending on the lighting conditions. Consequently, many studies have focused on using radar for lane detection. However, when using radar, it is difficult to distinguish between the plain road surface and painted lane markers, necessitating the use of radar reflectors for guidance. Previous studies have used long-range radars which may receive interference signals from various objects, including other vehicles, pedestrians, and buildings, thereby hampering lane detection. Therefore, we propose a lane detection method that uses an impulse radio ultra-wideband radar with high-range resolution and metal lane markers installed at regular intervals on the road. Lane detection and departure is realized upon using the periodically reflected signals as well as vehicle speed data as inputs. For verification, a field test was conducted by attaching radar to a vehicle and installing metal lane markers on the road. Experimental scenarios were established by varying the position and movement of the vehicle, and it was demonstrated that the proposed method enables lane detection based on the data measured.

1. Introduction

An advanced driver-assistance system (ADAS) assists a driver in dangerous situations that may not always be recognized by a human driver or a self-driving system. Among the many functions of ADAS, the lane departure warning system (LDWS) and lane keeping assistant system (LKAS) help in safe driving by assisting the driver in case of an unintended departure from the lane. Although the LDWS is a warning system, the LKAS is a more advanced system that has the ability to maintain the lane through steering wheel control in conjunction with the control system. A system that assists in lane keeping helps tremendously in accident prevention and is an essential function for autonomous driving technology in the future.
The most critical factor in successful implementation of any lane keeping technology is lane detection. Currently, the most widely used sensor for lane detection is a camera. Lane detection technology using cameras has been mainly studied to increase its recognition rate in complex environments [1,2,3,4] and to reduce the complexity for real-time lane recognition [5,6,7,8]. However, when cameras are affected by factors, such as lighting conditions, fog, and obstacles, the lane recognition rate is degraded. Furthermore, for the advancement of autonomous driving technology, which has recently gained much attention, it should be able to detect lanes even when the camera is not working well. Therefore, research is needed on lane detection technology using other sensors to complement the camera.
In addition to cameras, light detection and ranging (LiDAR) systems and radars have also been proposed as sensors for lane recognition [9,10,11,12,13]. The method using LiDAR uses the difference in intensity of the received signal reflected from the asphalt and the lane of the road. Although relatively accurate, the cost of implementing a LiDAR system is still high, and it requires a large amount of computation for data processing; hence, it is mainly limited to being used in research on autonomous vehicles [9,10,11]. In a radar-based system, as there is no difference between the reflected signals of asphalt and a lane, a radar reflector is installed in the lane for guidance. Clarke et al. [12] studied the imaging of reflectors on roads with synthetic aperture radars (SARs). Radar signals for reflectors were generated by modeling and not based on actual data, and simulations showed that images of reflectors can be generated. Stolz et al. [13] also investigated installation of metal reflectors along the lanes to detect them with radar. They analyzed the advantages and disadvantages of reflectors by comparing the radar cross-sections with different types of reflectors. For lane recognition, a method of extracting a line by clustering signals close to the line among the detected radar signals is proposed. In general, previous studies on lane recognition using radar have used long-range radar that can have a range of up to tens of meters. In reported studies, simulations or experiments were conducted in an environment without surrounding objects. However, in the practical environment in which a vehicle operates, there are many interference sources around the vehicle such as pedestrians, buildings, and other lanes that reflect signals. The vehicle radar may know the reflected signal strength, direction, and speed information of the detected target, but this information is not enough to distinguish between lanes and other objects. In general, as there is no other object between the vehicle and the lane, minimizing the detection distance to the lane can prevent the interference source from being received by the radar. However, vehicle radars have poor range resolution, making it difficult to distinguish roads and lane reflectors at close range. Difficulties in lane detection with sub-10 m range were also observed in the study by Stolz et al. [13]. Therefore, radar with high-range resolution are needed to distinguish lane and road surfaces at close range.
As discussed above, cameras play a major role in lane detection. However, in a real road environment, there arise some situations wherein lane detection via cameras is difficult such as when the lighting changes suddenly, when direct sunlight hits the lens, or when there is fog. Hence, radar and LiDAR were investigated for lane detection. Even though LiDAR works well with rapid lighting changes, lane detection is still difficult in fog or in direct incident sunlight. In such environments, radar is a good alternative sensor. Radar is slightly ineffective while detecting the position of the lane in comparison with cameras or LiDAR, but it can at least confirm the existence of a lane; thus, it can be used to detect lanes in situations where cameras or LiDAR are difficult to operate. In this study, we propose a new lane detection method using impulse radio ultra-wideband (IR-UWB) radars to contribute to the determination of lane departure in situations where camera and LiDAR do not function well. The IR-UWB radars have a high-range resolution, because they transmit short pulses at the nano- or picosecond [14]. The high-range resolution of IR-UWB radars has been applied to various fields such as detection, location estimation, tracking, recognition, and bio-signal measurement. There have been studies for detecting, estimating, and tracking humans [15,16,17,18,19,20] and further studies for detecting multiple humans [21,22,23]. They are also used in the field of cognition, where they have been used for studies on distinguishing human body movements including hand gestures and mouth movements [24,25,26,27,28]. In addition, they have also been studied to measure bio-signals for detecting movements such as human breathing and heartbeats in a non-invasive manner [29,30,31,32,33,34,35,36,37,38,39]. However, to the best of our knowledge, there has been no research using IR-UWB radars for lane recognition in the automotive field.
In this paper, we propose a lane detection method based on IR-UWB radar with characteristics that are suitable for near-lane recognition. Lane recognition requires the presence of objects with a higher reflectivity than the road surface. In our proposed method, metal plates with the same width and length as the lane markings were installed at regular intervals over the actual lane markings, while the radar was directed toward the road surface. The thickness of the metal plates does not affect the radar reflection, so they could be very thin. However, they should be sufficiently robust to withstand being repeatedly run over by vehicles. In addition, most metals are excellent radar signal reflectors with a higher reflectance being advantageous for lane detection. To prevent noise signals from other than the lane, the detection range was set to a distance where the lane was expected to be detected and the lane reflection energy was in the detection range. The detected energy was a signal reflected from the road surface and the metal lane, and the lane candidate group was selected based on the energy difference. The energy detector output of the lane reflector installed at regular intervals repeated the strength and weakness of the signal periodically. The lane interval was calculated using the estimated period and vehicle speed information, and finally, the existence of lanes was determined. A field experiment was performed to verify the proposed method. To this end, a radar was attached to the rearview mirror of the vehicle and metal lanes were installed at regular intervals and lengths in the same position as the existing lanes. Experimental scenarios were established, and actual data were acquired according to the movement of the vehicle in the lane. Based on the measured data, the proposed method successfully detected lanes and verified whether lanes can be maintained or departed.

2. System Model

The proposed lane recognition system model using IR-UWB radar is shown in Figure 1. The IR-UWB radar is installed in the rearview mirror of the vehicle and emits a transmission signal toward the road surface. If the lane reflection signal does not interfere with the vehicle surface reflection, the radar position does not affect the application of the lane detection method proposed herein. On the road, metal lane reflectors (“metal lanes” hereafter) are installed at regular intervals along the lanes and at regular intervals and lengths in the same position as the existing paint markings. The IR-UWB radar transmits impulse signals and receives signals reflected by the road surface and metal lanes. The process of transmitting and receiving an impulse is called a radar scan, and the received signal is an IR-UWB signal. The signal of the kth radar scan is given as follows when the transmission pulse x(t) is received as N k reflected signals:
r k t = i = 1 N k a k i x t t k i + n t
where k is a slow time index, which means a single radar scan, and t is a fast time index, the time in which the pulse signal is reflected back after being emitted from the radar, and the value is linearly related to the distance from the radar to the reflector. a k i and t k i are the amplitude and time of arrival of the i th received signal in the k th radar scan, respectively. n t is the observation noise of the UWB radar channel. The proposed lane detection method receives the IR-UWB signal and vehicle speed as input signals. Vehicle speed can be obtained through the on-board diagnostics terminal of the vehicle or by installing sensors such as GPS and odometer. The proposed lane detection method can be applied independently to the left and right lanes of the vehicle. This study focused on the right lane, but the same method can be applied to the left lane, because there is no significant difference in the environments of the right and left lanes. With the proposed lane detection method, it is possible to check whether there are lanes on the left and right sides of the vehicle, so it can be linked with the LDWS.

3. Lane Detection Method

In this section, we discuss the workflow for lane detection shown in Figure 2 to detect metal lanes. The detection range determination block determines the minimum and maximum distances to perform energy detection on the IR-UWB signal. If the detected energy is above the threshold, the process proceeds to the next step, lane spacing estimator block, which calculates the lane interval based on vehicle speed data and the energy detection result over several hours. The lane presence determination block determines whether a lane exists by comparing the estimated lane spacing with the actual lane spacing.

3.1. Detection Range Determination and Energy Detector

The IR-UWB radar signal r k t represents the intensity of the reflected signal according to the distance from the radar. In general, as the position of the target is not known, it is estimated by targeting places where the received signal strength is large. However, the lane detection system model proposed herein predicts the minimum and maximum distances from the radar to the metal lanes if the vehicle starts in the lane. Therefore, the range of energy detection can be set from the minimum to the maximum distance at which the lane is expected to be detected, and the lane can be detected using the magnitude or change of the energy value. The distance calculation from the radar to the lane requires a three-dimensional coordinate system from the plane of x , y to the height of the z -axis, but the height of the radar does not change according to the movement of the vehicle. Consider the x and y coordinate planes as shown in Figure 3a. Let the length of one metal lane be L l , the distance between the starting points of two consecutive metal lanes, the lane spacing L s , the width of the left and right lanes W l , and the vehicle width W c . Although not shown in Figure 3, let us assume that the height of the radar is z = H r . Figure 3b shows an example where the distance to the radar and lane is the closest. In this situation, the radar is immediately above the lane, i.e., the radar and lane have the same x and y coordinates (x = 0 and 0 y L l , L s y L s + L l ). For the above coordinates, the distance between the radar and lane is minimal, such that the minimum distance d m i n can be written as
d m i n = H r
Figure 3c shows an example of the longest distance between the radar and lanes when the radar is x , y = W l + W c , L s L l 2 and the lane is x ,   y = 0 ,   0 . Therefore, the maximum distance between the radar and lane d m a x can be written as:
d m a x = W l + W c 2 + L s L l 2 2 + H r 2
The d m a x value also refers to the minimum distance that the radar should detect; this should be taken into account when selecting a radar. As d m i n and d m a x are the distance between the radar and the lane, we can convert them to the time, which is the energy detector input value equal to the time when the round trip distance is moved at the speed of light. Therefore, the minimum and maximum detection ranges t m i n and t m a x can be written as:
t m i n = 2 × d m i n / c ,
t m a x = 2 × d m a x / c
where c is the speed of light. If energy detection is performed for the detection range t m i n t t m a x , the energy detector output E k for the k th scan can be written as:
E k = t = t m i n t m a x r k t 2
When the range resolution of the IR-UWB radar is smaller than the size of the detection object, the optimal detector is the square sum of the received signal when the signal is reflected from multiple range cells of the object [14]. In the proposed system, the IR-UWB radar has a resolution of several centimeters and the lane is several meters in size, so the above energy detector is the optimal detector for this lane detection system. If the detector output value is greater than a threshold, the lane candidate can be detected. The threshold value can be determined by measuring the energy detector output values with and without metal lanes. The threshold determination is discussed in detail in Experimental Results section.

3.2. Lane Spacing Estimation and Lane Presence Determination

To estimate lane spacing, let us look at the change in reflected energy as the vehicle moves over two consecutive metal lanes. For simplifying the figures and equations, let L s = 2 L and L l = L in Figure 4. Suppose the radar moves from y = 0 to y = 2 L with x = 0 and z = H r fixed in the coordinate system of Figure 3. Suppose the detection range is from 2 L to 2 L only in the y -axis direction at each point. As shown in Figure 4, let us consider the result of detecting the energy reflected from the lane at each point, assuming that the position of the radar changes from A to F as the vehicle moves. Let E A , E B , E C , E D , E E , and E F be the energies detected by the radar at points AF, respectively. To compare the magnitude of the energy reflected by the lanes, divide each lane in half and divide it into four areas, from 1 to 4. The energy reflected from the lanes of the 1st and 2nd regions is detected from −2L to +2L from the point A to the y-axis, and the energies of the areas 1 and 2 detected at the point A are called E A 1 and E A 2 , respectively. Similarly, at points B and C, only the energies reflected in areas 1 and 2 are detected. At point D, the energy reflected from areas 2 and 3 is detected, and at the points E and F, the energy of the signal reflected from the lanes of areas 3 and 4 is detected. This can be summarized and rewritten as:
E A = E A 1 + E A 2
E B = E B 1 + E B 2
E C = E C 1 + E C 2
E D = E D 2 + E D 3
E E = E E 3 + E E 4
E F = E F 3 + E F 4
The reflected energy of area 1 at point A, areas 1 and 2 at point B, area 2 at point C, area 3 at point E, and areas 3 and 4 at point F are the same. As the distances from the radar to the lanes are the same and the area of each area is the same, the reflected energy is also detected. Therefore, we can write:
E A 1 = E B 1 = E B 2 = E C 2 = E E 3 = E F 3 = E F 4
In addition, the distances from point A to area 2, from point C to area 1, from point D to areas 2 and 3, and from point E to area 4 are equal, and the area of areas 1–4 is the same. The energy of the realm is the same and can be written as:
E A 2 = E C 1 = E D 2 = E D 3 = E E 4
Comparing the value of Equation (8) with the value of Equation (9), the areas 1–4 have the same area, but Equation (8) is closer to the lanes than Equation (9). Therefore, the energy value of Equation (8) is larger than Equation (9) and the following relationship holds:
E A 1 = E B 1 = E B 2 = E C 2 = E E 3 = E F 3 = E F 4 >   E A 2 = E C 1 = E D 2 = E D 3 = E E 4
Substituting the result of Equation (10) into Equation (7), the energy values at each point from A to F have the following order of magnitude:
E B = E F > E A = E C = E E > E D
Based on Equation (11), the energy values detected at each point as the radar moves from A to F are shown in the energy versus time graph at the bottom of Figure 4. The maximum energy value appears in the middle of the first and second lanes and the distance between them is L s . The distance L s traveled from B to F using the time taken to travel between the points B and F and the speed information of the vehicle can be estimated as follows:
L s ˜ = v c t F t B f s
where f s is the radar scanning rate in scans per second, t B and t F are the slow time index at B and F, respectively, and v c is the vehicle speed. For convenience of explanation, x = 0 is assumed, but the radar position changes to 0 x W l + W c if the vehicle moves without leaving the lane when the actual vehicle is driven. This is because the vehicle does not move completely straight and there is a lateral movement when moving in the lane. Even in this case, if the energy is compared in the manner above, the tendency to detect the highest energy at the middle point of the lane and the least energy at the middle point between the lanes will not change, but an estimation error e = L s L s ˜ occurs. In the lane presence determination block, it is possible to determine whether a lane exists by determining whether the estimated lane interval that can be recognized as a lane is smaller than the maximum estimated error. Estimation errors can be determined based on data measured in the real environment and are explained in the Experimental Results section.
Next, the range of the values of the parameters mentioned in Figure 3 are described. Assuming that at least N radar scans should be performed for one lane to ensure that the energy detector output represents the periodicity illustrated in Figure 4, the length of one lane L l should satisfy the inequality V c × N / f s L l ; then, the minimum value of L l is V c × N / f s . Further, to fully observe one cycle in the energy output curve in Figure 4, the minimum distance L s must satisfy L s 2 L l ; thus, the minimum value of L s is 2 L l . The larger the value of L l , the longer the maximum energy value at points B or F. Likewise, the larger the value of L s , the longer the minimum energy at point D. Therefore, the larger the values of L l and L s , the longer the period of energy detector output value and the longer the lane detection time. Therefore, the optimal lane spacing value is L s = 2 L l so as to update the lane detection results as soon as possible. The combined width W l of the left and right lanes and the width W c of the vehicle can be seen as constants and depend on the road conditions and the vehicle; hence, they are not parameters that can be varied. Finally, the height H r where the antenna is installed, must be determined in consideration of W l , W c , L s , and L l such that d m a x in Equation (3) is smaller than the minimum detection distance of the radar.

4. Experimental Results

In order to verify the method proposed above, metal lanes and radars were installed, and field tests were performed as shown in Figure 5. In terms of equipment, only the right lane markings were installed with metal lanes and the radar was installed only on the right side rearview of the vehicle. As there was no significant difference between the right and left side in the road environment, there were no problems in the feasibility verification of the proposed lane detection method. Environment variables were measured as follows: length of the metal lane L l = 3 m, distance between the center of each metal lane (lane spacing) L s = 8 m, width of the lane W l = 3.5 m, vehicle width W c = 1.9 m, radar installation height H r = 1.32 m, and radar scanning rate f s = 20 scans per second. The vehicle traveled at speeds ranging from 20 to 30 km/h (5.56–8.33 m/s), depending on driving conditions. The radar used in this experiment was Xethru X4m03 IR-UWB radar which had a center frequency of 8.748 GHz and a bandwidth of 1.5 GHz. For the above environment, the energy detection range was determined as d m i n = 1.32 m and d m a x = 3.65 m by applying Equations (2) and (3).
To test the lane detection method, four scenarios were established by varying the installation of metal lanes and vehicle movement path as shown in Figure 6. Scenario 1 is an environment in which no metal lanes or special reflectors were installed on the road. The vehicle traveled in a straight line, 30 cm from the right lane. In Scenarios 2–4, metal lanes were installed. The vehicle moved at distances of 30 and 120 cm from the right lane markers in Scenarios 2 and 3, respectively. In Scenario 4, the vehicle moved at a distance of 30 cm from the right lane markers between metal lanes 1 and 4, and the vehicle moved from metal lanes 4 to 5 and went over into the lane on the left, from metal lane 4 to 5.
The next step was to determine the threshold value to distinguish lanes and roads by the energy detector output value. For this purpose, energy detector output values were collected through experiments with and without metal lanes. The histogram was plotted by measuring approximately 6000 energy detector output values at different locations between the vehicle and the radar while the vehicle was in the lane. Figure 7a–c are histograms of the energy detector outputs for Scenarios 1, 2, and 3, respectively. Threshold-based decision making is best to minimize the false alarm rate. The proposed method estimates the location of the next lane by considering the vehicle speed based on the previous lane; if it finds the lane above the threshold, a false alarm may occur; hence, the speed-based lane estimation algorithm cannot operate well due to the misidentified lane. Therefore, in the proposed lane recognition method, the threshold was set to 5.4 mW which is larger than 5.36 mW, the maximum value of the energy detector output in Figure 7a; thus, the false alarm rate was 0%. Thus, the metal lane detection rates for Scenarios 2 and 3 were 98.7% and 90.9%, respectively.
The following are the experimental results for each scenario. The energy detector output for Scenario 1 and the IR-UWB signal at 3.9 s are shown in Figure 8. It represents the energy reflected by simply the road surface without special reflectors; its value was less than the threshold value 5.4 mW.
The energy detector output for Scenario 2 and the IR-UWB signal at 1.6 s at the maximum energy in metal lane 1 are shown in Figure 9. The energy detector output shows the highest value as it passes through the center of each metal lane with the energy detector output between 6 mW and 7 mW.
The travel time, speed, and estimated metal lane spacing among maximum energy value points for each metal lane are shown in Table 1. The metal lane installation interval was 8 m and metal lanes were detected with an error of ±0.25 m. The experimental Scenario 2 was the best environment for lane detection, where we obtained a detection rate of 94% and an average lane spacing error of 22 cm by repeating Scenario 2 ten times.
Figure 10 shows the energy detector output for Scenario 3. However, unlike Scenario 2, the energy portion of the lane is unclear, but the lanes were detected above the threshold, and the lane spacing estimate was <20 cm except for lanes 2 and 3, with an error of up to 97 cm for lanes 2 and 3 as shown in Table 2. The experimental Scenario 3 was the worst environment for lane detection, where we obtained a detection rate of 86% and average lane spacing error of 38 cm by repeating Scenario 3 ten times.
Scenario 4 is when a vehicle moves from metal lane 4 to 5 and goes over into the lane on the left. In Figure 11, metal lanes 1 to 4 were detected, and the energy detector output had the highest value of 4.96 mW at 5.8 s and did not exceed the threshold value of 5.4 mW; hence, the metal lane 5 was not detected. In this scenario, if a vehicle leaves the lane, the lane is not detected, and a warning signal is sent to the LDWS. Metal lane spacing estimates for Scenario 4 are shown in Table 3.
Finally, the reflection signal by the manhole that could be mistaken as a metal lane among the metallic facilities on the road was examined. The round and square manholes were tested, and the manholes used for the measurement are shown in Figure 12. The received signal and energy detector output for the round and square manholes are shown in Figure 13 and Figure 14, respectively. Both manholes were detected with an energy detector output of 5.4 mW or more but would not be detected as lanes, because they do not appear in series with periodicity.

5. Conclusions

An IR-UWB radar-based lane detection method was proposed and verified through experiments. Metal lane markers were installed because radar cannot be used to recognize common paint lane markers. The proposed method estimates lane spacing using the periodic changes in reflected energy values in the regularly installed lane and by comparing it with the actual value to determine a lane. This result can be used in conjunction with the LDWS to assist drivers in an environment where camera-based lane recognition technology does not operate smoothly or to improve the autonomous driving recognition technology. In addition, the proposed lane recognition system can also be utilized for estimating the travel distance or position through counting of lane markers. The results from field experiments showed that the obtained lane detection rates were approximately 86%–94% for the experimental scenarios and 90.9%–98.7% in the sample collection step for the histogram. This difference was because the experiment was performed by precisely moving the vehicle at a speed of 10 km/h in the sample collection step, whereas the vehicle moved at 20–30 km/h in the experimental scenarios and slightly swayed toward the left and right. This difference may also be attributed to the difference in the number of samples. The lane spacing estimation error was in the range of 22–38 cm on average; however, actual errors occurred up to 97 cm. The reason for the large error in the lane spacing estimation was that the vehicle did not move in a direction that was completely parallel to the lane. However, this type of vehicle swaying is encountered at all times, even during actual vehicle driving scenarios. This error can be compensated for if the inertial sensor information or the steering information of the vehicle can be used. Accurate lane spacing estimates will help eliminate the sources of high reflectivity such as manholes.
In this study, the possibility of lane detection using IR-UWB radar was demonstrated. Although this method is difficult to apply to all roads owing to the installation cost of metal lanes, it can be applied at places where cameras encounter difficulty while operating such as tunnel entrances and exits, places that are prone to fog, and places with direct sunlight. As radars must also be installed, our proposed model may be appropriate for vehicles requiring high safety, such as public transportation, rather than for all vehicles. The areas for further study toward commercialization are as follows. First, the energy detector output must be modeled by accumulating and analyzing experimental data in various road environments such as curved roads and sloped roads. To increase the lane detection rate, research on lane detection-specific IR-UWB and antenna radiation pattern optimization is also required.

Acknowledgments

This research was supported by a grant (20TLRP-C152478-02) from the Transportation and Logistics Research Program funded by the Ministry of Land, Infrastructure, and Transport (MOLIT) of the Korean Government and the Korea Agency for Infrastructure Technology Advancement (KAIA).

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Cheng, W.C. PSO algorithm particle filters for improving the performance of lane detection and tracking systems in difficult roads. Sensors 2012, 12, 17168–17185. [Google Scholar] [CrossRef] [PubMed]
  2. Hoang, T.M.; Hong, H.G.; Vokhidov, H.; Park, K.R. Road lane detection by discriminating dashed and solid road lanes using a visible light camera sensor. Sensors 2016, 16, 1313. [Google Scholar] [CrossRef] [PubMed]
  3. Hoang, T.M.; Baek, N.R.; Cho, S.W.; Kim, K.W.; Park, K.R. Road lane detection robust to shadows based on a fuzzy system using a visible light camera sensor. Sensors 2017, 17, 2475. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Tapia-Espinoza, R.; Torres-Torriti, M. Robust lane sensing and departure warning under shadows and occlusions. Sensors 2013, 13, 3270–3298. [Google Scholar] [CrossRef] [Green Version]
  5. Wu, C.B.; Wang, L.H.; Wang, K.C. Ultra-low complexity block-based lane detection and departure warning system. IEEE Trans. Circuits Syst. Video Technol. 2019, 29, 582–593. [Google Scholar] [CrossRef]
  6. Li, Q.; Zhou, J.; Li, B.; Guo, Y.; Xiao, J. Robust lane-detection method for low-speed environments. Sensors 2018, 18, 4274. [Google Scholar] [CrossRef] [Green Version]
  7. Son, J.; Yoo, H.; Kim, S.; Sohn, K. Real-time illumination invariant lane detection for lane departure warning system. Expert Syst. Appl. 2015, 42, 1816–1824. [Google Scholar] [CrossRef]
  8. Jung, H.; Min, J.; Kim, J. An efficient lane detection algorithm for lane departure detection. In Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, Australia, 23–26 June 2013; pp. 976–981. [Google Scholar]
  9. Jung, J.; Bae, S.H. Real-time road lane detection in urban areas using LiDAR data. Electronics 2018, 7, 276. [Google Scholar] [CrossRef] [Green Version]
  10. Hata, A.; Wolf, D. Road marking detection using LIDAR reflective intensity data and its application to vehicle localization. In Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Qingdao, China, 8–11 October 2014; pp. 584–589. [Google Scholar]
  11. Kammel, S.; Pitzer, B. Lidar-based lane marker detection and mapping. In Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands, 4–6 June 2008; pp. 1137–1142. [Google Scholar]
  12. Clarke, D.; Andre, D.; Zhang, F. Synthetic aperture radar for lane boundary detection in driver assistance systems. In Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Baden-Baden, Germany, 19–21 September 2017; pp. 238–243. [Google Scholar]
  13. Stolz, M.; Feng, Z.; Kunert, M.; Wiesbeck, W.; Li, M. Lane detection with a high-resolution automotive radar by introducing a new type of road marking. IEEE Trans. Intell. Transp. Syst. 2018, 20, 2430–2447. [Google Scholar]
  14. Taylor, J. Ultra-Wideband Radar Technology, 1st ed.; CRC Press: Boca Raton, FL, USA, 2001; ISBN 0849342678. [Google Scholar]
  15. Rana, S.; Dey, M.; Ghavami, M.; Dudley, S. Signature inspired home environments monitoring system using IR-UWB technology. Sensors 2019, 19, 385. [Google Scholar] [CrossRef] [Green Version]
  16. Sabushimike, D.; Na, S.; Kim, J.; Bui, N.; Seo, K.; Kim, G. Low-rank matrix recovery approach for clutter rejection in real-time IR-UWB radar-based moving target detection. Sensors 2016, 16, 1409. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Nguyen, V.H.; Pyun, J.Y. Location detection and tracking of moving targets by a 2D IR-UWB radar system. Sensors 2015, 15, 6740–6762. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. SangHyun, C.; Wolf, M.; Burdick, J.W. Human detection and tracking via Ultra-Wideband (UWB) radar. In Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA, 3–8 May 2010; pp. 452–457. [Google Scholar]
  19. Nezirovic, A.; Yarovoy, A.G.; Ligthart, L.P. Signal processing for improved detection of trapped victims using UWB radar. IEEE Trans. Geosci. Remote Sens. 2010, 48, 2005–2014. [Google Scholar] [CrossRef]
  20. Chang, S.; Sharan, R.; Wolf, M.; Mitsumoto, N.; Burdick, J.W. UWB radar-based human target tracking. In Proceedings of the 2009 IEEE Radar Conference, Pasadena, CA, USA, 4–8 May 2009; pp. 1–6. [Google Scholar]
  21. Choi, J.W.; Quan, X.; Cho, S.H. Bi-directional passing people counting system based on IR-UWB radar sensors. IEEE Internet Things J. 2018, 5, 512–522. [Google Scholar] [CrossRef]
  22. Liang, F.; Qi, F.; An, Q.; Lv, H.; Chen, F.; Li, Z.; Wang, J. Detection of multiple stationary humans using UWB MIMO radar. Sensors 2016, 16, 1922. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Choi, J.W.; Nam, S.S.; Cho, S.H. Multi-human detection algorithm based on an impulse radio ultra-wideband radars. IEEE Access 2016, 4, 10300–10309. [Google Scholar] [CrossRef]
  24. Jiang, L.; Zhou, X.; Che, L.; Rong, S.; Wen, H. Feature extraction and reconstruction by using 2D-VMD based on carrier-free UWB radar application in human motion recognition. Sensors 2019, 19, 1962. [Google Scholar] [CrossRef] [Green Version]
  25. Yim, D.; Lee, W.H.; Kim, J.I.; Kim, K.; Ahn, D.H.; Lim, Y.H.; Cho, S.H.; Park, H.K.; Cho, S.H. Quantified activity measurement for medical use in movement disorders through IR-UWB radar sensor. Sensors 2019, 19, 688. [Google Scholar] [CrossRef] [Green Version]
  26. Ghaffar, A.; Khan, F.; Cho, S.H. Hand pointing gestures based digital menu board implementation using IR-UWB transceivers. IEEE Access 2019, 7, 58148–58157. [Google Scholar] [CrossRef]
  27. Khan, F.; Leem, S.; Cho, S.H. Hand-based gesture recognition for vehicular applications using IR-UWB radar. Sensors 2017, 17, 833. [Google Scholar] [CrossRef]
  28. Shin, Y.H.; Seo, J. Towards contactless silent speech recognition based on detection of active and visible articulators using IR-UWB radar. Sensors 2016, 16, 1812. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Yin, W.; Yang, X.; Li, L.; Zhang, L.; Kitsuwan, N.; Oki, E. HEAR: Approach for heartbeat monitoring with body movement compensation by IR-UWB radar. Sensors 2018, 18, 3077. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Khan, F.; Cho, S.H. A detailed algorithm for vital sign monitoring of a stationary/non-stationary human through IR-UWB radar. Sensors 2017, 17, 290. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Leem, S.K.; Khan, F.; Cho, S.H. Vital sign monitoring and mobile phone usage detection using IR-UWB radar for intended use in car crash prevention. Sensors 2017, 17, 1240. [Google Scholar] [CrossRef] [Green Version]
  32. Liang, X.; Wang, Y.; Wu, S.; Gulliver, T.A. Experimental study of wireless monitoring of human respiratory movements using UWB impulse radar systems. Sensors 2018, 18, 3065. [Google Scholar] [CrossRef] [Green Version]
  33. Pittella, E.; Pisa, S.; Cavagnaro, M. Breath activity monitoring with wearable UWB radars: Measurement and analysis of the pulses reflected by the human body. IEEE Trans. Biomed. Eng. 2016, 63, 1447–1454. [Google Scholar] [CrossRef]
  34. Schires, E.; Georgiou, P.; Lande, T.S. Vital sign monitoring through the back using an UWB impulse radar with body coupled antennas. IEEE Trans. Biomed. Circuits Syst. 2018, 12, 292–302. [Google Scholar] [CrossRef]
  35. Fathy, A.E.; Koo, Y.S.; Liu, Q.; Ren, L.; Wang, H.; Wang, Y. Noncontact multiple heartbeats detection and subject localization using UWB impulse Doppler radar. IEEE Microw. Wirel. Compon. Lett. 2015, 25, 690–692. [Google Scholar]
  36. Liu, L.; Liu, Z.; Barrowes, B.E. Through-wall bio-radiolocation with UWB impulse radar: Observation, simulation and signal extraction. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2011, 4, 791–798. [Google Scholar] [CrossRef]
  37. Duan, Z.; Liang, J. Non-contact detection of vital signs using a UWB radar sensor. IEEE Access 2019, 7, 36888–36895. [Google Scholar] [CrossRef]
  38. Nguyen, V.; Weitnauer, A.M.A. Denoised maximum likelihood estimation of chest wall displacement from the IR-UWB spectrum. IEEE Access 2018, 6, 15249–15258. [Google Scholar] [CrossRef]
  39. Yin, W.; Yang, X.; Zhang, L.; Oki, E. ECG monitoring system integrated with IR-UWB radar based on CNN. IEEE Access 2016, 4, 6344–6351. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Metal lane detection system model using impulse radio ultra-wideband (IR-UWB) radar.
Figure 1. Metal lane detection system model using impulse radio ultra-wideband (IR-UWB) radar.
Sensors 20 00324 g001
Figure 2. Lane detection method. LDWS: lane departure warning system.
Figure 2. Lane detection method. LDWS: lane departure warning system.
Sensors 20 00324 g002
Figure 3. Distance from radar to lane in the x, y plane: (a) parameters required for calculation; (b) example at minimum; and (c) example at maximum.
Figure 3. Distance from radar to lane in the x, y plane: (a) parameters required for calculation; (b) example at minimum; and (c) example at maximum.
Sensors 20 00324 g003
Figure 4. Reflected signal energy according to vehicle and metal lane location.
Figure 4. Reflected signal energy according to vehicle and metal lane location.
Sensors 20 00324 g004
Figure 5. Lane detection field experiment environment.
Figure 5. Lane detection field experiment environment.
Sensors 20 00324 g005
Figure 6. Experiment scenarios.
Figure 6. Experiment scenarios.
Sensors 20 00324 g006
Figure 7. Energy detector output histogram: (a) Scenario 1; (b) Scenario 2; and (c) Scenario 3.
Figure 7. Energy detector output histogram: (a) Scenario 1; (b) Scenario 2; and (c) Scenario 3.
Sensors 20 00324 g007
Figure 8. Energy detector output and IR-UWB signal for Scenario 1.
Figure 8. Energy detector output and IR-UWB signal for Scenario 1.
Sensors 20 00324 g008
Figure 9. Energy detector output and IR-UWB signal for Scenario 2.
Figure 9. Energy detector output and IR-UWB signal for Scenario 2.
Sensors 20 00324 g009
Figure 10. Energy detector output for Scenario 3.
Figure 10. Energy detector output for Scenario 3.
Sensors 20 00324 g010
Figure 11. Energy detector output for Scenario 4.
Figure 11. Energy detector output for Scenario 4.
Sensors 20 00324 g011
Figure 12. Manhole measurement environment.
Figure 12. Manhole measurement environment.
Sensors 20 00324 g012
Figure 13. Energy detector output and IR-UWB signal for round manhole.
Figure 13. Energy detector output and IR-UWB signal for round manhole.
Sensors 20 00324 g013
Figure 14. Energy detector output and IR-UWB signal for square manhole.
Figure 14. Energy detector output and IR-UWB signal for square manhole.
Sensors 20 00324 g014
Table 1. Metal lane spacing estimation for Scenario 2.
Table 1. Metal lane spacing estimation for Scenario 2.
Metal Lane Numbers1–22–33–44–5
Travel Time (s)1.110.951.1
Vehicle Speed (m/s)7.227.788.337.5
Estimated Lane Spacing (m)7.947.787.918.25
Table 2. Metal lane spacing estimation for Scenario 3.
Table 2. Metal lane spacing estimation for Scenario 3.
Metal Lane Numbers1–22–33–44–5
Travel Time (s)1.41.11.41.35
Vehicle Speed (m/s)5.836.395.835.83
Estimated Lane Spacing (m)8.167.038.167.87
Table 3. Metal lane spacing estimation for Scenario 4.
Table 3. Metal lane spacing estimation for Scenario 4.
Metal Lane Numbers1–22–33–44–5
Travel Time (s)1.3111.15
Vehicle Speed (m/s)7.227.787.787.5
Estimated Lane Spacing (m)9.397.787.788.63

Share and Cite

MDPI and ACS Style

Kim, D.-H. Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors. Sensors 2020, 20, 324. https://doi.org/10.3390/s20010324

AMA Style

Kim D-H. Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors. Sensors. 2020; 20(1):324. https://doi.org/10.3390/s20010324

Chicago/Turabian Style

Kim, Dae-Hyun. 2020. "Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors" Sensors 20, no. 1: 324. https://doi.org/10.3390/s20010324

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop