Lane detection algorithms play a key role in Advanced Driver Assistance Systems (ADAS), which are however unable to achieve accurate lane recognition in low-light environments. This paper presents a novel deep network structure, namely LLSS-Net (low-light images semantic segmentation), to achieve accurate lane detection in low-light environments. The method integrates a convolutional neural network for low-light image enhancement and a semantic segmentation network for lane detection. The image quality is firstly improved by a low-light image enhancement network and lane features are then extracted using semantic segmentation. Fast lane clustering is finally performed by using the KD tree models. Cityscapes and Tusimple datasets are utilized to demonstrate the robustness of the proposed method. The experimental results show that the proposed method has an excellent performance for lane detection in low-light roads.
YiCZhangKPengN. A multi-sensor fusion and object tracking algorithm for self-driving vehicles. Proc IMechE, Part D: J Automobile Engineering2019; 233(9): 2293–2300.
2.
VangiDVirgaAGulinoM S. Adaptive intervention logic for automated driving systems based on injury risk minimization. Proc IMechE, Part D: J Automobile Engineering2020; 234(13): 2975–2987.
3.
HuJLiuWKangJ, et al. Semi-cascade network for driver’s distraction recognition. Proc IMechE, Part D: J Automobile Engineering2019; 233(9): 2323–2332.
4.
YooHYangUSohnK. Gradient-enhancing conversion for illumination-robust lane detection. IEEE Trans Intell Transp Syst2013; 14(3): 1083–1094.
5.
ManoharanKDanielP. Image processing-based framework for continuous lane recognition in mountainous roads for driver assistance system. J Electron Imaging2017; 26(6): 063011.
6.
PiaoJShinH. Robust hypothesis generation method using binary blob analysis for multi-lane detection. IET Image Process2017; 11(12): 1210–1218.
7.
DuXTanKK. Vision-based approach towards lane line detection and vehicle localization. Mach Vis Appl2016; 27(2): 175–191.
8.
ByambaaDJinLD. A precise lane detection algorithm based on top view image transformation and least-square approaches. J Sens2016; 2016: 1–13.
9.
OzgunalpU. Robust lane-detection algorithm based on improved symmetrical local threshold for feature extraction and inverse perspective mapping. IET Image Process2019; 13(6): 975–982.
10.
GuptaAChoudharyA. A framework for camera-based real-time lane and road surface marking detection and recognition. IEEE Trans Intell Veh2018, 3: 476–485.
11.
DingYXuZZhangY, et al. Fast lane detection based on bird’s eye view and improved random sample consensus algorithm. Multimed Tools Appl2017; 76(21): 22979–22998.
12.
WangHFWangYFZhaoXM, et al. Lane detection of curving road for structural highway with straight-curve model on vision. IEEE Trans Veh Technol2019; 68(6): 5321–5330.
13.
YiSCChenYCChangCH. A lane detection approach based on intelligent vision. Comput Electr Eng2015; 42: 23–29.
14.
ZhangKZuoWMZhangL. FFDNet: toward a fast and flexible solution for CNN based image denoising. IEEE Trans Image Process2018; 27(9): 4608–4622.
15.
EveringhamMGoolLVWilliamsCKI, et al. The pascal visual object classes (VOC) challenge. Int J Comput Vis2010; 88(2): 303–338.
16.
LongJShelhamerEDarrellT. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell2015; 39(4): 640–651.
17.
BadrinarayananVKendallACipollaR. SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell2017; 39(12): 2481–2495.
18.
ChenLCPapandreouGKokkinosI, et al. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell2018; 40(4): 834–848.
19.
ZouQJiangHDaiQ, et al. Robust lane detection from continuous driving scenes using deep neural networks. IEEE Trans Veh Technol2020; 69(1): 41–54.
20.
TianYGelernterJWangX, et al. Lane marking detection via deep convolutional neural network. Neurocomputing2018; 280: 46–55.
21.
YangYYXiaoLHHouJC. Lane detection method based on lane structural analysis and CNNs. IET Intell Transp Syst2018; 12(6): 513–520.
22.
MinhHTRaeBNWoonCS, et al. Road lane detection robust to shadows based on a fuzzy system using a visible light camera sensor. Sensors2017; 17(11): 2475.
23.
GuJCZhangQSKamataS. Robust road lane detection using extremal-region enhancement. In: 3rd IAPR Asian conference on pattern recognition (ACPR), Kuala Lumpur, Malaysia, 3–6 November 2015. IEEE.
24.
MaCMaoLZhangYF, et al. Lane detection using heuristic search methods based on color clustering. In: International conference on communications, circuits and systems (ICCCAS), Chengdu, China, 1 July 2010.
25.
BaoZCJiangQXLiuFZ. Multiple model efficient particle filter based track-before-detect for maneuvering weak targets. J Syst Eng Electron2020; 31(4): 647–656.
26.
FortinBLherbierRNoyerJC. A model-based joint detection and tracking approach for multi-vehicle tracking with lidar sensor. IEEE Trans Intell Transp Syst2015; 16(4): 1883–1895.
27.
MeloJNaftelABernardinoA, et al. Detection and classification of highway lanes using vehicle motion trajectories. IEEE Trans Intell Transp Syst2006; 7(2): 188–200.
28.
LooseHFrankeUStillerC. Kalman particle filter for lane recognition on rural roads. In: IEEE intelligent vehicles symposium, Xian, China, 3–5 June 2009.
29.
GopalanRHongTShneierM, et al. A learning approach towards detection and tracking of lane markings. IEEE Trans Intell Transp Syst2012; 13(3): 1088–1098.
30.
DasSKaleAVaswaniN. Particle filter with a mode tracker for visual tracking across illumination changes. IEEE Trans Image Process2012; 21(4): 2340–2346.
31.
SongDJLiuWZhouTY, et al. Efficient robust conditional random fields. IEEE Trans Image Process2015; 24(10): 3124–3136.
32.
HurJKangSNSeoSW. Multi-lane detection in urban driving environments using conditional random fields. In: IEEE intelligent vehicles symposium, Gold Coast, Australia, 23–26 June 2013.
33.
HuJXiongSZhaJ, et al. Lane detection and trajectory tracking control of autonomous vehicle based on model predictive control. Int J Automot Technol2020; 21(2): 285–295.
34.
GhafoorianMNugterenCBakaN, et al. EL-GAN: embedding loss driven generative adversarial networks for lane detection. In: 15th European conference on computer vision (ECCV), Munich, Germany, 8–14 September 2018.
35.
HouYNMaZLiuCX, et al. Learning lightweight lane detection CNNS by self attention distillation. In: 2019 IEEE/CVF international conference on computer vision (ICCV), Seoul, Korea, 27 October–2 November 2019.
36.
LiJMeiXProkhorovD, et al. Deep neural network for structural prediction and lane detection in traffic scene. IEEE Trans Neural Netw Learn Syst2017; 28(3): 690–703.
37.
LohYPChanCS. Getting to know low-light images with the exclusively dark dataset. Comput Vis Image Underst2019; 178: 30–42.
38.
LohYPLiangXFChanCS. Low-light image enhancement using Gaussian Process for features retrieval. Signal Process Image Commun2019; 74: 175–190.
39.
LoreKGAkintayoASarkarS. LLnet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recognit2017; 61: 650–662.
40.
ChenLCZhuYPapandreouG, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation. In: FerrariVHebertMSminchisescuC, et al. (eds) Computer vision – ECCV. Cham: Springer, 2018, pp.833–851.
41.
CholletF. Xception: deep learning with depthwise separable convolutions. In: 30th IEEE/CVF conference on computer vision and pattern recognition (CVPR), Honolulu, HI, 21–26 July 2017.
42.
CordtsMOmranMRamosS, et al. The cityscapes dataset for semantic urban scene understanding. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), Seattle, WA, 27–30 June 2016.
JobsonDJRahmanZUWoodellGA. A multiscale Retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process1997; 6(7): 965–976.
45.
JiangXSYaoHXZhangSP, et al. Night video enhancement using improved dark channel prior. In: 2013 IEEE international conference on image processing, Melbourne, VIC, Australia, 15–18 September 2013.
46.
PaszkeAChaurasiaAKimS, et al. ENet: a deep neural network architecture for real-time semantic segmentation. arXiv:1802.02611v3 [cs.CV], 2018, https://arxiv.org/abs/1606.02147 (accessed 12 October 2020)
47.
DavyNBertDBStamatiosG, et al. Towards end-to-end lane detection: an instance segmentation approach. In: 2018 IEEE intelligent vehicles symposium (IV), Changshu, China, 26–30 June 2018.
48.
NiuJWLuJXuML, et al. Robust lane detection using two-stage feature extraction with curve fitting. Pattern Recognit2016; 59: 225–233.
49.
JiaoXYYangDGJiangK, et al. Real-time lane detection and tracking for autonomous vehicle applications. Proc IMechE, Part D: J Automobile Engineering2019; 233(9): 2301–2311.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
