Low-Cost Driver Monitoring System Using Deep Learning

Abstract

Driver monitoring systems are becoming an essential part of Advanced Driver Assistance Systems (ADAS) safety features in modern vehicles. The U.S. National Highway Traffic Safety Administration reports that drowsy/fatigued driving results in almost 100,000 road accidents per year. Driver's fatigue can have different causes, such as lack of sleep, long journeys, restlessness, mental pressure and alcohol consumption. Early monitoring systems relied on data from vehicle sensors, and modern systems commonly use driver's eye tracking. Recently, there has been growing interest in utilizing machine vision and deep learning for driver monitoring. Using machine vision can create more advanced driver monitoring systems capable of detecting driver attention state as well as other features like smartphone usage while driving and seat belts. Machine vision systems usually require extensive processing power, which raises the cost of such systems. In this paper, we present a low-cost driver monitoring system using a 15 Raspberry Pi Zero 2 W board and deep learning CNN to deliver a system capable of monitoring and identifying different states of the driver like safe driving, distracted, drowsy, and smartphone usage, the system achieves an inference rate for 10 Frames Per Second (FPS) and above 90% accuracy with the testing dataset. In addition to the deep learning CNN which runs on Raspberry Pi CPU, we utilize the Raspberry Pi GPU to run a head pose estimation algorithm to boost the system's accuracy.