The primary purpose of this paper was to propose a way to alert sleepy drivers in the act of driving. Most of the traditional methods to detect drowsiness are based on behavioral aspects while some are intrusive and may distract drivers, while some require expensive sensors/hardware. Therefore, in this paper, driver’s drowsiness detection system is developed and implemented to aid drowsy drivers from falling asleep and to prevent accidents. The system takes images from the device as input. Using these image templates, the trained model starts execution and predicts/classifies whether the face of the person in the image is drowsy or alert. The proposed model is able to achieve accuracy of 99.93% using CNN on trained image dataset.