Research on Facial Fatigue Detection of Drivers with Multi-feature Fusion
Author:
Affiliation:

1. School of Electronic and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044;
2. School of Artificial Intelligence (School of Future Technology), Nanjing University of Information Science and Technology, Nanjing 210044)

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    In order to solve the shortcomings of current fatigue detection methods such as low accuracy or poor real-time performance, a fatigue detection method based on multi-feature fusion is proposed. Firstly, the HOG face de-tection algorithm and KCF target tracking algorithm are integrated and deformable convolutional neural network is introduced to identify the state of extracted eyes and mouth, fast track the detected faces and extract con-tinuous and stable target faces for more efficient extraction. Then the head pose algorithm is introduced to detect the driver's head in real time and obtain the driver's head state information. Finally, a multi-feature fusion fatigue detection method is proposed based on the state of the eyes, mouth and head. According to the experimental results, the proposed method can detect the driver's fatigue state in real time with high accuracy and good ro-bustness compared with the current fatigue detection algorithms.

    Reference
    Related
    Cited by
Get Citation

YE Yuxuan, ZHOU Xianchun, WANG Wenyan, YANG Chuanbin, ZOU Qingyu.[J]. Instrumentation,2023,(1):23-31

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: October 20,2023
  • Published:
License
  • Copyright (c) 2023 by the authors. This work is licensed under a Creative
  • Creative Commons Attribution-ShareAlike 4.0 International License.