"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

July 08, 2021

Computer Vision Lip Reading - Use Case Analysis

Paper #1 - Computer Vision Lip Reading

Key Notes

  • Extract Face, Extract Lips / Mouth area
  • Depth map with an MS Kinect sensor
  • Dlib based face landmarks
  • Deep network trained for numbers detection

Paper #2 - Deep Learning for Lip Reading using Audio-Visual Information for Urdu Language

Key Notes

  • A sequence of T frames is used as input, and is processed by 3 layers of STCNN, each followed by a spatial max-pooling layer
  • Explore as words, Digits

Lip Reading Datasets

Lipreading Demo by Convolutional Neural Network, Link2

More Reads

  • HLR-Net: A Hybrid Lip-Reading Model Based on Deep Convolutional Neural Networks
  • Automatic Lip-Reading System Based on Deep Convolutional Neural Network and Attention-Based Long Short-Term Memory

Keep Thinking!!!

No comments: