Lip reading

1 January, 2019

tech

Edit this page

Tired of typing on a phone with my fat fingers. Wondering if the front facing camera can just do lip reading.

Here are some resources:

Lip reading machine learning

• https://github.com/rizkiarm/LipNet
• https://github.com/deepconvolution/LipNet
• https://boingboing.net/2016/11/28/lipnet-lip-reading-ai-uses-ma.html
• https://github.com/astorfi/lip-reading-deeplearning

Android keyboard & camera

• https://stackoverflow.com/questions/9577304/how-to-make-an-android-custom-keyboard
• https://developer.android.com/guide/topics/media/camera
• https://developer.android.com/reference/android/inputmethodservice/Keyboard

Could try and do subvocalization or more crazy brain stuff

• https://dam-prod.media.mit.edu/x/2018/03/23/p43-kapur_BRjFwE6.pdf
• https://resnet.microsoft.com/video/42992