2023-03-27 18:40:39 -07:00
2023-03-26 22:46:45 -04:00
2023-03-26 22:46:45 -04:00
2023-03-27 18:40:39 -07:00
2023-03-26 22:46:45 -04:00
2023-03-25 12:22:22 -07:00
2023-03-26 18:45:40 -04:00

ProjectBabble

A Mouth tracking system for VR, 100% Opensource!

Currently the architecture is a modified mobilenetv3-large training on blenshapes from ARKit! The model outputs 33 blenshapes of which most cross over with SRanipals blendshapes.

A few things to note

  1. The current version of the model may not work for your mouth as it has been trained on a not very diverse dataset. Expect this to change in newer versions.
  2. Not all blendshapes may work as there isnt enough data collected in the dataset.
  3. This model is not a 1 to 1 translation to SRanipal blenshapes. While most blendshapes do cross over with SRanipal cheek and tounge movements are limited.

Warranty

Lol

Credit

Thank you to dfgHiatus#7426 for providing the unity demo as well as the intergrations with other apps!

Thank you to Rames The Generic#3540 who made the dataset, tested and evaluated the performence for the models, and for being awesome!

Copyright (c) 2022 Sameer Suri

Languages
Python 99%
Shell 0.6%
Inno Setup 0.3%