mirror of
https://github.com/Project-Babble/ProjectBabble.git
synced 2026-11-20 09:01:16 -08:00
c048399d57fa51b5bdf677a129e26730d1053d4c
ProjectBabble
A Mouth tracking system for VR, 100% Opensource!
Currently the architecture is a modified mobilenetv3-large training on blenshapes from ARKit! The model outputs 33 blenshapes of which most cross over with SRanipals blendshapes.
A few things to note
- The current version of the model may not work for your mouth as it has been trained on a not very diverse dataset. Expect this to change in newer versions.
- Not all blendshapes may work as there isnt enough data collected in the dataset.
- This model is not a 1 to 1 translation to SRanipal blenshapes. While most blendshapes do cross over with SRanipal cheek and tounge movements are limited.
Warranty
Lol
Credit
Thank you to dfgHiatus#7426 for providing the unity demo as well as the intergrations with other apps!
Thank you to Rames The Generic#3540 who made the dataset, tested and evaluated the performence for the models, and for being awesome!
Copyright (c) 2022 Sameer Suri
Languages
Python
99%
Shell
0.6%
Inno Setup
0.3%