mirror of
https://github.com/Project-Babble/ProjectBabble.git
synced 2026-11-20 09:01:16 -08:00
30fbe5d810309a3a1380451cd3e7a7d65ee8dd2e
Moved shape blacklists and defines into a class Made a class for the functions that select shapes. Added Function that returns a list of available shapes after selecting a class example.
ProjectBabble
A Mouth tracking system for VR, 100% Opensource!
Currently the architecture is a modified mobilenetv3-large training on blenshapes from ARKit! The model outputs 33 blenshapes of which most cross over with SRanipals blendshapes.
A few things to note
- The current version of the model may not work for your mouth as it has been trained on a not very diverse dataset. Expect this to change in newer versions.
- Not all blendshapes may work as there isnt enough data collected in the dataset.
- This model is not a 1 to 1 translation to SRanipal blenshapes. While most blendshapes do cross over with SRanipal cheek and tounge movements are limited.
Warranty
Lol
Credit
Thank you to dfgHiatus#7426 for providing the unity demo as well as the intergrations with other apps!
Thank you to Rames The Generic#3540 who made the dataset, tested and evaluated the performence for the models, and for being awesome!
Copyright (c) 2022 Sameer Suri
Languages
Python
99%
Shell
0.6%
Inno Setup
0.3%