This is absolutely amazing, I have been searching for so long for something like this. Today, again, I thought I would give it a go and after 7h by the computer, looking at maybe doing some crazy hack between 3 different repos to get this working at all I found your thread! Is there anywhere I can donate or anything to keep this project alive? I don't have much money but I will throw whatever I can at this because it is essential to get these tools in artists hands for even better and more streamlined workflows + your interface and implementation is just amazing!
I am about to test the alpha right now, so cool to see this and again - THANK YOU!!!
You say Mediapipe doesn't do inference with GPU on windows, how come? I think I've seen other projects using GPU on Windows? :O
EDIT: I can't seem to find where the HDAs shown in the videos are? I've got VML Streamer up and running!
EDIT2: I tried this video just for testing (
https://www.pexels.com/video/a-woman-dancing-at-home-6003986/ [
www.pexels.com] ) and downscaled it to 540x960 and tried running that. It played fine in the Streamer but then when choosing face or body didn't give anything and choosing hands crashed Streamer! I will try with webcam tomorrow instead, also if I can find the HDAs!
EDIT3: I found the other thread were the HDAs are available. I will test it out!
EDIT4: Sorry for all the edits BUT! I have installed it but there are two problems. My main webcam shows up as interlaced, extremely stretched and is mirrored on top of itself. I did overcome this with doing a OBS Virtual Camera instead, but the aspect ratio is wrong. NEXT when selecting anything in the TYPE nothing happens on the video in VML Streamer. I can see no MediaPipe overlay or anything like that in your demos. Houdini gives generic Python error when laying down a Mocap Stream and then a VideoCapture.
VML shows MT: 142.0 CV: 60.0 and I'm streaming in 720p.
Great potential in this - so amazing and I am so happy if I can get this to work!
-
Oliver