liang444366454
Really an amazing job !!!!!!!!!!!! Thanks fabriciochamon
Thanks, I'm glad you found it useful!
liang444366454
Really an amazing job !!!!!!!!!!!! Thanks fabriciochamon
It was a bit of a struggle to record the motion capture and playing back live the body animation, so that body and hands match time wise
luisguggenberger
Yes it's certainly a good feature to have, been able to still use the mouse. When others in my studio tested it, they felt it was a bit unintuitive, that the webcam image doesn't behave like a mirror. When one hand accidentally got out of frame they moved the wrong hand first to bring it back into frame. (hope that discription makes sense)
If it would be me, I would probably have either two toggles (flip image/flip hands) or have the mirrored image as the default without actually mirroring the hands.
That said it's an easy fix inside Houdini for anyone who wants a different behavior.
I made a first test today adding finger motion to a body mocap and it worked out pretty good! It still needs cleanup for final animation but for previs it does a great job. It was a bit of a struggle to record the motion capture and playing back live the body animation, so that body and hands match time wise. I don't quite understand the "Time Dependant" toggle on Mocap Stream. It helps in terms of performance when the real time toggle is switched on, but for some reason I had to timeshift to get the finger animation into place.
luisguggenberger
One thing I realized using "Flip image" in VML Streamer it also flips the hand assignment. So when flipped I'm controlling the right hand using my left hand. It's an easy fix in houdini obviously, just realized this behavior changed from the previous version and was wondering if it was intentional.
olivettyfabriciochamon
Another update being pushed soon:
Android Sensors
Another great update and the UI is starting to look really nice as well! Are you fore-seeing this becoming like a poor-mans virtual camera in the future if we can get more sensors in there? Like what Unreal Live Link is doing with iPhones to make the phone the camera so to speak.
Nevertheless, looks great and good luck with the rest of implementation. Following this thread with great interest!
luisguggenberger
Hi guys,
found out about this tool yesterday and installed it straight away. It works like a charm. Amazing work Fabricio! I was trying to retarget the hand mocap points to a kinefx rig and had medium success with it. I have difficulties keeping the orientations stable. Has anyone tried this yet? I will post my progress next week.
All the best,
Luis
olivetty
Camo Studio
olivetty
This is absolutely amazing, I have been searching for so long for something like this. Today, again, I thought I would give it a go and after 7h by the computer, looking at maybe doing some crazy hack between 3 different repos to get this working at all I found your thread! Is there anywhere I can donate or anything to keep this project alive? I don't have much money but I will throw whatever I can at this because it is essential to get these tools in artists hands for even better and more streamlined workflows + your interface and implementation is just amazing!
I am about to test the alpha right now, so cool to see this and again - THANK YOU!!!
You say Mediapipe doesn't do inference with GPU on windows, how come? I think I've seen other projects using GPU on Windows? :O
EDIT: I can't seem to find where the HDAs shown in the videos are? I've got VML Streamer up and running!
EDIT2: I tried this video just for testing and downscaled it to 540x960 and tried running that. It played fine in the Streamer but then when choosing face or body didn't give anything and choosing hands crashed Streamer! I will try with webcam tomorrow instead, also if I can find the HDAs!
EDIT3: I found the other thread were the HDAs are available. I will test it out!
EDIT4: Sorry for all the edits BUT! I have installed it but there are two problems. My main webcam shows up as interlaced, extremely stretched and is mirrored on top of itself. I did overcome this with doing a OBS Virtual Camera instead, but the aspect ratio is wrong. NEXT when selecting anything in the TYPE nothing happens on the video in VML Streamer. I can see no MediaPipe overlay or anything like that in your demos. Houdini gives generic Python error when laying down a Mocap Stream and then a VideoCapture.
VML shows MT: 142.0 CV: 60.0 and I'm streaming in 720p.
Great potential in this - so amazing and I am so happy if I can get this to work!
-
Oliver