iPhone X Face Motion Capture into Houdini
We’re starting to see experiments utilizing depth and face tech from the iPhone X - here is Elisha Hung is taking data captured with the iPhone and placing it into 3D renderings:
Using iPhone X's TrueDepth Camera and Xcode ARKit to fetch data and write into a custom file.
On the Houdini side, create a Python SOP to import custom file and parse it to what it should be.
Using iPhone X's TrueDepth Camera and Xcode ARKit to fetch face geometry and vertex animation, then write into a custom file.
On the Houdini side, create a Python SOP to import custom file and parse it to animation.
Also worth keeping an eye on is Brad Dwyer’s Twitter account, how has 3D printed his face data,
Elisha Hung has shared the code to Github for this project here, with an accompanying blog post [in Chinese] here.
Also, Jimmy Gunawan has been sharing on YouTube tutorials and results using the code with 3D software package Blender:
Requirements for this setup: 1. Blender 3D or other 3D software. 2. iPhone X with 3D true depth camera 3. MacBookPro (XCode app) 4. Animation Nodes and Sverchok Add-On In this episode, I am using Elisha Hung XCode iPhone App Project to basically capture facial animation using the iPhone and bring the data into Blender for further processing and render. I am still working on the complete data parser, all can be done using Python, I am currently using Animation Nodes to parse the data, and Sverchok to do the rest of data combination.
