Blender facial animation tool. What else should it do?

Artists cheer, then cry: make it webcam-ready and record takes

TLDR: A new Blender add-on streams iPhone face tracking to 3D characters in real time. The community loves the magic but clashes over iPhone-only limits, loudly asking for webcam support and built-in recording of takes—plus wild “mudface map” ideas and a nod to [FaceIt] as an alternative.

Blender just got a new party trick: an add‑on that lets your iPhone’s Live Link Face app stream your facial expressions straight onto a 3D character, in real time. It taps Apple’s ARKit with 52 standard “shape keys” (think sliders for brow raises, blinks, smiles), supports a handy HUD preview, and plays nice with “Perfect Sync” rigs—though it’s not compatible with Metahuman. It’s GPL‑licensed, tested on Blender 4.5, and aims to make artists grin as their models grin back. But the comments instantly turned it into a showdown: iPhone‑only? Cue the webcam‑or‑bust crowd storming in.

Top request: “record and manage takes” right inside Blender, so creators can nail a performance and retake like a director. Others waved the “no iPhone, no fun” flag, begging for a webcam pipeline and local face‑tracking. One dreamer proposed a punk‑rock “DIY mudface map”—a black‑and‑white wrinkle capture to drive expressions with Blender trackers. Meanwhile, a helpful throwback linked to FaceIt, an older tool for ARKit rigs, fueling a mini sequel: FaceIt vs Face‑it‑off. Jokes flew about “bring your own wrinkles,” while the bigger debate raged: Apple wall vs open cam crowd—and everyone wants it to record takes. Dev says feedback is very welcome.

Key Points

  • Blender add-on streams iPhone Live Link Face ARKit data to Blender Shape Keys with real-time preview.
  • Uses Apple ARKit’s standard 52 Shape Key names and supports Perfect Sync models.
  • Developed and tested with Blender 4.5; not compatible with Metahuman protocol.
  • Setup requires entering the PC’s local IP, using port 11111, and enabling the add-on panel.
  • Troubleshooting covers network configuration, reducing latency, and resolving Shape Key name mismatches.

Hottest takes

"Being able to record and manage takes directly in Blender would be an awesome feature" — embedding-shape
"using a webcam + local model for detection as input would be awesome" — s1mplicissimus
"I would love a DIY mudface map that’s a b/w displacement map so you can capture the wrinkles of the face" — reactordev
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.