Reallusion combines Vicon technology with industry-standard timecode support in iClone.
Reallusion announces its official partnership with Vicon, enabling direct motion capture support for iClone. For the first time, Vicon systems can seamlessly connect with Motion LIVE, offering full integration of real-time, high-fidelity body capture, along with facial and hand mocap, all within one unified platform. Jeff Sheetz, founder of Monkey Chow Animation Studio, shares his experience with this powerful iClone-Vicon suite, which he believes delivers studio-quality results faster than ever before.
Jeff Scheetz, Motion Capture Orlando
Since leaving his role as co-founder of The Digital Animation & Visual Effect (DAVE) School, Jeff Scheetz, alongside his wife Anne, has been running Monkey Chow Animation Studio in Orlando, Florida. In 2021, they expanded into motion capture with the launch of Motion Capture Orlando, serving the theme park industry. Their work can be seen at Universal Studios and Walt Disney World, and they’ve also produced various motion capture packs for iClone and ActorCore, such as Run for Your Life, Bank Heist, and Avenging Warriors. Jeff’s team also collaborated with Actor Capture on the Netflix movie The Electric State. Key team members include senior mocap technicians Kaszmere Messbarger and Nelson Escobar.
iClone and Vicon—The New Dynamic Duo
One of the most exciting aspects of Jeff’s relationship with Reallusion is getting to test out cutting-edge technology before it’s officially released. When he was informed that iClone would soon support Vicon integration and timecode synchronization, it was a game-changer. Motion Capture Orlando has been using Vicon’s cameras and software since they started investing in mocap gear, but they were unable to integrate Vicon data directly into Motion LIVE until now.
This breakthrough is especially significant for Jeff, as the previous workflow involved streaming Vicon data into Motion Builder for retargeting, and then moving that data into Unreal Engine. The integration of facial data, hand motion (via data gloves), and the inherent latency in this multi-step process presented challenges. Now, with iClone’s Motion LIVE, Vicon streams directly into iClone, allowing for seamless integration of face, body, and hand all within the platform. This streamlined approach reduces complexity, making it easier to execute live shows and set up production workflows.
Record, Edit, and Render Previz in iClone
When it comes to previz, speed and cost-effectiveness are essential. Traditional mocap workflows can be time-consuming due to the necessary exports and imports between different software tools. However, by recording directly into iClone, you can immediately start blocking shots, working out camera moves, and rendering previews. Jeff’s team recorded a few assassin chase scenes on their stage, using Motion LIVE to capture data, and the resulting iProject files served as the foundation for their productions.
The quality of the capture was impressive due to starting with Vicon data. This allowed them to present high-quality previz to a director quickly. The renders included vital data on the edges, such as version info, lens used, and notes for feedback, helping the team stay organized throughout the process.
From Previz to Polished Video: Cleaning and Syncing with Timecode
After capturing mocap for the previz, the team performed proper data cleaning using Shogun Post (Vicon’s mocap cleaning software), and motion edits were carried out in iClone. They identified the best takes—approximately 20% of what was shot—and cleaned only those pieces. One major challenge was syncing the cleaned data, but the introduction of timecode has made this process much easier.
Using the new Timecode Plugin, Jeff could instantly sync the cleaned motion data with the original timeline. By dropping the new motion (as an FBX) onto their character and selecting “Align Clip to Embedded Timecode”, iClone automatically aligned it with the original recording. This feature works not only for motion data but also for facial capture, hand data, audio, and video.
Seamless Mocap Sync with Live Action
This seamless integration was especially useful when creating a sitcom scene for Life with Bob! in which a live actress performed against a CGI character. Mocap actors, placed just out of frame, could improvise and interact with the CGI character.
The use of a Tentacle Sync device transmitted timecode across all systems: Vicon, the Live Face app, the video camera, and sound recording devices. This made it incredibly easy to sync everything once the master shot was completed.
Reshooting and Updating with Motion LIVE
One of Jeff’s favorite features of this new workflow is the ability to quickly make adjustments, such as reshooting facial animation without the need for a full reshoot. Using his iPhone, he could capture just the parts that needed improvement, like the lips, while leaving other aspects of the face intact. The flexibility to isolate and reshoot specific elements is a major time-saver and enhances the overall efficiency of the production process.
The New Workflow: Speed, Efficiency, and Creativity
For creators using Reallusion products, the integration of Vicon with iClone opens up new possibilities for creating high-quality animated content in a fraction of the time previously required. For a more detailed insight into the workflow, please find the full article here. The new workflow allows for fast, professional results with minimal overhead. With the addition of the Timecode plugin, keeping everything aligned and organized is simple. Motion LIVE, combined with Vicon’s mocap system, empowers creators to focus on what matters most: creativity and storytelling. And after all, that’s why many of us got into animation in the first place.
Brought to you by Reallusion:
This article is part of the befores & afters VFX Insight series. If you’d like to promote your VFX/animation/CG tech or service, you can find out more about the VFX Insight series here.
