Inserting Rendered 3D Objects

< Previous | Contents | Manuals Home | Boris FX | Next >

‌Inserting Rendered 3D Objects

With the 3D camera path and position information, you can insert 3D rendered objects into your footage. SynthEyes provides the workflow to be able to do that using ordinary 3D applications, without requiring them to support 360 VR directly. The overall process is similar to that for handling lens distortion.

Note : See the next section if your app has an equirectangular panoramic camera or an equivalent 360VR rendering rig (for example as AfterEffects + Cinema 4D). That should frequently be the case, and the procedure described in this section irrelevant.

Repeat the following process to render each mesh you want to insert in your 3D application:

 Place an imported, created, or bounding-box proxy 3D mesh into the (SynthEyes) scene.

 Position the mesh accurately in the 3D environment, using the 3D trackers as references (Parent it to an animated moving object if needed.)

 Make a copy of the scene file. Or, use Shot/Add shot to add another copy of the original shot, then with the new camera active, select the original camera, and run Copy Stabilization to make the additional shot the same as the original.

 Use the Follow Mesh script to change the shot to a conventional linear version that tightly watches the mesh.

 (Optional) Run the Create Spherical Screen script if you want the background imagery available in your 3D app.

 Export the scene to your 3D app using an appropriate SynthEyes exporter.

 Import the exported scene in your 3D app.

 Use the desired full 3D mesh in your 3D app, shade it, animate it, etc, as needed.

 Render the shot in your 3D app over black with an alpha channel. Do NOT include a flat or spherical screen in the render! Notice that you can use any conventional 3D app; it does not have to have any 360 VR capabilities.

 Back in SynthEyes, use Shot/Change Shot Images with the Re-distort CGU--- switch to Apply mode setting. Select your rendered imagery. The resulting images could be composited over the original unstabilized plates.

 To obtain a world-stabilized version, run the Unfollow Mesh script, which restores the camera path and stabilizer to produce world-stabilized images.

 If you earlier ran the Align Camera to Path script on the main footage, run it again now with the same settings so that the insert matches.

 Use Save Sequence to store the 360 VR version of the rendered shot.

 Use your favorite compositing application to composite the stabilized 360 VR shot with the 360 VR renders of the meshes to be inserted. These are just 2D images, so no 360 VR capabilities are required in the compositing application.

Overall, working with 360 VR footage involves quite a few steps! They'll make more sense as you see them in tutorials and work through them yourself.

Using External 360 VR Cameras

< Previous | Contents | Manuals Home | Boris FX | Next >