360 Degree Virtual Reality Tracking

< Previous | Contents | Manuals Home | Boris FX | Next >

‌360 Degree Virtual Reality Tracking ‌

SynthEyes can help stabilize and add 3D effects to 360 degree spherical virtual reality (VR) footage. SynthEyes helps you work with 360 VR shots even if your 3D app has no 360 VR capabilities at all.

Some other buzzwords that describe this type of footage: equirectangular, 360x180, or even plate carrée. The defining feature is that a single frame shows the view in all directions according to a latitude/longitude scheme; viewing software/devices typically extract a portion of the image as a conventional camera image in the desired direction to show the user.

Important! 360VR equirectangular images should always have an image aspect ratio of exactly 2.0 and a pixel aspect ratio of exactly 1.0, ie their horizontal resolution should be twice their vertical resolution. Violations will probably result in subtle issues in SynthEyes and other applications. Use proper sizes: 4K is either 3840 or 4096, not 4000 (which can cause mp4 codecs to fail).

When you work with 360 VR images, you don't have to be concerned about determining distortion, field of view, or plate/sensor sizes, which is definitely convenient!

Note that SynthEyes does not perform stitching, ie removing distortion and combining multiple images to initially create a 360 VR image. That is handled by specialized applications.

You tell SynthEyes that an incoming shot is 360 VR using that setting on the SynthEyes Shot Setup panel: None or Present, plus the further option of Remove!

We'll start the discussion by describing how to do a simple stabilization to 360 VR shots, if you will not be doing 3D effects.

ATTENTION ! If this is the first part of the SynthEyes manual that you are reading, you'll need to eventually read quite a bit more of it! Working with 360 VR footage requires a wide variety of techniques from throughout SynthEyes: the image preprocessor, automatic and supervised tracking, solving, coordinate system setup, etc. The material here builds upon that earlier material; it is not repeated here because it would be exactly that, a repetition.

Simple Stabilization 3D Tracking, Stabilization, and Effects Workflow Native 360VR Solving Special 360VR Solving Considerations Automatic Solving Mode From Seed Points or Automatic Mode 3D Solves from a Linearized Shot Using Add Many Trackers Using a Roto-d Auto-Track Manipulating the Viewing Direction Inserting Rendered 3D Objects Using External 360 VR Cameras Areas of SynthEyes Supporting 360 VR Footage Scene Exporters Supporting 360VR 360 VR Scripts Reference 3D Tracking Setup 3D Tracking Wrap Unstabilized 3D Tracking Wrapup Align Camera to Path AfterEffects 360VR Stabilization Blend Stabilizations Importer Copy ONLY Adjustment Tracks Copy Stabilization Create Next Piece Create Spherical Screen Export Stabilization Fine Tune Rotation Follow Mesh Fusion 360VR Stabilization Generate VR Lens Map Importer HitFilm 360VR Stabilization Import Stabilization Level Scene from Frame Re-aim stabilized shot Remove Stabilization SkyBox AE 360VR Stabilization Stabilize from Camera Path Unfollow Mesh

< Previous | Contents | Manuals Home | Boris FX | Next >