Getting started with re.view

Sensori re.view offers a complete solution for the capture of dense on-site imagery, automated creation of 3D environment models, and easy communication using that data.

This document is a guide to the capturing of data, submission for processing, and viewing of the final models. 

If you have any queries, please get in touch using our contact form.

Choice of camera

The cameras we recommend for recording video for re.view are the Z Cam E2-M4, E2-S6G, and E2.  They can be used with the Meike 6.5mm f/2 fisheye lens (MFT mount).   Pre-assembled kits are available to rent from Sensori.

Alternatively, you may use other cameras that support the capture of high bitrate video with a fisheye lens, but the results are likely to be of a lower quality than with our recommended equipment.

We also support the use of stitched 360 panoramic video (equirectangular), but this will result in significantly lower quality and will not provide useful results in darker indoor environments.

  • Budget option: Z Cam E2-M4

    Premium option (reduced drift): Z Cam E2-S6G

    CFast 2.0 Memory card and card reader

    Meike 6.5mm f/2 fisheye lens (MFT mount)

    Battery: Sony L-series compatible battery and charger

    Smallrig camera cage and top handle for easier handling

  • The following video recording settings should be used for the recommended z cameras. If you are using an alternative camera then try to match these settings as closely as possible.

    First update to the latest firmware version (currently 0.98.2).

    A settings file containing our recommended settings is available for the E2, E2-M4 and E2-S6G.

    Alternatively, use the following manual settings. Note that changing some settings might reset others, so double check all settings after completion.

    Record

    Resolution:

    E2-S6G: 6144 x 4096

    E2/E2-M4: 3696 x 2772

    Project FPS: 24

    File Format: MP4

    Split Duration: 5 mins.

    VFR Control: Fine

    Variable Framerate: 3

    Playback FR: Default

    Video

    Encoder: H.265

    Bitrate: High

    Exposure

    EV: 0

    Shutter speed: Auto

    ISO: Auto

    MIn ISO: Auto

    Max ISO: 51200 for E2/E2-M4 or 40,000 for E2-S6G

    Max shutter speed: 1/160

    Metering Mode: Centre

    Shutter operation: Speed

    AE Speed: Fast

    Lock In Record: off

    Focus

    Focus Mode: MF (only need to set if using an autofocus lens).

    Image

    Image Profile Rec.709

    Sharpness: None

    Noise reduction: Weak

    System

    Assist Tools

    Display: On

    Peak:

    Enable: On

    Threshold: 50

    User Button

    F4: Magnifier (This will enable a magnified view for manual focus when pressing the F4 side button).

The scanning targets used by re.view are available to order from Sensori, but you may also print your own.

Origin plate and scale plates are available to download here.  These should be printed at the original print size of the file.  The distance between the centres of the target patterns is exactly 200mm and must be printed accurately.  We recommend printing these on aluminium composite to reduce the risk of movement during outdoor captures. The rectangular scale plates can be printed either single sided or double sided. Single sided is sufficient for most situations.

Control point markers for use with survey points can be downloaded here.  We recommend printing these on 3mm foam. Our standard size for these is 12cm across, but they may be used at any print size. The centre should be cut out as shown below.

Scanning targets

Using the targets

When capturing data of a site there must be known scale targets or survey point targets placed within the scene. These targets are used to set an accurate scale, reduce drift in the final output, and allow for alignment of the model.  We provide both a set of standard scale plates that can be used when accurately surveyed control points are not available, and a set of control point markers which should be used when three or more control points are available.  

We recommend always using surveyed control points when attempting larger captures of over 1000 square metres.

Note: With all markers it is vital they do not move during a scan. They must be stationary to prevent geometric errors in the final model. Do not collect any of the targets until capture of the scan has finished.

Origin and scale plates - easy use

Our standard set of scale plates includes a square origin plate which defines the centre of a local coordinate system for the scan, and eight unique rectangular scale markers which should be placed as evenly as possible around the site.  We suggest trying to ensure the distances between targets are no more than 20 metres to minimise accumulation of drift in the scan. The square origin plate should be placed flat on a level surface. The rectangular scale pair markers may be placed in any convenient location. Leaning them against a wall can help maximise visibility.

Control point targets - advanced use 

These markers allow the captured geometry to be aligned with surveyed control points, providing accurate geo-referencing and drift correction. They should be placed around existing retro markers or bolts in the scene with known accurate positions. When uploading the captured video data for a scan, you will also need to provide a csv file listing the coordinates and target ID for each control point marker (described below).  We recommend leaving these markers in place if possible so that successive scans can be captured without updating the marker coordinates.  

Notes on target placement: 

  • You might need to secure the targets to the ground or other surface to prevent them moving in the wind for outdoor captures. 

  • The origin target can be screwed into place to maintain a consistent coordinate system across multiple scans. 

  • Using double sided tape is useful when fixing retro markers to walls, though if left too long this may rip off paint, so take care

Capturing a scan

Site captures are organised according to a hierarchy of projects, scenes, and scans. For example, a project might represent the entirety of a building. Each scene within that project would represent one floor within that building. Each scan provides a single time-stamped capture of that scene on a particular day.

When capturing data of a scene we refer to this as “scanning” the scene. A scan is one continuous walk through the entire scene. Re.view doesn’t support stitching multiple physically separated recordings together so your scan must cover every area of a scene that is to be reconstructed without stopping.

Order of operations 

  1. Ensure there is an memory card and charged battery in the camera before going to the site

  2. Locate surveyed control points if those will be used

  3. Distribute the origin and scale plates around the scene or place control point targets over surveyed control points.

  4. Turn the camera on 

  5. Set the aperture and focus 

  6. Hit the record button once, the red recording circle will appear on screen 

  7. Slowly walk through and capture the scene, making sure to regularly turn around a full 360 degrees.

  8. Take care to record each target multiple times

  9. Walk back to where you started if possible

  10. Hit the record button to stop, the red recording circle will disappear 

  11. Collect targets as required 

  12. Upload videos from camera and control points csv file if used to the Sensori website

Camera check 

Before you begin, ensure the camera has the SD Card and battery installed. You can do this by opening the card slot and battery housing.  

Turn the camera on and ensure there is going to be sufficient battery for the full scan.

Check camera settings against the list provided above if they might have been changed.

Check focus and aperture 

Once the camera is turned on we must set the focus and aperture. These settings will not be altered at any point during the scan. 

The aperture should be set at F2.0 and this is done by manually adjusting the aperture dial on the fisheye lens. 

To capture data you will be walking slowly through the scene, moving and pointing the camera towards areas of interest.  When capturing there are a few guidelines to consider: 

  • Don’t get closer than 1 metre to any object if possible 

  • Don’t move faster than a slow walk, about a third your usual pace 

  • Don’t swing the camera faster than you would a cup of liquid 

  • Each time you pass a target (Origin plate, scale plate, or control point), point the camera at the target and move it left and right.  

  • Try to “weave” through the site, crossing back over spaces you have walked through.

  • Occasionally turn around a full 360 degrees to ensure you capture in all directions. This is very important to ensure your capture is fully connected and has low drift error.

  • If a space becomes narrow, such as a corridor or doorway, then slow your pace further.

  • If there are areas of interest (pipes, cables, etc) then get closer to these areas and slowly move the camera around them to capture more detail.

Any area that you don’t walk through will not be reconstructed well, so be sure to walk throughout the whole scene that you want to capture. It doesn’t matter where you start, but it’s a very good idea to walk back to where you started before you end the capture, and try to visit each area more than once.

For focus checks we will adjust this manually as opposed to using an autofocus system. The focus distance should be set as shown in this image, but we recommend looking at the focus peaking provided in the camera’s live view. To do this  

  • Stand about 2 metres from an object in the scene and point the camera at the object 

  • Move the focus ring left and right, you will see highlighted “peaks” change as you do this 

  • During this movement you want to look for a point where there are the most “peaks”, which are shown as highlighted areas, around the object. 

  • Once you have found the point where there are the most “peaks” leave the focus ring in that position. 

The focus is now set for the scan.

Walk the site

For improved accuracy on larger captures and around repeating structures such as stairwells you may also use the control point targets without surveyed ground truth positions . These should be placed in locations with good visibility as shown below. It is important that these markers be secured if you are in a windy outdoor environment to prevent them moving during the capture.

Example routes taken during capture

Capture of a control point target

Uploading your data

Register for an account on the Sensori website if you don’t already have one.

Create the project and scene hierarchy.

Create a new scan within the scene

Choose the appropriate survey data option depending on whether you used the origin and scale plates, or surveyed control points.

Upload csv file of control point coordinates if control points were used. See below for more information on the csv format.

Select ‘Fixed Lens’ for the lens type.

Upload the video files from the camera.

An example of the expected csv format for the control point survey data can be seen here. Units should be metres:

Environmental and weather factors

Depending upon the environment you’re capturing and how the weather is there are a few key notes: 

  • Wet and shiny surfaces won’t reconstruct well. Be prepared for mirrored areas, pools of standing water, and glassy objects to be deformed in the final model 

  • Clean featureless areas, such as painted walls, may also be deformed or not get reconstructed in the final model.

  • Dense vegetation, such as grasses and tree branches, will be poorly reconstructed in the model if there is much wind 

Processing of the scan will take between a few hours and 2 days, depending on the length of video you uploaded.