Getting started with re.view
Sensori re.view offers a complete solution for the capture of dense on-site imagery, automated creation of 3D environment models, and easy communication using that data.
This document is a guide to the capturing of data, submission for processing, and viewing of the final models.
If you have any queries, please get in touch using our contact form.
Choice of camera
The cameras we recommend for recording video for re.view are the Z Cam E2-M4, E2-S6G, and E2. They can be used with the Meike 6.5mm f/2 fisheye lens (MFT mount). Pre-assembled kits are available to rent from Sensori.
Alternatively, you may use other cameras that support the capture of high bitrate video with a fisheye lens, but the results are likely to be of a lower quality than with our recommended equipment.
We also support the use of stitched 360 panoramic video (equirectangular), but this will result in significantly lower quality and will not provide useful results in darker indoor environments.
-
Budget option: Z Cam E2-M4
Premium option (reduced drift): Z Cam E2-S6G
CFast 2.0 Memory card and card reader
Meike 6.5mm f/2 fisheye lens (MFT mount)
Battery: Sony L-series compatible battery and charger
Smallrig camera cage and top handle for easier handling
-
The following video recording settings should be used for the recommended z cameras. If you are using an alternative camera then try to match these settings as closely as possible.
First update to the latest firmware version (currently 0.98.2).
A settings file containing our recommended settings is available for the E2, E2-M4 and E2-S6G.
Alternatively, use the following manual settings. Note that changing some settings might reset others, so double check all settings after completion.
Record
Resolution:
E2-S6G: 6144 x 4096
E2/E2-M4: 3696 x 2772
Project FPS: 24
File Format: MP4
Split Duration: 5 mins.
VFR Control: Fine
Variable Framerate: 3
Playback FR: Default
Video
Encoder: H.265
Bitrate: High
Exposure
EV: 0
Shutter speed: Auto
ISO: Auto
MIn ISO: Auto
Max ISO: 51200 for E2/E2-M4 or 40,000 for E2-S6G
Max shutter speed: 1/160
Metering Mode: Centre
Shutter operation: Speed
AE Speed: Fast
Lock In Record: off
Focus
Focus Mode: MF (only need to set if using an autofocus lens).
Image
Image Profile Rec.709
Sharpness: None
Noise reduction: Weak
System
Assist Tools
Display: On
Peak:
Enable: On
Threshold: 50
User Button
F4: Magnifier (This will enable a magnified view for manual focus when pressing the F4 side button).
The scanning targets used by re.view are available to order from Sensori, but you may also print your own.
Origin plate and scale plates are available to download here. These should be printed at the original print size of the file. The distance between the centres of the target patterns is exactly 200mm and must be printed accurately. We recommend printing these on aluminium composite to reduce the risk of movement during outdoor captures. The rectangular scale plates can be printed either single sided or double sided. Single sided is sufficient for most situations.
Control point markers for use with survey points can be downloaded here. We recommend printing these on 3mm foam. Our standard size for these is 12cm across, but they may be used at any print size. The centre should be cut out as shown below.
Scanning targets
Using the targets
When capturing data of a site there must be known scale targets or survey point targets placed within the scene. These targets are used to set an accurate scale, reduce drift in the final output, and allow for alignment of the model. We provide both a set of standard scale plates that can be used when accurately surveyed control points are not available, and a set of control point markers which should be used when three or more control points are available.
We recommend always using surveyed control points when attempting larger captures of over 1000 square metres.
Note: With all markers it is vital they do not move during a scan. They must be stationary to prevent geometric errors in the final model. Do not collect any of the targets until capture of the scan has finished.
Origin and scale plates - easy use
Our standard set of scale plates includes a square origin plate which defines the centre of a local coordinate system for the scan, and eight unique rectangular scale markers which should be placed as evenly as possible around the site. We suggest trying to ensure the distances between targets are no more than 20 metres to minimise accumulation of drift in the scan. The square origin plate should be placed flat on a level surface. The rectangular scale pair markers may be placed in any convenient location. Leaning them against a wall can help maximise visibility.
Control point targets - advanced use
These markers allow the captured geometry to be aligned with surveyed control points, providing accurate geo-referencing and drift correction. They should be placed around existing retro markers or bolts in the scene with known accurate positions. When uploading the captured video data for a scan, you will also need to provide a csv file listing the coordinates and target ID for each control point marker (described below). We recommend leaving these markers in place if possible so that successive scans can be captured without updating the marker coordinates.
Notes on target placement:
You might need to secure the targets to the ground or other surface to prevent them moving in the wind for outdoor captures.
The origin target can be screwed into place to maintain a consistent coordinate system across multiple scans.
Using double sided tape is useful when fixing retro markers to walls, though if left too long this may rip off paint, so take care
Capturing a scan
Site captures are organised according to a hierarchy of projects, scenes, and scans. For example, a project might represent the entirety of a building. Each scene within that project would represent one floor within that building. Each scan provides a single time-stamped capture of that scene on a particular day.
When capturing data of a scene we refer to this as “scanning” the scene. A scan is one continuous walk through the entire scene. Re.view doesn’t support stitching multiple physically separated recordings together so your scan must cover every area of a scene that is to be reconstructed without stopping.
Order of operations
Ensure there is an memory card and charged battery in the camera before going to the site
Locate surveyed control points if those will be used
Distribute the origin and scale plates around the scene or place control point targets over surveyed control points.
Turn the camera on
Set the aperture and focus
Hit the record button once, the red recording circle will appear on screen
Slowly walk through and capture the scene, making sure to regularly turn around a full 360 degrees.
Take care to record each target multiple times
Walk back to where you started if possible
Hit the record button to stop, the red recording circle will disappear
Collect targets as required
Upload videos from camera and control points csv file if used to the Sensori website
Camera check
Before you begin, ensure the camera has the SD Card and battery installed. You can do this by opening the card slot and battery housing.
Turn the camera on and ensure there is going to be sufficient battery for the full scan.
Check camera settings against the list provided above if they might have been changed.
Check focus and aperture
Once the camera is turned on we must set the focus and aperture. These settings will not be altered at any point during the scan.
The aperture should be set at F2.0 and this is done by manually adjusting the aperture dial on the fisheye lens.
To capture data you will be walking slowly through the scene, moving and pointing the camera towards areas of interest. When capturing there are a few guidelines to consider:
Don’t get closer than 1 metre to any object if possible
Don’t move faster than a slow walk, about a third your usual pace
Don’t swing the camera faster than you would a cup of liquid
Each time you pass a target (Origin plate, scale plate, or control point), point the camera at the target and move it left and right.
Try to “weave” through the site, crossing back over spaces you have walked through.
Occasionally turn around a full 360 degrees to ensure you capture in all directions. This is very important to ensure your capture is fully connected and has low drift error.
If a space becomes narrow, such as a corridor or doorway, then slow your pace further.
If there are areas of interest (pipes, cables, etc) then get closer to these areas and slowly move the camera around them to capture more detail.
Any area that you don’t walk through will not be reconstructed well, so be sure to walk throughout the whole scene that you want to capture. It doesn’t matter where you start, but it’s a very good idea to walk back to where you started before you end the capture, and try to visit each area more than once.
For focus checks we will adjust this manually as opposed to using an autofocus system. The focus distance should be set as shown in this image, but we recommend looking at the focus peaking provided in the camera’s live view. To do this
Stand about 2 metres from an object in the scene and point the camera at the object
Move the focus ring left and right, you will see highlighted “peaks” change as you do this
During this movement you want to look for a point where there are the most “peaks”, which are shown as highlighted areas, around the object.
Once you have found the point where there are the most “peaks” leave the focus ring in that position.
The focus is now set for the scan.
Walk the site
For improved accuracy on larger captures and around repeating structures such as stairwells you may also use the control point targets without surveyed ground truth positions . These should be placed in locations with good visibility as shown below. It is important that these markers be secured if you are in a windy outdoor environment to prevent them moving during the capture.
Example routes taken during capture
Capture of a control point target
Uploading your data
Register for an account on the Sensori website if you don’t already have one.
Create the project and scene hierarchy.
Create a new scan within the scene
Choose the appropriate survey data option depending on whether you used the origin and scale plates, or surveyed control points.
Upload csv file of control point coordinates if control points were used. See below for more information on the csv format.
Select ‘Fixed Lens’ for the lens type.
Upload the video files from the camera.
An example of the expected csv format for the control point survey data can be seen here. Units should be metres:
Environmental and weather factors
Depending upon the environment you’re capturing and how the weather is there are a few key notes:
Wet and shiny surfaces won’t reconstruct well. Be prepared for mirrored areas, pools of standing water, and glassy objects to be deformed in the final model
Clean featureless areas, such as painted walls, may also be deformed or not get reconstructed in the final model.
Dense vegetation, such as grasses and tree branches, will be poorly reconstructed in the model if there is much wind
Processing of the scan will take between a few hours and 2 days, depending on the length of video you uploaded.