Skip to content

Augmented Reality (AR)

AR (augmented reality) adds a digital layer on top of what the phone camera sees. With AR you can:

  • show objects, images, graphics or filmed people “on top of” reality
  • show how a place looked in the past – or might look in the future
  • create discovery trails and treasure hunts
Term Meaning
AR Experience A set of one or more AR triggers. Linked to a stop (Location).
AR Trigger A single AR event: when X is detected, show Y.
Image Recognition A trigger that fires when the camera recognises an image you’ve uploaded.
GPS trigger A trigger that fires when the visitor is at a given position.
  1. Image recognition – the app looks for one or more reference images in the camera view, e.g. a sign, a façade or a painting.
  2. GPS position – AR starts when the visitor is at a certain place.

Once triggered, the camera view can:

  • play audio
  • show an image (including transparency)
  • show a video – including green-screen video where the green becomes transparent
  • show graphics or animation
  • show a 3D model, even animated

Example: “This is how it looked 100 years ago”

Section titled “Example: “This is how it looked 100 years ago””

You have an old photograph of a house and want visitors to see it on top of today’s house.

  1. Study the old photo: angle and distance. Stand in the same spot.
  2. Photograph the house today from the same angle and distance. Take several shots.
  3. Crop the new photo to the part that looks the same regardless of weather and season – AR needs clear, stable details to recognise.
  4. Create an AR Experience with an Image Recognition trigger: the cropped photo is the reference image, the old photo is what’s shown.
  5. Adjust size, hints and other parameters.
  6. Link the AR experience to the right stop.
  7. Go out and test on site!
  • Lots of detail and contrast, ideally irregular patterns.
  • Avoid repetitive patterns, large single-colour areas and shiny/reflective surfaces.
  • Flat subjects (signs, paintings) work best.
  • Follow Google’s ARCore augmented images recommendations.

Chroma key makes a certain colour – usually green – transparent in a video.

  1. Hang a green-screen backdrop against a wall and light it evenly.
  2. Film the person or object in front of it. Nothing green on their clothes!
  3. The video is added to the AR trigger with chroma key enabled, so the green becomes transparent.

Use pure green, roughly RGB 0, 255, 0. The system removes a range of green shades around that colour; the width of the range is controlled by chromaKeyThreshold.

iOS and Android use different formats, so you provide one model per platform:

Platform Format
Android .glb
iOS .zip containing an .obj and an .mtl side by side
  1. Put the .obj and .mtl files (and any textures) in the same folder.
  2. Open the .obj file in a text editor and check that near the top there’s a line pointing to the .mtl file, e.g. mtllib model.mtl.
  3. Right-click the folder and choose Compress.
  4. The zip file is used as the iOS model.

Only have a .glb? Convert to OBJ + MTL with 3dviewer.net. You can sometimes also “repair” broken GLB files by opening and exporting them again there.

If the model looks dark or unlit, the material’s emission may be 0. In Blender:

  1. Go to the Shading tab and select the model (or press A).
  2. Choose the material. Check that it uses Principled BSDF.
  3. Expand Emission, connect Image Texture → Color to Emission Color and set Strength to 1 (adjust as needed).
  4. Check the lighting via Viewport Shading → Lighting → Scene World.

AR is turned off automatically when a screen reader (VoiceOver/TalkBack) is active. The first time AR is used, a warning reminds visitors to watch their surroundings and that children should use AR under supervision.

AR works on iPhones with ARKit support and Android phones with ARCore support (varies by brand and model).