Augmented Reality (AR)
AR (augmented reality) adds a digital layer on top of what the phone camera sees. With AR you can:
- show objects, images, graphics or filmed people “on top of” reality
- show how a place looked in the past – or might look in the future
- create discovery trails and treasure hunts
How an AR experience is structured
Section titled “How an AR experience is structured”| Term | Meaning |
|---|---|
| AR Experience | A set of one or more AR triggers. Linked to a stop (Location). |
| AR Trigger | A single AR event: when X is detected, show Y. |
| Image Recognition | A trigger that fires when the camera recognises an image you’ve uploaded. |
| GPS trigger | A trigger that fires when the visitor is at a given position. |
Two ways to trigger AR
Section titled “Two ways to trigger AR”- Image recognition – the app looks for one or more reference images in the camera view, e.g. a sign, a façade or a painting.
- GPS position – AR starts when the visitor is at a certain place.
What can be shown?
Section titled “What can be shown?”Once triggered, the camera view can:
- play audio
- show an image (including transparency)
- show a video – including green-screen video where the green becomes transparent
- show graphics or animation
- show a 3D model, even animated
Example: “This is how it looked 100 years ago”
Section titled “Example: “This is how it looked 100 years ago””You have an old photograph of a house and want visitors to see it on top of today’s house.
- Study the old photo: angle and distance. Stand in the same spot.
- Photograph the house today from the same angle and distance. Take several shots.
- Crop the new photo to the part that looks the same regardless of weather and season – AR needs clear, stable details to recognise.
- Create an AR Experience with an Image Recognition trigger: the cropped photo is the reference image, the old photo is what’s shown.
- Adjust size, hints and other parameters.
- Link the AR experience to the right stop.
- Go out and test on site!
Tips for good reference images
Section titled “Tips for good reference images”- Lots of detail and contrast, ideally irregular patterns.
- Avoid repetitive patterns, large single-colour areas and shiny/reflective surfaces.
- Flat subjects (signs, paintings) work best.
- Follow Google’s ARCore augmented images recommendations.
Green screen and chroma key
Section titled “Green screen and chroma key”Chroma key makes a certain colour – usually green – transparent in a video.
- Hang a green-screen backdrop against a wall and light it evenly.
- Film the person or object in front of it. Nothing green on their clothes!
- The video is added to the AR trigger with chroma key enabled, so the green becomes transparent.
Use pure green, roughly RGB 0, 255, 0. The system removes a range of green shades around that colour; the width of the range is controlled by chromaKeyThreshold.
3D models
Section titled “3D models”iOS and Android use different formats, so you provide one model per platform:
| Platform | Format |
|---|---|
| Android | .glb |
| iOS | .zip containing an .obj and an .mtl side by side |
Creating the iOS zip file
Section titled “Creating the iOS zip file”- Put the
.objand.mtlfiles (and any textures) in the same folder. - Open the
.objfile in a text editor and check that near the top there’s a line pointing to the.mtlfile, e.g.mtllib model.mtl. - Right-click the folder and choose Compress.
- The zip file is used as the iOS model.
Only have a .glb? Convert to OBJ + MTL with 3dviewer.net. You can sometimes also “repair” broken GLB files by opening and exporting them again there.
The model looks dark
Section titled “The model looks dark”If the model looks dark or unlit, the material’s emission may be 0. In Blender:
- Go to the Shading tab and select the model (or press A).
- Choose the material. Check that it uses Principled BSDF.
- Expand Emission, connect Image Texture → Color to Emission Color and set Strength to 1 (adjust as needed).
- Check the lighting via Viewport Shading → Lighting → Scene World.
Accessibility and safety
Section titled “Accessibility and safety”AR is turned off automatically when a screen reader (VoiceOver/TalkBack) is active. The first time AR is used, a warning reminds visitors to watch their surroundings and that children should use AR under supervision.
Phone requirements
Section titled “Phone requirements”AR works on iPhones with ARKit support and Android phones with ARCore support (varies by brand and model).
AI answers can be wrong – check the linked pages.
