TWNKLS is developing augmented reality and computer vision technology since 2011. To adapt our solutions as well as possible to the needs and circumstances of the customer, we develop various AR technologies. The most used technologies are described below.

Horizontal & vertical plane tracking

A major way in which augmented reality is used is the projection of virtual 3D objects into a physical environment. To make such an environment usable as a projection canvas, you first need to map it accurately. This can be done using the camera from a mobile phone or tablet. Every second of footage generates 60 separate images, or video frames.

3D conversion pipeline

Many processes such as BIM models, technical models and detailed render models are based on 3D (CAD) models. The limited computing power of mobile devices means they are not usually able to portray these very data-heavy models via an attractive augmented reality experience. It is therefore necessary to transpose the information into a lighter database which only contains the essentials needed for realistic AR. Our conversion pipeline makes that possible, automatically.

Object recognition

Augmented reality lets you place virtual 3D objects in your physical environment. In some cases you can also create relationships or interactions with the physical object. To make this possible, the AR software has to be able to recognize the object within your environment. The first step in achieving this is to generate an image of the object using the camera from a phone or tablet.

Accurate 3D scanning

A digital version of a physical object, surface or environment has many different applications. These 3D files can be used to produce a clone of an object, quickly make a 3D record of a crime scene, quickly and effectively measure objects and much more. Making this possible starts with taking an accurate scan of the physical object, surface or environment concerned.

3D model tracking

Augmented reality makes it possible to place information over a physical object as a digital layer. If you present this digital information layer in 3D, you can create the illusion of ‘looking inside the object’. One of the important conditions for creating this effect is that the object and the augmentation need to be perfectly aligned. For this reason, you need to know exactly where the object is positioned.

Robust image and marker tracking

Augmented reality makes it possible to project virtual 3D visuals in your physical environment or on specific objects. In order to be able to use it as a projection screen, you first have to know what this environment or objects looks like, and what the scale is. If you can only use or want to use the camera of your mobile phone or tablet, you can use markers.