Computer-generated scenery can be realistically added to live video footage, using a machine vision system developed at Oxford University.

Previously, it has only been possible to add special effects to a scene in the studio afterwards. The Oxford team’s system can automatically rework a scene at up to 30 frames per second. The key is to efficiently search for visual markers.

The system could be important step towards machine vision. Robots could use the technique to better understand and navigate through an environment. This might even enable them to act in a more human manner.