Media production with correlation of image stream and abstract objects in a three-dimensional virtual stage

Abstract From the Canadian patent

In a media production system, two-dimensional images captured from physical objects are analyzed to create three-dimensional representations of the physical objects within a virtual stage. Representations of physical and synthetic objects are manipulated and choreagraphed in the virtual stage within an integrated system which also generates a media product in the form of a two-dimensional image stream of the physical and synthetic objects with optional synchronized audio tracks. A correlation is maintained between object models in the virtual stage and the original two-dimensional images so that information from those images can be included in the final product. To facilitate …