FREE VIEWPOINT VIDEO SYNTHESIS AND PRESENTATION FROM MULTIPLE SPORTING VIDEOS (FriPmSS1)

Author(s) : Naho Inamoto (Keio University, Japan) Hideo Saito (Keio University, Japan)

Abstract : This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (viewpoint on demand system), a user can watch the realistic sporting scenes with original stadium. In the second system (mixed reality presentation system), a user can virtually watch the scenes overlaid on the desktop stadium model via a video see-through HMD. In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene has shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce realistic mixed reality presentation.

Menu