Interactive Steaming of Panoramas and VR Worlds

Bibliographic Reference(s)

• K. A. Tan, H. Hua, and N. Ahuja, “Multiview Panoramic Cameras Using Mirror Pyramids,” Transactions on Pattern Analysis and Machine Intelligence, 26(7), 941-946, 2004. EXTERNAL
• C. Weissig, O. Schreer, P. Eisert, and P. Kauff, “The Ultimate Immersive Experience: Panoramic 3D Video Acquisition.” Proc. MM 2012, Klagenfurt, Austria, Jan. 2012. EXTERNAL
• U. Iwerks, “Panoramic Motion Picture Camera Arrangement,” Canadian Patent Publication No. CA 673633, 1963. EXTERNAL
• Y. Sanchez, R. Skupin, and T. Schierl, “Compressed Domain Video Processing for Tile based Panoramic Streaming using HEVC,” Proc. IEEE International Conference on Image Processing (ICIP), Quebec, Canada, Sep. 2015. cost, while the tiles that remain within the RoI can use efficient temporal prediction. Tiles 3 and 4 in Fig. 10 belong to the latter category. Thus, most often, only a subset of the RoI tiles contribute to bitrate peaks at such RoI change events. Using Compressed Domain Tile Stitching, all the stitched tiles change spatial position within the RoI during such an event. Therefore, random access usually would have to be provided for all the tiles leading to a significant peak bitrate increase compared to classic Tiled Panorama Streaming without stitching. In order to resolve this disadvantage, Fraunhofer HHI has developed a lightweight processing that operates in the compressed domain.5 Through inserting artificial reference pictures into the bitstream at RoI change events with low complexity and for almost zero bitrate cost, tiles that remain in the RoI, e.g., Tiles 3 and 4 in Fig. 10, can use temporal prediction as in the classic Tiled Panorama Streaming approach. Hence, among other advantages, the peak bitrate behavior using Compressed Domain Tile Stitching with a single decoder instance on the end device is comparable to classic Tiled Panorama Streaming that requires multiple decoders. Conclusion Virtual reality is currently one of the hottest topics in the media sector, besides complete computergenerated imagery panoramas, which can be easily EXTERNAL
• P. Sturm, S. Ramalingam, J.-P. Tardif, S. Gasparini, and J. Barreto, “Camera Models and Fundamental Concepts Used in Geometric Computer Vision,” Foundations and Trends in Computer Graphics and Vision, 6(1–2):1-183, 2010. EXTERNAL