Breaking the Fourth Wall through Extended Reality

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2023, No. 10, pp. 6–9
Abstract: Filmmakers pursue a goal of a more absorbing and powerful sensory viewing experience through implementing advanced technologies. With the thriving of extended reality (XR), an XR revolution in the entertainment industry has been initiated by practitioners. This article reviews cinematic realism from aspects of photorealism, the phenomenal S3D cinema, and its unfulfillments for the immersive experience, and elaborates the XR trend by specifying the potential of implementing augmented reality (AR) as a medium for a new level of cinematic realism. AR's feature of presenting virtual imaging in the physical world provides a solid foundation for an extended dimension over the viewing screen. This article introduces the concept of augmented dimension (AD) that implements augmented reality as the out-of-screen visual effects to explore the perceptual realism in cinematic experiences. Compared with stereoscopic 3D films, the three-dimensional perception in AD can be considered as perceptual realism rather than photorealism. This article also illustrates the proposed pipeline to produce AD films and concludes the potential of AD for the future immersive cinema.
Publication Date: 2023-10-16
DOI: 10.5594/M001994
ISBN: Print: 978-1-61482-964-5
Link: https://doi.org/10.5594/M001994
Author(s): Jason S. KaoPh.D., Inland Norway University of Applied Sciences, Norway
Karen KaoPh.D., Glasgow Caledonian University, UK
Keyword(s): Augmented Reality, Cinematic Realism, Immersive Cinema, Augmented Dimension
Copyright: © 2023 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Stereoscopy and the Human Visual System [Active]
S. Prince, “True Lies: Perceptual Realism, Digital Images, and Film Theory”, Film Quarterly, Vol. 49, No. 3, 27–37 (1996). EXTERNAL
M. Ross, “3D Cinema: Optical Illusions and Tactile Experience”, Screen, Vol. 57, Issue 3, 389-392 (2015). EXTERNAL
F. Gabriel, “The Interchangeability of VFX and Live Action and Its Implications for Realism”, Journal of Film and Video, Vol. 69, No. 1, p. 3 (2017). EXTERNAL
J. Brown, “Dark Knight Rises director Christopher Nolan says IMAX is the best format”, Imax. Retrieved March 29, 2023 from https://www.imax.com.au/news/2012/04/dark-knight-rises-director-christopher-nolan-says-imax-is-the-best-format/ EXTERNAL
D.-H. Shin and Y.-J. Shin, “Why do people play social network games?”, Computers in Human Behavior, Vol. 27, No. 2, 852–861, (2011). EXTERNAL
J. R. Smythies and R. E. French, Direct versus Indirect Realism (Cambridge: Academic Press, 2018). EXTERNAL
J. Turnock, “The ILM Version: Recent Digital Effects and the Aesthetics of 1970s Cinematography”, Film History, Vol. 24, No. 2, p. 158 (2012). EXTERNAL
T. Gunning, “The Cinema of Attractions : Early Film, Its Spectator and the Avant-Garde ”, Theater and Film: A Comparative Anthology (1986) p. 39. EXTERNAL
L. Budianto, S. Setiawan, P. Retnaningdyah, P. K. Barus, B. A. W. Ningsih, , D. R. Amelia, “The Power of The Computer-Generated Imagery (CGI) in Avengers Endgame Movie: EXTERNAL
F. Kessler, “The Cinema of Attractions as Dispositif”, The Cinema of Attractions Reloaded (Amsterdam University Press, 2006) 59 - 69. EXTERNAL
E. Dumic, S. Grgic, and M. Grgic, “Comparison of HDTV formats using objective video quality measures”, Multimedia Tools and Applications, Vol. 49, No. 3, 409–424 (2010). EXTERNAL
S. Kao, Evaluating the Effect of Colour in Stereoscopic Three-dimensional Perception, (Leeds: Ph.D. dissertation, School of Design, Univ. Leeds, 2015). EXTERNAL
R. Ebert, “Why 3D doesn’t work and never will - Case closed. Roger Ebert”. Retrieved April 20, 2023 from https://www.rogerebert.com/roger-ebert/why-3d-doesnt-work-and-never-will-case-closed EXTERNAL
H. Hart, “The Hobbit Is Insanely Gorgeous at 48 Frames per Second”, Wired. Retrieved March 29, 2023 from https://www.wired.com/2012/12/hobbit-movie-review-48-fps/ EXTERNAL
A. Bazin, ‘The myth of total cinema’, What is cinema, No. 1, 17-22 (1967). EXTERNAL
D. A. Ross, “Evolution of Technology in Cinema: Film to Digital, CGI, VFX, Motion Capture & Beyond - Hollywood Insider,” Hollywoodinsider. Retrieved March 29, 2023 from https://www.hollywoodinsider.com/technology-in-cinema-cgi-motion-capture/ EXTERNAL
J. Hart, “Shooting Time-Lapse 3D Movies with Digital Still Cameras”, 3DIY (Routledge, 2011). EXTERNAL
D. Bordwell, J. Staiger, and K. Thompson, The Classical Hollywood Cinema : Film Style & Mode of Production to 1960 (London ; New York: Routledge, Taylor & Francis Group, 1985). EXTERNAL
“Disney Remembering: Short Film & AR Experience,” Magnopus. Retrieved April 30, 2023 from https://www.magnopus.com/projects/disney-remembering EXTERNAL
T. Gunning, ONE. Tracing the Individual Body: Photography, Detectives, and Early Cinema. In L. Charney & V. Schwartz (Ed.), Cinema and the Invention of Modern Life (Berkeley: University of California Press, 1995), 15-45. EXTERNAL
“Disney Research Enabling More Complex, Entertaining Augmented Reality for Theme Parks”, Disney Research. Retrieved April 30, 2023 from https://la.disneyresearch.com/innovations/procams/ EXTERNAL
B. Isaacs, The orientation of future cinema: Technology, aesthetics, spectacle (A&C Black, 2013) p. 39. EXTERNAL
Q. Ji, J. Tanca, and S. Janicke, “Does 3D increase the enjoyment experience? A comparative experiment on the psychological effects of 3D”, 3D Research, Vol. 4, No. 4, (2013). EXTERNAL
R. Allison, L. Wilcox, A. Kazimi, Perceptual artefacts, suspension of disbelief and realism in stereoscopic 3D film, Public, Vol. 24, 149-160 (2013). EXTERNAL
M. Frizot, “Line Screen Systems”, Paris in 3D: From Stereoscopy to Virtual Reality (London: Booth-Clibborn, 2000) 153-157. EXTERNAL
J. Barr, “Transformers: Dark of the Moon Brighter Digital Print”, Collider. Retrieved February 20, 2023 from https://collider.com/transformers-dark-of-the-moon-enhanced-digital-print EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001994.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Jason S. Kao and Karen Kao; Breaking the Fourth Wall through Extended Reality, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M001994

Snippet:

Jason S. Kao and Karen Kao; Breaking the Fourth Wall through Extended Reality, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M001994

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Jason S. Kao and Karen Kao; <cite>Breaking the Fourth Wall through Extended Reality</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M001994" target="_blank" rel="noopener">https://doi.org/10.5594/M001994</a></span>

SMPTE's HTML Pub

Preview:

Jason S. Kao and Karen Kao; Breaking the Fourth Wall through Extended Reality, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
doi: 10.5594/M001994
url: https://doi.org/10.5594/M001994

Snippet:

<li>
Jason S. Kao and Karen Kao; <cite id="bib-10-5594-m001994">Breaking the Fourth Wall through Extended Reality</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
<span class="doi">10.5594/M001994</span>
</li>