Creative Intent on the Windward Slopes

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2023, No. 10, pp. 19–22
Abstract: SMPTE was formed in 1916 as narrative performance was ushered onto the technological stage allowing for mass distribution and transmission. While there is no need to list those advantages, there is one weakness with audiovisual media as compared to the traditional stage, which media still has not overcome. This is real-time audience feedback, and the ability to adjust the performance based on differing audience reactions. This paper motivates the use of biosensors in media by highlighting the problem of signal loss due to playback technology. A metadata system is proposed that allows creatives to steer signal modifications as a function of audience emotion and cognition as determined by biosensor analysis This is needed because today's audiovisual ecosystem includes such a wide variety of playback devices that the audience's experience can differ substantially for the same source content. Metadata for narrative and emotional expectation as inserted by creatives during the content production stages combines with the assessment to adapt the rendering. As a result, the system allows for creative intent to be scalable as best as possible across many types of playback systems in a manner analogous to real-time stage presentation.
Publication Date: 2023-10-16
DOI: 10.5594/M002013
ISBN: Print: 978-1-61482-964-5
Link: https://doi.org/10.5594/M002013
Author(s): Scott DalyDolby Laboratories Inc.
Shane RuggieriDolby Laboratories Inc.
Dan DarcyDolby Laboratories Inc.
Evan GittermanDolby Laboratories Inc.
Poppy CrumConsultant
Keyword(s): Biosensors, Creative Intent Preservation, Emotion, Cognition, Image Processing, Audio Processing, Display, Sound System, Real-time Signal Modification
Copyright: © 2023 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

https://galea.co/#home EXTERNAL
C. Mosher and B. Wellner (2022) Biometric signals reveal how audiences engage with stories. SMPTE Motion Imaging Journal. V131 #2 EXTERNAL
Antonenko, Paas, Grabner, van Gog, (2010) Using Electroencephalography to Measure Cognitive Load, Educational psychology review V22, #4, pp 425-438. EXTERNAL
R. Barthes (1967) The Death of the Author. EXTERNAL
Hladek, Porr, Brimijoin (2018) Real-time estimation of horizontal gaze angle by saccade integration using in-ear electrooculography, PLOS. EXTERNAL
A. Favre-Félix ; C. Graversen ; T. Dau ; T. Lunner (2017 ) real time estimation of eye gaze by in-ear electrodes. IEEE EMBC annual conf. EXTERNAL
https://www.roadtovr.com/htc-facial-eye-trackers-vive-focus-3/ EXTERNAL
A. S. Cowen and D. Keltner (2017) Self-report captures 27 distinct categories of emotion bridged by continuous gradients. PNAS September 19, 2017. 114 (38) E7900-E7909; EXTERNAL
L. Tolstoy (1897) What is Art?, Penguin Classics. EXTERNAL
D. Rufenacht and A. Shaji (2022) Customized facial expression analysis in video. SMPTE Motion Imaging Journal, April EXTERNAL
T.S. Eliot (1920) The Sacred Wood: essays on Poetry and Criticism. Methuen Publishing, London. EXTERNAL
Nhan and Chau (2010) Classifying Affective States Using Thermal Infrared Imaging of the Human Face, IEEE Tran Biomedical engineering, V57. EXTERNAL
Livingston, Paisley (2009) Poincaré’s ‘‘Delicate Sieve’’: On Creativity and Constraints in the Arts.’ The Idea of Creativity. Eds. M. Krausz, et al. 129–46. EXTERNAL
P. Shem, S. Wang, and Z. Liu (2013) facial expression recognition from infrared thermal videos, In: Lee S., Cho H., Yoon KJ., Lee J. (eds) Intelligent Autonomous Systems 12. Advances in Intelligent Systems and Computing, vol 194. Springer. EXTERNAL
https://qz.com/1039102/disney-can-now-use-infrared-cameras-to-track-your-reactions-to-films-in-darkened-cinemas/ EXTERNAL
M. S. Livingstone,(2001) Is it warm? Is it real? Or just low spatial frequency? Science 290:1299. EXTERNAL
https://www.ted.com/talks/poppy_crum_technology_that_knows_what_you_re_feeling EXTERNAL
https://medium.com/inborn-experience/behold-the-next-generation-vr-technology-part-6-brain-interface-89b1d31a0a96 EXTERNAL
C. Jahnke (1990) Application of dynamical systems theory to nonlinear aircraft dynamics. PhD Thesis. CIT. EXTERNAL
W.K. Wimsatt, M.C. Beardsley (1946) The Intentional Fallacy. The Sewanee Review 54 (3) 468-488. EXTERNAL
http://neurable.com/ EXTERNAL
J. Farrell (2017) The varieties of authorial intention: literary theory beyond the intentional fallacy. Macmillan EXTERNAL
S. Daly, E. Gitterman, D. Darcy, S. Ruggieri, (2023) Biosensors for Landing Creative Intent, HVEI at IS&T Electronic Imaging EXTERNAL
A. Huddleston (2012) "The Conversation Argument for Actual Intentionalism”, British Journal of Aesthetics 52(3):241–256. EXTERNAL
R. Plutchik, (1980), Emotion: Theory, research, and experience: Vol. 1. Theories of emotion, 1, New York: Academic EXTERNAL
K. Stock (2017). Only Imagine: Fiction, Interpretation and Imagination (1st ed.). Oxford University Press. EXTERNAL
P. J. Lang, M. M. Bradley, and B. N. Cuthbert, “International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical report A-6,” Univ. Florida Tech. Rep. 6, 2005 EXTERNAL
A. Salah and A. Salah (2008) Technoscience Art: A bridge between neuroesthetics and art history. Review of General Psychology. V12 #2, See pg. 7 for entoptics example. EXTERNAL
L. Kontsevich and C.W. Tyler (2004) what makes Mona Lisa Smile? Vis. Res. EXTERNAL
P. Ekman". American Psychologist. 47 (4): 470–471. April 1992. doi:10.1037/0003-066x.47.4.470. EXTERNAL
J. Storyk (2020) recording studio and architectural room acoustic design, tutorial. Walters-Storyk Design Group EXTERNAL
https://www.humintell.com/2010/06/the-seven-basic-emotions-do-you-know-them/ EXTERNAL
Muhl, Jeunet, and Lotte (2014) EEG-based workload estimation across affective contexts. Front. Neuroscience V 12. EXTERNAL
S. Daly and X. Feng (2004) “Decontouring: Prevention and removal of false contour artifacts”, SPIE Proc. 5292, pg. 130-149. EXTERNAL
D. Wong, J. Hjortkjær, ; E. Ceolini, S. Nielsen, S. R. Griful, S. Fuglsang, M. Chait, T. Lunner, T. Dau, S-C. Liu, A. Cheveigné, (2018). A closed-loop platform for real-time attention control of simultaneous sound streams., ARO Midwinter meeting. EXTERNAL
T.S. Elliot (1922) The Wasteland. Boni & Liveright Publishing. EXTERNAL
https://nordicapis.com/20-emotion-recognition-apis-that-will-leave-you-impressed-and-concerned/ EXTERNAL
Z. Deng et al., "Factorized Variational Autoencoders for Modeling Audience Reactions to Movies," 2017 IEEE CVPR, 2017, doi: 10.1109/CVPR.2017.637. EXTERNAL
https://arpost.co/2022/06/01/varjo-opencbi-vr-headset-with-neurotech/ EXTERNAL
R-REC-B.2100 — Recommendation ITU-R B. 2100. Image parameter values for high dynamic range television for use in production and international programme exchange, 7/2018 EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M002013.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Scott Daly, Shane Ruggieri, Dan Darcy, Evan Gitterman, and Poppy Crum; Creative Intent on the Windward Slopes, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002013

Snippet:

Scott Daly, Shane Ruggieri, Dan Darcy, Evan Gitterman, and Poppy Crum; Creative Intent on the Windward Slopes, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002013

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Scott Daly, Shane Ruggieri, Dan Darcy, Evan Gitterman, and Poppy Crum; <cite>Creative Intent on the Windward Slopes</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M002013" target="_blank" rel="noopener">https://doi.org/10.5594/M002013</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Scott Daly, Shane Ruggieri, Dan Darcy, Evan Gitterman, and Poppy Crum; <cite id="bib-10-5594-m002013">Creative Intent on the Windward Slopes</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
<span class="doi">10.5594/M002013</span>
</li>