SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022)
[ACTIVE]
Biometric Signals Reveal How Audiences Engage With Stories
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 131, No. 2, pp. 29–39
- Abstract
- Consumer-wearable Bluetooth-enabled biometric devices are becoming more reliable for the collection of physiological data. They are also more accessible to the average consumer. Building a technology platform with the right devices, components, and algorithms can enable content creators to gather consumer insights on how viewers are engaging with their content. Additionally, content can be created with the intention of allowing viewers to interact and control storylines by utilizing their physiological responses. This article outlines the framework by which this type of data can be collected, what types of stimuli can be applied to insight gathering and content creation, and how this data can be processed.
- Publication Date
- 2022-03-01
- DOI
10.5594/JMI.2022.3146520- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2022.3146520
- Author(s)
- Clayton P. Mosher
bio
Clayton P. Mosher received his PhD in neuroscience from The University of Arizona and is the lead scientist of neurotechnology at the Warner Media Neuro Lab, Burbank, CA. His research focuses on social behavior and emotion and his studies have been published in a variety of journals spanning a breadth of topics: from how neurons in the brain facilitate eye-contact to how emotions cause our hearts to race and our palms to sweat. He is an active member of the Society for Neuroscience and the Society for Psychophysiological Research.Brian Wellnerbio
Brian Wellner is the director of digital platforms at Warner Brothers, Burbank, CA, where he leads the Neurotechnology Team, which is responsible for building and growing technology solutions for research and development and immersive content development purposes. The team consists of software engineers, UI/UX designers, product managers, neuroscientists, and data scientists. Wellner’s career spans more than 20 years in the media and entertainment industry. All of his past roles have been focused on productizing new and innovative technologies and applying them to businesses that are going through disruption due to evolving technology and changes in consumer behavior. - Keyword(s)
- Advanced Narratives, Algorithm, Artificial Intelligence, Biometrics, Facial Action Coding System (FACS), Galvanic Skin Response (GSR), Gaze Tracking, Heart Rate Variability (HRV), Signal Processing and Analysis
- Copyright
- © 2022 SMPTE
Bibliographic Reference(s)
- M. M. Bradley, M. Codispoti, B. N. Cuthbert, and P. J. Lang, “Emotion and Motivation I: Defensive and Appetitive Reactions in Picture Processing,” Emotion, Washington, DC, 1(3): 276–298, 2001. [Online]. Available: https://doi.org/10.1037/1528-3542.1.3.276 EXTERNAL
- A. Yarbus, Eye Movements and Vision, Plenum Press: New York, NY, 1967. EXTERNAL
- T. Nishiyama, J. Sugenoya, T. Matsumoto, S. Iwase, and T. Mano, “Irregular Activation of Individual Sweat Glands in Human Sole Observed by a Videomicroscopy,” Auton. Neurosci., 88(1): 117–126, Apr. 2001. [Online]. Available: https://doi.org/10.1016/S1566-0702(01)00229-6 EXTERNAL
- P. Ekman, “Expression or Communication About Emotion,” Uniting Psychology and Biology: Integrative Perspectives on Human Development, American Psychological Association: Washington, DC, pp. 315–338, 1997. [Online]. Available: https://doi.org/10.1037/10242-008 EXTERNAL
- J. Polich and A. Kok, “Cognitive and Biological Determinants of P300: An Integrative Review,” Biol. Psychol., 41(2): 103–146, Oct. 1995. [Online]. Available: https://doi.org/10.1016/0301-0511(95)05130-9 EXTERNAL
- E. Maris and R. Oostenveld, “Nonparametric Statistical Testing of EEG- and MEG-Data,” J. Neurosci. Methods, 164(1): 177–190, Aug. 2007. [Online]. Available: https://doi.org/10.1016/j.jneumeth.2007.03.024 EXTERNAL
- M. Kunz, and S. Lautenbacher, “‘The Need for Diversity in Research on Facial Expressions of Pain’: Reply to Dildine and Atlas,” Pain, 160(8): 1902–1903, 2019. [Online]. Available: https://doi.org/10.1097/j.pain.0000000000001594 EXTERNAL
- M. B. Kugler, “From Identification to Identity Theft: Public Perceptions of Biometric Privacy Harms,” U.C. Irvine L. Rev. 107, Oct. 2019. [Online]. Available: https://scholarship.law.uci.edu/ucilr/vol10/iss1/5 EXTERNAL
- M. Kosinski, D. Stillwell, and T. Graepel, “Private Traits and Attributes Are Predictable From Digital Records of Human Behavior,” Proc. Natl. Acad. Sci., 110(15): 5802–5805, Apr. 2013. [Online]. Available: https://doi.org/10.1073/pnas.1218772110 EXTERNAL
- P. Ekman and W. V. Friesen, “Measuring Facial Movement,” Environ. Psychol. Nonverb. Behav., 1(1): 56–75, 1976. [Online]. Available: https://doi.org/10.1007/BF01115465 EXTERNAL
- M. Dawson, A. Schell, and D. Filion, The Electrodermal System, Cambridge University Press: Cambridge, U.K., 2000. [Online]. Available: https://doi.org/10.1017/CBO9780511546396.007 EXTERNAL
- M. Benedek and C. Kaernbach, “A Continuous Measure of Phasic Electrodermal Activity,” J. Neurosci. Methods., 190(1): 80–91, Jun. 2010. [Online]. Available: https://doi.org/10.1016/j.jneumeth.2010.04.028 EXTERNAL
- R. Edelberg, “Electrical Properties of the Skin,” Methods in Psychophysiology, Williams and Wilkins: Baltimore, MD, pp. 1–53, 1967. EXTERNAL
- S. Stöckli, M. Schulte-Mecklenbeck, S. Borer, and A. Samson, “Facial Expression Analysis With AFFDEX and FACET: A Validation Study,” Behav. Res. Methods, 50, Dec. 2017. [Online]. Available: https://doi.org/10.3758/s13428-017-0996-1 EXTERNAL
- S. J. Elliott, S. A. Massie, and M. J. Sutton, “The Perception of Biometric Technology: A Survey,” 2007 IEEE Workshop on Automatic Identification Advanced Technologies, pp. 259–264, June 2007. [Online]. Available: https://ieeexplore.ieee.org/abstract/document/4263251 EXTERNAL
- M. van Dooren, J. J. G. (Gert-Jan) de Vries, and J. H. Janssen, “Emotional Sweating Across the Body: Comparing 16 Different Skin Conductance Measurement Locations,” Physiol. Behav., 106(2): 298–304, May 2012. [Online]. Available: https://doi.org/10.1016/j.physbeh.2012.01.020 EXTERNAL
- E. E. Smith, S. J. Reznik, J. L. Stewart, and J. J. B. Allen, “Assessing and Conceptualizing Frontal EEG Asymmetry: An Updated Primer on Recording, Processing, Analyzing, and Interpreting Frontal Alpha Asymmetry,” Int. J. Psychophysiol., 111: 98–114, Jan. 2017. [Online]. Available: https://doi.org/10.1016/j.ijpsycho.2016.11.005 EXTERNAL
- F. Shaffer and J. P. Ginsberg, “An Overview of Heart Rate Variability Metrics and Norms,” Front. Public Health, 5: 258, 2017. [Online]. Available: https://doi.org/10.3389/fpubh.2017.00258 EXTERNAL
- S. Gerster, B. Namer, M. Elam, and D. R. Bach, “Testing a Linear Time Invariant Model for Skin Conductance Responses by Intraneural Recording and Stimulation,” Psychophysiology, 55(2): e12986, 2018. [Online]. Available: https://doi.org/10.1111/psyp.12986 EXTERNAL
- C. Nebeker, J. Harlow, R. E. Giacinto, R. Orozco-Linares, EXTERNAL
- A. Malliani, M. Pagani, F. Lombardi, and S. Cerutti, “Cardiovascular Neural Regulation Explored in the Frequency Domain,” Circulation, 84(2): 482–492, Aug. 1991. [Online]. Available: https://doi.org/10.1161/01.cir.84.2.482 EXTERNAL
- W. Boucsein, Electrodermal Activity. 2nd ed., Springer, 2012 . EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2022.3146520.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Clayton P. Mosher and Brian Wellner; Biometric Signals Reveal How Audiences Engage With Stories, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3146520
Snippet:
Clayton P. Mosher and Brian Wellner; Biometric Signals Reveal How Audiences Engage With Stories, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3146520
HTML (ISO 690 compliant)
Preview:
Clayton P. Mosher and Brian Wellner; Biometric Signals Reveal How Audiences Engage With Stories, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3146520
Snippet:
<span class="citation">Clayton P. Mosher and Brian Wellner; <cite>Biometric Signals Reveal How Audiences Engage With Stories</cite>, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022); SMPTE, 2022. Available at <a href="https://doi.org/10.5594/JMI.2022.3146520" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2022.3146520</a></span>
SMPTE's HTML Pub
Preview:
Clayton P. Mosher and Brian Wellner; Biometric Signals Reveal How Audiences Engage With Stories, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022); SMPTE, 2022
doi: 10.5594/JMI.2022.3146520
url: https://doi.org/10.5594/JMI.2022.3146520
doi: 10.5594/JMI.2022.3146520
url: https://doi.org/10.5594/JMI.2022.3146520
Snippet:
<li> Clayton P. Mosher and Brian Wellner; <cite id="bib-10-5594-jmi-2022-3146520">Biometric Signals Reveal How Audiences Engage With Stories</cite>, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 2, March 2022); SMPTE, 2022 <span class="doi">10.5594/JMI.2022.3146520</span> </li>