Scene-based Audio Implemented with Higher Order Ambisonics
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 125, No. 9, pp. 16–24
- Abstract
- Scene-based audio uses a sound-field technology called “higher-order ambisonics” (HOA) to create holistic descriptions of both live-captured and artistically created sound scenes that are independent of specific loudspeaker layouts. For efficient representation, the audio can be carried as a set of PCM channels that contain predominant sounds and ambience in separate tracks. Standard audio bandwidth-compression techniques can then be applied to the PCM channels. This approach is in contrast to conventional channel-based sound representations in which one signal is used for each loudspeaker of a target reproduction system, with the implication that upmixing or downmixing is required when loudspeaker configurations other than the intended one are used for actual reproduction. This paper examines how, with scene-based audio, there can be satisfactory reproduction of immersive sound at bitrates corresponding to the equivalent of only six channels, whereas an alternative sound-field method that exclusively employs audio objects typically involves much higher bitrates.
- Publication Date
- 2016-11-01
- DOI
10.5594/JMI.2016.2623398- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2016.2623398
- Author(s)
- Nils PetersDeep SenMoo-Young KimOliver WuebboltS. Merrill Weiss
- Keyword(s)
- Scene-based Audio, Higher-order Ambisonics (HOA), Spatial Audio, Next-Generation Audio, MPEG-H, ATSC 3.0
- Copyright
- © 2016 SMPTE
Bibliographic Reference(s)
- EBU.Tech3364.2014 — EBU Tech 3364, Audio Definition Model, European Broadcasting Union, Geneva, Switzerland, 2014. EXTERNAL
- ISO.23008-3.2015 — ISO/IEC 23008-3:2015, “Information technology -High efficiency coding and media delivery in heterogeneous environments - Part 3: 3D audio,” International Organization for Standardization, 2015. EXTERNAL
- ”Scene based audio: A novel paradigm for immersive and interactive audio user experience,” Qualcomm Technologies, Inc., accessed November, 2016, https://www.qualcomm.com/documents/whitepaper-scene-based-audio-mpeg-h. EXTERNAL
- B. Rafaely, “Plane-wave decomposition of the sound field on a sphere by spherical convolution,” J. Acoust. Soc. Am., 116(4): 2149–57, Oct. 2004. EXTERNAL
- D. Huron, “Voice denumerability in polyphonic music of homogeneous timbres,” Music Perception, 6(4): 361–82, 1989. EXTERNAL
- F. Zotter, M. Frank, and H. Pomberger, “Comparison of energy-preserving and all-round ambisonic decoders,” Proc. German Ann. Con. Acoust. (DAGA), 2013. EXTERNAL
- D. R. Begault, E. M. Wenzel, and M. R. Anderson, “Direct comparison of the impact of head tracking, reverberation, and individualized head-related transfer functions on the spatial perception of a virtual speech source,” J. Audio Eng. Soc., 49(10): 904–16, 2001. EXTERNAL
- V. Pulkki, “Spatial sound reproduction with directional audio coding,” J. Audio Eng. Soc., 55(6): 503–16, June 2007. EXTERNAL
- A. Daniel, R. Nicol, and S. McAdams, “Multichannel audio coding based on minimum audible angles,” Proc. 40th Int. Conf., Spatial Audio, Sense Sound Space, p. 1–10, 2010. EXTERNAL
- M. Kashino and T. Hirahara, “How many concurrent talkers can we hear out,” Proc. Acoust. Soc. Japan, 467–8, 1995. EXTERNAL
- B. Cheng et al., “A general compression approach to multichannel three-dimensional audio,” IEEE Trans. Audio, Speech, Lang. Process., 21(8): 1676–88, 2013. EXTERNAL
- A. Krueger, “Higher order ambisonics relevant architecture,” ISO/MPEG-H Audio – The New Standard for Universal Spatial/3D Audio Coding, 138th AES Convention, Warsaw, PL, 2015. EXTERNAL
- I. Burnett et al., “Encoding higher order ambisonics with AAC,” in Proc. 124th AES Conv., p. 1–8, May 2008. EXTERNAL
- J. Daniel, “Représentation de champs acoustiques, application à la transmission et à la reproduction de scènes sonores complexes dans un contexte multimédia,” Ph.D. dissertation, University of Paris VI, France, 2000. EXTERNAL
- A. J. Heller, E. Benjamin, and R. Lee, “A toolkit for the design of ambisonic decoders,” Proc. Linux Audio Conf., p. 1–12, 2012. EXTERNAL
- V. Pulkki et al., “Parametric spatial audio reproduction with higher-order B-format microphone input,” Proc 134th AES Conv., p. 1–10, 2013. EXTERNAL
- M. Frank, F. Zotter, and A. Sontacchi “Producing 3D audio in ambisonics,” in Proc. 57th Int. AES Conf., The Future of Audio Entertainment Technology – Cinema, Television and the Internet, p. 1–8, 2015. EXTERNAL
- E. Hellerud, A. Solvang, and U. P. Svensson, “Spatial redundancy in higher order ambisonics and its use for lowdelay lossless compression, IEEE Int.” Conf. Acoust., Speech Signal Process. (ICASSP), pp. 269–72, Apr. 2009. EXTERNAL
- M. Noisternig et al., “3D binaural sound reproduction using a virtual ambisonic approach,” Proc. IEEE Int. Symp. Virtual Environments, Human-Comput. Interfaces Meas. Syst. (VECIMS’03), pp. 174–8, Lugano, Switzerland, July 2003. EXTERNAL
- J. Herre et al., “MPEG-H 3D Audio – the new standard for coding of immersive spatial audio,” IEEE J. Selected Topics Signal Process., 9(5): 770–9, Aug 2015. EXTERNAL
- M. A. Poletti, “Three-dimensional surround sound systems based on spherical harmonics,” J. Audio Eng. Soc., 53(11): 1004–25, Nov. 2005. EXTERNAL
- R-REC-BS.2076-0 — ITU-R BS.2076-0 Audio Definition Model, International Telecommunication Union, Geneva, Switzerland, June 2015. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2016.2623398.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Nils Peters, Deep Sen, Moo-Young Kim, Oliver Wuebbolt, and S. Merrill Weiss; Scene-based Audio Implemented with Higher Order Ambisonics, SMPTE Motion Imaging Journal ( Volume: 125, Issue: 9, 2016); SMPTE, 2016. Available at https://doi.org/10.5594/JMI.2016.2623398
Snippet:
Nils Peters, Deep Sen, Moo-Young Kim, Oliver Wuebbolt, and S. Merrill Weiss; Scene-based Audio Implemented with Higher Order Ambisonics, SMPTE Motion Imaging Journal ( Volume: 125, Issue: 9, 2016); SMPTE, 2016. Available at https://doi.org/10.5594/JMI.2016.2623398
HTML (ISO 690 compliant)
Preview:
Nils Peters, Deep Sen, Moo-Young Kim, Oliver Wuebbolt, and S. Merrill Weiss; Scene-based Audio Implemented with Higher Order Ambisonics, SMPTE Motion Imaging Journal ( Volume: 125, Issue: 9, 2016); SMPTE, 2016. Available at https://doi.org/10.5594/JMI.2016.2623398
Snippet:
<span class="citation">Nils Peters, Deep Sen, Moo-Young Kim, Oliver Wuebbolt, and S. Merrill Weiss; <cite>Scene-based Audio Implemented with Higher Order Ambisonics</cite>, SMPTE Motion Imaging Journal ( Volume: 125, Issue: 9, 2016); SMPTE, 2016. Available at <a href="https://doi.org/10.5594/JMI.2016.2623398" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2016.2623398</a></span>
SMPTE's HTML Pub
Preview:
Nils Peters, Deep Sen, Moo-Young Kim, Oliver Wuebbolt, and S. Merrill Weiss; Scene-based Audio Implemented with Higher Order Ambisonics, SMPTE Motion Imaging Journal ( Volume: 125, Issue: 9, 2016); SMPTE, 2016
doi: 10.5594/JMI.2016.2623398
url: https://doi.org/10.5594/JMI.2016.2623398
doi: 10.5594/JMI.2016.2623398
url: https://doi.org/10.5594/JMI.2016.2623398
Snippet:
<li> Nils Peters, Deep Sen, Moo-Young Kim, Oliver Wuebbolt, and S. Merrill Weiss; <cite id="bib-10-5594-jmi-2016-2623398">Scene-based Audio Implemented with Higher Order Ambisonics</cite>, SMPTE Motion Imaging Journal ( Volume: 125, Issue: 9, 2016); SMPTE, 2016 <span class="doi">10.5594/JMI.2016.2623398</span> </li>