SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023)
[ACTIVE]
Applications of Generative AI to Media
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 132, No. 8, pp. 53–57
- Abstract
- When ChatGPT was released in November 2022, the public became aware of a new era of artificial intelligence (AI) built on a class of machine learning models known as foundation models (FMs). Although FMs burst upon the scene seemingly without precedent, the roots of FMs go back several years earlier. A key distinguishing factor of FMs versus older models is their powerful applications to Generative AI (GenAI), the use of models to generate new content and transform existing content. GenAI models tend to be general-purpose and more flexible than previous kinds of AI models, which are limited to specific predictive tasks such as object detection in images, text classification, forecasting, or detecting data anomalies. Although there were some other kinds of GenAI models before the rise of FMs, FMs are much more powerful and are an enormous leap over their predecessors.
- Publication Date
- 2023-09-01
- DOI
10.5594/JMI.2023.3297238- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2023.3297238
- Author(s)
- Brent Rabowsky
bio
Brent Rabowsky manages a team of AI/ML consultants at Amazon Web Services (AWS), Seattle, WA, with a focus on media companies. He has over a decade of experience in AI/ML, including work before AWS on conversational AI agents at both a government contractor and a research institute. He also has served as a technical editor for multiple AI/ML books published by O’Reilly Media and Packt Publishing. - Copyright
- © 2023 SMPTE
Bibliographic Reference(s)
- H. Wang, A. Tamrazian, and S. Sarraf, “Enhance Sports Narratives With Natural Language Generation Using Amazon SageMaker,” Amazon Web Services, May 24, 2021. Accessed: May 17, 2023. [Online]. Available: https://aws.amazon.com/blogs/machine-learning/enhance-sports-narratives-with-natu-ral-language-generation-using-amazon-sagemaker/ EXTERNAL
- V. Madan and A. Shen, “Inpaint Images With Stable Diffusion Using Amazon SageMaker JumpStart,” Amazon Web Services, Apr. 10, 2023. Accessed: May 15, 2023. [Online]. Available: https://aws.amazon.com/blogs/machine-learning/inpaint-images-with-stable-diffusion-using-amazon-sagemaker-jumpstart/ EXTERNAL
- N. Popli, “The AI Job That Pays up to $335K—And You Don’t Need a Computer Engineering Background,” Time, Apr. 14, 2023. Accessed: May 17, 2023. [Online]. Available: https://time.com/6272103/ai-prompt-engineer-job/ EXTERNAL
- V. Madan and H. Hotz, “Upscale Images With Stable Diffusion in Amazon SageMaker JumpStart,” Amazon Web Services, Jan. 25, 2023. Accessed: May 15, 2023. [Online]. Available: https://aws.amazon.com/blogs/machine-learning/upscale-images-with-stable-diffusion-in-amazon-sagemaker-jumpstart/ EXTERNAL
- J. Gregory, Game Engine Architecture, AK Peters Ltd.: Wellesley, MA, pp. 491–593, 2009. EXTERNAL
- G. Maddaus, “DGA Delivers Details of Contract Terms on Artificial Intelligence,” Variety, Jun. 7, 2023. Accessed: Jul. 25, 2023. [Online]. Available: https://variety.com/2023/biz/news/dga-details-amptp-1235636942/ EXTERNAL
- P. Lewis et al., “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks,” arXiv:2005.11401, May 2020. Accessed: May 15, 2023. [Online]. Available: https://arxiv.org/abs/2005.11401 EXTERNAL
- R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-Resolution Image Synthesis With Latent Diffusion Models,” Proc. of the IEEE/CVF Conf. on Comput. Vision and Pattern Recognit., 2022. Accessed: May 16, 2023. [Online]. Available: https://openaccess.thecvf.com/content/CVPR2022/html/Rombach _ High-Resolution _ Image_ Synthesis _With _ Latent_Diffusion_Models_CVPR_2022_paper.html EXTERNAL
- “Copyright Registration Guidance: Works Containing Material Generated by Artificial Intelligence,” Copyright Office, Mar. 16, 2023. Accessed: May 02, 2023. [Online]. Available: https://www.federalregister.gov/documents/2023/03/16/2023-05321/copyright-registration-guidance-works-containing-material-gen-erated-by-artificial-intelligence EXTERNAL
- A. Ramesh, P. Dhariwal, A. Nichol, C. Chu, and M. Chen, “Hierarchical Text-Conditional Image Generation With CLIP Latents,” OpenAI, 2022. Accessed: May 16, 2023. [Online]. Available: https://arxiv.org/abs/2204.06125 EXTERNAL
- Y. Zhang, Y. Wei, D. Jiang, X. Zhang, W. Zuo, and Q. Tian, “ControlVideo: Training-Free Controllable Text-to-Video Generation,” arXiv:2305.13077, May 2023. Accessed: May 30, 2023. [Online]. Available: https://arxiv.org/abs/2305.13077 EXTERNAL
- H. Jun and A. Nichol, “Shap-E: Generating Conditional 3D Implicit Functions,” arXiv:2305.02463, May 2023. Accessed: May 30, 2023. [Online]. Available: https://arxiv.org/abs/2305.02463 EXTERNAL
- A. Vaswani et al., “Attention is All You Need,” Proc. of the 31st Int. Conf. on Neural Inf. Process. Syst., pp. 6000–6010, Dec. 2017. Accessed: May 16, 2023. [Online]. Available: https://arxiv.org/abs/1706.03762 EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2023.3297238.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Brent Rabowsky; Applications of Generative AI to Media, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3297238
Snippet:
Brent Rabowsky; Applications of Generative AI to Media, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3297238
HTML (ISO 690 compliant)
Preview:
Brent Rabowsky; Applications of Generative AI to Media, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3297238
Snippet:
<span class="citation">Brent Rabowsky; <cite>Applications of Generative AI to Media</cite>, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023); SMPTE, 2023. Available at <a href="https://doi.org/10.5594/JMI.2023.3297238" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2023.3297238</a></span>
SMPTE's HTML Pub
Preview:
Brent Rabowsky; Applications of Generative AI to Media, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023); SMPTE, 2023
doi: 10.5594/JMI.2023.3297238
url: https://doi.org/10.5594/JMI.2023.3297238
doi: 10.5594/JMI.2023.3297238
url: https://doi.org/10.5594/JMI.2023.3297238
Snippet:
<li> Brent Rabowsky; <cite id="bib-10-5594-jmi-2023-3297238">Applications of Generative AI to Media</cite>, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 8, September 2023); SMPTE, 2023 <span class="doi">10.5594/JMI.2023.3297238</span> </li>