Video Production with Generative AI
Metadata
- Publisher
- SMPTE
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Motion Imaging Jour.
- Volume
- 134, No. 2, pp. 37–42
- Abstract
- There are many kinds of Generative AI (GenAI) models, from audio to text generation models. However, video generation models (VGMs) are foundational for video production and are gaining importance as their expressiveness increases. VGMs differ from other GenAI models in that VGM users must have domain-specific knowledge to leverage VGMs to express their artistic vision optimally. Specifically, it can be demonstrated that VGM users must know the basics of the visual language of cinematography to translate their creative vision into quality output correctly. Prompt engineering is used to craft VGM output into something useful and aesthetically viable. Using prompt engineering, it is possible to ask a VGM to instantiate the basic elements of cinematography, such as camera placement, camera movement, shot composition, shot size, focus/depth of field, and lighting. Besides VGMs, other GenAI models are useful for pre-and post-production tasks.
- Publication Date
- 2025-04-01
- DOI
10.5594/JMI.2025/GGBP2184- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2025/GGBP2184
- Author(s)
- Brent Rabowsky
- Keyword(s)
- Generative AI, GenAI, Video Generation, Prompt Engineering
- Copyright
- © 2025 SMPTE
Bibliographic Reference(s)
- T. Maglio, “Sony Will Use AI to Cut Film Costs, Says CEO Tony Vinciquerra,” IndieWire, 30 May 2024. [Online]. Available: https://www.indiewire.com/news/breaking-news/sony-pictures-will-cut-film-costs-using-ai-1235010605/. [Accessed: 3 Aug. 2024]. EXTERNAL
- N. Magoon, “Tech in Content Production: Will AI Kill the Video Star?,” Bain & Company, 28 Sept 2023. [Online]. Available: https://www.bain.com/insights/tech-in-content-production-will-AI-kill-the-video-star/. [Accessed: 3 Aug. 2024]. EXTERNAL
- B. Rabowsky, “Applications of Generative AI to Media,” SMPTE Mot. Imag. J., 132 (8): 53–57, Sep. 2023. DOI: https://www.doi.org/10.5594/JMI.2023.3297238. EXTERNAL
- A. Still, “Bringing generative AI to video editing workflows in Adobe Premiere Pro,” Adobe Blog, 15 Apr. 2024. [Online]. Available: https://blog.adobe.com/en/pub-lish/2024/04/15/bringing-gen-ai-to-video-editing-workflows-adobe-premiere-pro. [Accessed: 4 Aug. 2024]. EXTERNAL
- M. Seymour, “Actually Using SORA,” fxguide, 14 Apr. 2024. [Online]. Available: https://www.fxguide.com/fxfeatured/actually-using-sora/. [Accessed: 4 Aug. 2024]. EXTERNAL
- M. Seymour, “1st SORA music video,” fxguide, 8 May 2024. [Online]. Available: https://www.fxguide.com/fxfeatured/1st-sora-music-video-how-sora-is-evolving-guessing-possible-pricing/. [Accessed: 4 Aug. 2024]. EXTERNAL
- E. David, “Toys R Us unveils first commercial made with OpenAI's Sora,” Venture-Beat, 25 Jun. 2024. [Online]. Available: https://venturebeat.com/ai/toys-r-us-un-veils-first-commercial-made-with-openais-sora/. [Accessed: 11 Aug. 2024]. EXTERNAL
- Y. Zhang, “ControlVideo: Training-free Controllable Text-to-Video Generation,” arXiv:2305.13077, May 2023 [Online]. Available: https://arxiv.org/abs/2305.13077. [Accessed: 14 Jul. 2024]. EXTERNAL
- A. Blattmann, “Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets,” arXiv:2311.15127, Nov. 2023 [Online]. Available: https://arxiv.org/abs/2377.75727. [Accessed: 10 Aug. 2024]. EXTERNAL
- A. Schomer, “How Much Should AI Giants Pay Hollywood?” Variety, 21 Aug. 2024. [Online]. Available: https://variety.com/vip/ai-licensing-training-studios-holly-wood-content-film-tv-1236112960/. [Accessed: 22 Aug. 2024]. EXTERNAL
- A. Weprin, “Lionsgate Inks Deal With AI Firm to Mine Its Massive Film and TV Library,” The Hollywood Reporter, 18 Sep. 2024. [Online]. Available: https://www.hollywoodreporter.com/business/business-news/lionsgate-deal-ai-firm-run-way-1236005554/. [Accessed: 24 Sep. 2024]. EXTERNAL
- J. Alton, Painting with Light, Macmillan: New York, NY, 1949. EXTERNAL
- B. Brown, Cinematography: Theory and Practice, Focal Press: New York, NY, 2002. EXTERNAL
- Amazon.com, Inc., “Amazon Ads launches a new AI Video generator-here's your first look at the beta,” [Online]. Available: https://www.aboutamazon.com/news/innovation-at-amazon/amazon-ads-generative-ai-video-generator-advertisers. [Accessed: 24 Sep. 2024]. EXTERNAL
- Runway AI, Inc., “Gen-3 Alpha Prompting Guide,” [Online]. Available: https://help.runwayml.com/hc/en-us/articles/30586818553107-Gen-3-Alpha-Prompting-Guide. [Accessed: 12 Aug. 2024]. EXTERNAL
- G. Chen, “VideoLLM: Modeling Video Sequence with Large Language Models,” arXiv:2305.13292, May 2023 [Online]. Available: https://arxiv.org/abs/2305.13292. [Accessed: 17 Aug. 2024]. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2025-GGBP2184.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Brent Rabowsky; Video Production with Generative AI, MIJ 2025, Volume 134, Number 2 (pp. 37 to 42); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/GGBP2184
Snippet:
Brent Rabowsky; Video Production with Generative AI, MIJ 2025, Volume 134, Number 2 (pp. 37 to 42); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/GGBP2184
HTML (ISO 690 compliant)
Preview:
Brent Rabowsky; Video Production with Generative AI, MIJ 2025, Volume 134, Number 2 (pp. 37 to 42); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/GGBP2184
Snippet:
<span class="citation">Brent Rabowsky; <cite>Video Production with Generative AI</cite>, MIJ 2025, Volume 134, Number 2 (pp. 37 to 42); SMPTE, 2025. Available at <a href="https://doi.org/10.5594/JMI.2025/GGBP2184" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2025/GGBP2184</a></span>
SMPTE's HTML Pub
Preview:
Brent Rabowsky; Video Production with Generative AI, MIJ 2025, Volume 134, Number 2 (pp. 37 to 42); SMPTE, 2025
doi: 10.5594/JMI.2025/GGBP2184
url: https://doi.org/10.5594/JMI.2025/GGBP2184
doi: 10.5594/JMI.2025/GGBP2184
url: https://doi.org/10.5594/JMI.2025/GGBP2184
Snippet:
<li> Brent Rabowsky; <cite id="bib-10-5594-jmi-2025-ggbp2184">Video Production with Generative AI</cite>, MIJ 2025, Volume 134, Number 2 (pp. 37 to 42); SMPTE, 2025 <span class="doi">10.5594/JMI.2025/GGBP2184</span> </li>