AI Assistants in Media Production and Management: A Survey of Workflow Optimizations for Enhancing Creativity

Bibliographic Reference(s)

• B. Rathore, “Future of AI & generation alpha: ChatGPT beyond boundaries,” Eduzone: Int. Peer Reviewed/Refereed Multidisciplinary J., 12 (1): 63–68, 2023. EXTERNAL
• R. Gonsalves, “ML-Based Indexing of Media Libraries for Insights and Search,” presented at the SMPTE 2022 Media Technology Summit, Hollywood, CA, Oct. 2022. EXTERNAL
• Y. Liu, “Summary of CHATGPT/gpt-4 Research and Perspective Towards the Future of Large Language Models,” Aug. 2023. [Online]. Available: arXiv preprint arXiv:2304.01852. EXTERNAL
• D. Keller, “Computational Creativity in Media Production: At the Crossroad of Progress and Peril,” MS thesis, The University of Bergen, 2023. EXTERNAL
• A. Upadhyay, “A Tutorial Guide to Using the Function Call Feature of OpenAI's ChatGPT API,” Confessions of a Code Addict, June 2023. [Online]. Available: https://codeconfessions.substack.com/p/creating-chatgpt-plugins-using-the. EXTERNAL
• A. Samim, “A New Paradigm of Artificial Intelligence to Disabilities,” Int. J. of Science and Research (IJSR), 12 (1): 478–482, 2023. EXTERNAL
• J. Wehrmann, “Language-Agnostic Visual-semantic Embeddings,” Proc. IEEE/CVF Int. Conf. on Computer Vision, pp. 5804–5813, 2019. EXTERNAL
• A. Radford, “Learning Transferable Visual Models from Natural Language Supervision,” Int. Conf. on Machine Learning (PMLR), Feb. 2021. EXTERNAL
• M. Cherti, “Reproducible Scaling Laws for Contrastive Language-Image Learning,” Proc. IEEE/CVF Conf. on Computer Vision and Pattern Recognition, pp. 2818–2829, Jun. 2023. EXTERNAL
• Z. Sun, “Alpha-CLIP: A CLIP Model Focusing on Wherever You Want,” Dec. 2023. [Online] Available: arXiv preprint arXiv:2312.03818. EXTERNAL
• R. Anil, “Gemini: A Family of Highly Capable Multimodal Models,” Dec. 2023. [Online] Available: arXiv preprint arXiv:2312.11805. EXTERNAL
• R. Luo, “Valley: Video Assistant with Large Language Model Enhanced Ability,” Jun. 2023. [Online]. Available: arXiv preprint arXiv:2306.07207. EXTERNAL
• H. Touvron, “Llama 2: Open Foundation and Fine-Tuned Chat Models,” Jul. 2023. [Online]. Available: arXiv preprint arXiv:2307.09288. EXTERNAL
• A. Radford, “Improving language understanding by generative pre-training,” 2018. [Online]. Available: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf. EXTERNAL
• T. Brown, “Language models are few-shot learners,” Advances in Neural Inform. Process. Sys., 33: 1877–1901, 2020. EXTERNAL
• L. Ouyang, “Training language models to follow instructions with human feedback,” Advances in Neural Information Processing Systems, 35: 27730–27744, Mar. 2022. EXTERNAL
• H. Touvron, “LLaMa: Open and Efficient Foundation Language Models,” Feb. 2023. [Online]. Available: arXiv preprint arXiv:2302.13971. EXTERNAL
• T. J. Park, “A Review of Speaker Diarization: Recent Advances with Deep Learning,” Computer Speech & Language, 72: 101317, 2022. EXTERNAL
• A. Radford, “Robust Speech Recognition via Large-Scale Weak Supervision,” presented at the Int. Conf. on Machine Learning, PMLR 202:28492–28518, 2023. EXTERNAL
• Y. Zhang, “Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages,” 2023. [Online]. Available: arXiv preprint arXiv:2303.01037. EXTERNAL
• V. Pratap, “Scaling speech technology to 1,000+ Languages,” May 2023. [Online]. Available: arXiv preprint arXiv:2305.13516. EXTERNAL
• H. Zhao, “Convolutional-Recurrent Neural Networks for Speech Enhancement,” Presented at the 2018 IEEE Int. Conf. Acoustics, Speech and Signal Process. (ICASSP), Apr. 2018. EXTERNAL
• G. Micchi, M. Gotham, and M. Giraud, “Not all roads lead to Rome: Pitch representation and model architecture for automatic harmonic analysis,” Trans. of the Int. Soc. for Music Information Retrieval, 3:42–54, 2020. EXTERNAL
• N. Nápoles López, M. Gotham, and I. Fujinaga, “AugmentedNet: A Roman Numeral Analysis Network with Synthetic Training Examples and Additional Tonal Tasks,” Proc. of the 22nd Int. Soc. for Music Information Retrieval Conf., pp. 404–411, Nov. 2021. EXTERNAL
• Microsoft, “Azure OpenAI Service - Documentation, quickstarts, API reference.” July 2023. [Online]. Available: https://learn.microsoft.com/en-us/azure/ai-services/openai/quickstart. EXTERNAL
• K. Schwab, “The Daunting Task of Making AI Funny,” Fast Company, Dec. 2016. EXTERNAL
• F. Kruek, “AudioGen: Textually Guided Audio Generation,” [Online]. Available: arXiv preprint arXiv:2209.15352, Sep. 2022. EXTERNAL
• J. Thickstun, D. Hall, C. Donahue, and P. Liang, “Anticipatory Music Transformer,” [Online]. Available: arXiv, Jun. 14, 2023. doi:10.48550/arXiv.2306.08620. EXTERNAL
• C.-Z. A. Huang,, “Music Transformer,” [Online]. Available: arXiv, Dec. 12, 2018. doi:10.48550/arXiv.1809.04281. EXTERNAL
• G. Hadjeres, F. Pachet, and F. Nielsen, “DeepBach: a steerable model for Bach chorales generation,” Proc. 34th Int. Conf. on Machine Learning (ICML'17), pp. 1362–1371, Aug. 2017. EXTERNAL
• J. Copet, “Simple and Controllable Music Generation,” [Online]. Available: arXiv, Jun. 08, 2023. doi:10.48550/arXiv.2306.05284. EXTERNAL
• P. Dhariwal, H. Jun, C. Payne, J. W. Kim, A. Radford, and I. Sutskever, “Jukebox: A Generative Model for Music,” [Online]. Available: arXiv, Apr. 30, 2020. doi: 10.48550/arXiv.2005.00341. EXTERNAL
• R. Rombach, “High-Resolution Image Synthesis with Latent Diffusion Models,” [Online]. Available: arXiv, Apr. 13, 2022. doi: 10.48550/arXiv.2112.10752. EXTERNAL
• A. Ramesh, P. Dhariwal, A. Nichol, C. Chu, and M. Chen, “Hierarchical Text-Conditionallmage Generation with CLIP Latents,” [Online]. Available: arXiv, Apr. 12, 2022. doi:10.48550/arXiv.2204.06125. EXTERNAL
• “Midjourney Variations,” Mar. 2023. [Online]. Available: https://docs.midjourney.com/docs/quick-start. EXTERNAL
• Y. Liu, “Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models,” Meta-Radiology, (2023): 100017. EXTERNAL
• E. Tabassi, “Artificial Intelligence Risk Management Framework (AI RMF 1.0),” NIST Trustworthy and Responsible AI, National Institute of Standards and Technology, Gaithersburg, MD, [Online]. https://doi.org/10.6028/NIST.AI.100-1, 2023. Available: https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=936225. EXTERNAL
• J. Spataro, “Introducing Microsoft 365 Copilot - your copilot for work,” Mar. 2023. [Online]. Available: https://blogs.microsoft.com/blog/2023/03/16/introducing-microsoft-365-copilot-your-copilot-for-work/. EXTERNAL