Movie Gen 是一系列基礎模型,可產生具有不同寬高比和同步音訊的高品質 1080p 高清視訊。在這裡,我們介紹一下我們的評估基準“Movie Gen Bench”,其中包括Movie Gen Video Bench(第3.5.2節)和Movie Gen Audio Bench(第6.3.2節),詳情請參閱Movie Gen技術報告。
為了能夠在這些評估基準上與 Movie Gen 進行公平、輕鬆的比較,我們也在 Movie Gen Video Bench 和 Movie Gen Audio Bench 上發布了 Movie Gen 的非精選生成影片。
Movie Gen Video Bench 包含 1003 個提示,涵蓋所有不同的測驗面向/概念:
除了全面涵蓋不同關鍵測試環節外,提示同時對高/中/低運動等級也有很好的覆蓋。
提示清單benchmark/MovieGenVideoBench.txt
包含在此儲存庫中,我們也在benchmark/MovieGenVideoBenchWithTag.csv
v. 中發布了每個提示的測試概念和運動等級標籤。相應產生的影片(由 Movie Gen)可以透過此連結下載。
Movie Gen Video Bench 也可在 Hugging Face 上使用。
Movie Gen Audio Bench 包含 527 個產生的影片以及相關的音效和音樂提示
benchmark/MovieGenAudioBenchSfx.jsonl
包含用於音效產生的音效提示,以及用於產生測試影片的影片提示。可以透過此連結下載帶有音訊和提示的影片。
benchmark/MovieGenAudioBenchSfxMusic.jsonl
包含用於聯合音效和背景音樂產生的音效和音樂提示,以及用於產生測試影片的影片提示。可以透過此連結下載帶有音訊和提示的影片。
該模型根據 CC-BY-NC 授權
如果您發現 Movie Gen Bench 有用,請考慮引用:
@misc{polyak2024moviegencastmedia,
title={Movie Gen: A Cast of Media Foundation Models},
author={Adam Polyak and Amit Zohar and Andrew Brown and Andros Tjandra and Animesh Sinha and Ann Lee and Apoorv Vyas and Bowen Shi and Chih-Yao Ma and Ching-Yao Chuang and David Yan and Dhruv Choudhary and Dingkang Wang and Geet Sethi and Guan Pang and Haoyu Ma and Ishan Misra and Ji Hou and Jialiang Wang and Kiran Jagadeesh and Kunpeng Li and Luxin Zhang and Mannat Singh and Mary Williamson and Matt Le and Matthew Yu and Mitesh Kumar Singh and Peizhao Zhang and Peter Vajda and Quentin Duval and Rohit Girdhar and Roshan Sumbaly and Sai Saketh Rambhatla and Sam Tsai and Samaneh Azadi and Samyak Datta and Sanyuan Chen and Sean Bell and Sharadh Ramaswamy and Shelly Sheynin and Siddharth Bhattacharya and Simran Motwani and Tao Xu and Tianhe Li and Tingbo Hou and Wei-Ning Hsu and Xi Yin and Xiaoliang Dai and Yaniv Taigman and Yaqiao Luo and Yen-Cheng Liu and Yi-Chiao Wu and Yue Zhao and Yuval Kirstain and Zecheng He and Zijian He and Albert Pumarola and Ali Thabet and Artsiom Sanakoyeu and Arun Mallya and Baishan Guo and Boris Araya and Breena Kerr and Carleigh Wood and Ce Liu and Cen Peng and Dimitry Vengertsev and Edgar Schonfeld and Elliot Blanchard and Felix Juefei-Xu and Fraylie Nord and Jeff Liang and John Hoffman and Jonas Kohler and Kaolin Fire and Karthik Sivakumar and Lawrence Chen and Licheng Yu and Luya Gao and Markos Georgopoulos and Rashel Moritz and Sara K. Sampson and Shikai Li and Simone Parmeggiani and Steve Fine and Tara Fowler and Vladan Petrovic and Yuming Du},
year={2024},
eprint={2410.13720},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2410.13720},
}