Spaces:
Running
video to video
Hiii, looks amazing Minette! I still don't know how to comment on the exact line for huggingface PRs, so I am going to put all of my comments here:
1 We called the video dataset "video editing dataset", should we have a little more informative name for it? Like Pruna Internal Video-edit Benchmark or something similar?
2 Similarly, in the explanation part for the dataset, we can give a little more information. We can say that this is our internal benchmarking dataset that was collected by our research engineers and it has data from various video-editing benchmarks as well as use case examples we collected for various use cases that include but not limited to advertisement, e-commerce, real estate, concept art, etc. We also have scenarios considering camera angle movement changes and different lighting scenarios, text in video (altering / adding / removing it).
3 I think we should rename the "elo" column to "Datapoint Elo" in the leaderboard
4 I think we can remove the "generations" column from the leaderboard
5 Can we rename the price per video column to price per second of video? I know it's super long but I think it's more accurate.
6 Again super nitpicky but can we rename the "seconds for 1s of video" to something like "generation time per second of video" (I also don't like this so much lol) or something like that? I would prefer if this column is before the min / median time columns because I think for video generation it is much more informative then the min / median time as the time of the generated video affects the generation time directly.
Thank you so much!!! Everything in the UI looks so good and works super smoothly, and paretos look amazing so I don't have any notes on display and the mechanisms of the space itself. I think one more iteration and we can immediately merge it <3