Jan De Cock - Measuring live video quality with minimal complexity, now available for everyone! скачать в хорошем качестве

Jan De Cock - Measuring live video quality with minimal complexity, now available for everyone!

We all love video, and we love it even more when the quality of the video is great! To measure that quality, we already have quite some options, and the folks at Netflix did a great job at giving us VMAF. This is all fine and dandy for our VOD colleagues, but what about us, live video engineers? We struggle to optimize every cycle in our live encoders, and spending a full CPU core on metric calculation is just not acceptable -- and not good for business. We spent quite some time figuring out how to simplify this problem. Our marketing people said: "Why don't you use AI"? So we did, and imagine that, in this case it actually worked. We'll forget about all those other projects that got stuck in the trough of AI disillusionment. Turns out that metrics such as SSIM and VMAF can be quite accurately predicted, and by using smart features inside the encoder, this can be done with marginal additional computational complexity. In the talk, we’ll explain how we found a balance between accuracy and complexity of the used features and ML networks. All fine for your encoder you say, but how does that help me? Well, we took on the challenge to show that this approach also works for open-source encoders, with x264 as our first target. And, we’re sharing the code, so you can try it out too! And while we’re eagerly awaiting the 10th Demuxed over the coming months, we’ll also be trying this approach on SVT-AV1. Too early to tell if this attempt will be successful, but we’ll be able to tell you in October, and take you through the process during the talk! This talk was presented at Demuxed 2024, a conference by and for engineers working in video. Every year we host a conference with lots of great new talks like this in San Francisco. Learn more at https://demuxed.com