DEMI: deep video quality estimation model using perceptual video quality dimensions

Saman Zadtootaghaj, Nabajeet Barman, Rakesh Rao, Steve Goering, Maria Martini, Alexander Raake, Sebastian Möeller

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    1 Downloads (Pure)

    Abstract

    Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub.
    Original languageEnglish
    Title of host publicationThis work was supported by the European Union's Horizon 2020 research and innovation programme [grant number: No 871793]. Published in: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), ISBN 9781728193236, ISSN 2163-3517 Organising Body: Institute of Electrical and Electronics Engineers Organising Body: Institute of Electrical and Electronics Engineers
    DOIs
    Publication statusPublished - 22 Sept 2020

    Bibliographical note

    Note: This work was supported by the European Union's Horizon 2020 research and innovation programme [grant number: No 871793].

    Published in: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), ISBN 9781728193236, ISSN 2163-3517

    Organising Body: Institute of Electrical and Electronics Engineers

    Organising Body: Institute of Electrical and Electronics Engineers

    Keywords

    • Computer science and informatics

    Fingerprint

    Dive into the research topics of 'DEMI: deep video quality estimation model using perceptual video quality dimensions'. Together they form a unique fingerprint.

    Cite this