MSU 3D-video Quality Analysis

Video Quality Measurement Tool 3D Project

MSU Graphics & Media Lab (Video Group)

Projects, ideas: Dr. Dmitriy Vatolin

Implementation: Alexander Voronov, Denis Sumin, Marat Arsaev, Vyacheslav Napadovsky, Alexander Bokov, Alexey Fedorov, Alexander Belous, Alexey Shalpegin, Vladimir Yanushkovsky, Sergey Lavrushkin

In cooperation with IITP RAS: Prof. Galina Rozhkova

November 1, 2020: Report #10 released!


Introduction


VQMT3D (Video Quality Measurement Tool 3D) project was created to improve stereoscopic films. Our aim is to help filmmakers produce high-quality 3D video by finding inexpensive ways of automatically enhancing film quality.

VQMT3D project is currently being developed. On this page we will collect recent information about the project.


List of Metrics


We have developed metrics for all kinds of stereoscopic video. The following metrics are in use:

Metric Class Type Applicable to
Horizontal disparity Standard Quantitative Any content
Vertical parallax Standard Quantitative Any content
Scale mismatch Standard Quantitative Any content
Rotation mismatch Standard Quantitative Any content
Color mismatch Standard Quantitative Any content
Sharpness mismatch Advanced Quantitative Native 3D capture
Stereo window violation Advanced Quantitative Any content
Crosstalk noticeability Advanced Quantitative Any content
Depth continuity Advanced Quantitative Any content
Cardboard effect Advanced Qualitative 2D-to-3D conversion
Edge-sharpness mismatch Unique Qualitative 2D-to-3D conversion
Channel mismatch Unique Qualitative Any content
Temporal asynchrony Unique Quantitative Native 3D capture
Stuck-to-background objects Unique Qualitative 2D-to-3D conversion
Classification by production type Unique Qualitative Any content
Comparison with the 2D version Unique Qualitative 2D-to-3D conversion

Visualizations of detected problems enable a possibility of clear stereoscopic problem understanding with just one picture. The following pictures are examples of found problems and of these visualizations, too.


An example of detected strong horizontal disparity. Frame #22030 from Galapagos: The Enchanted Voyage


An example of detected vertical disparity. Frame #19105 from Galapagos: The Enchanted Voyage


An example of detected color mismatch. Frame #53725 from Galapagos: The Enchanted Voyage


An example of detected sharpness mismatch. Frame #25100 from Galapagos: The Enchanted Voyage


Reports overview


Report 1 (S3D shooting quality analysis of 5 movies)

Release date: March 7, 2013

Download (Additional info for bloggers and press)

Pages: 246;   Figures: 295

Film list:

  • Pirates of the Caribbean: On Stranger Tides
  • Resident Evil: Afterlife
  • Step Up 3D
  • Galapagos: The Enchanted Voyage
  • Into the Deep

Film list:

  • Dolphin Tale
  • Drive Angry
  • Hugo
  • The Three Musketeers
  • Sanctum

Film list:

  • Alice in Wonderland
  • Clash of the Titans
  • Conan the Barbarian
  • Green Lantern
  • Abraham Lincoln: Vampire Hunter

Report 4 (S3D shooting quality analysis of 5 movies)

Release date: October 1, 2013

Download

Pages: 301;   Figures: 402

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Pina
  • Step Up Revolution
  • Resident Evil 5: Retribution
  • The Amazing Spider-Man

Film list:

  • The Avengers
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Gulliver’s Travels
  • Immortals
  • Wrath of the Titans

Report 6 (Stereo Window analysis of 10 movies)

Release date: September 10, 2014

Download (Additional info for bloggers and press)

Pages: 415;   Figures: 455

Film list:

  • The Amazing Spiderman
  • The Three Musketeers
  • Pirates of the Caribbean: On Stranger Tides
  • Dolphin Tale
  • Drive Angry
  • The Avengers
  • John Carter
  • G-Force
  • Abraham Lincoln: Vampire Hunter
  • Clash of the Titans

Report 7 (Stereo Window analysis of 10 movies)

Release date: October 22, 2014

Download (Additional info for bloggers and press)

Pages: 333;   Figures: 348

Film list:

  • Pina
  • Step Up Revolution
  • Resident Evil: Retribution
  • Hugo
  • Immortals
  • A Very Harold & Kumar 3D Christmas
  • Green Lantern
  • Conan the Barbarian
  • Wrath of the Titans
  • Alice in Wonderland

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Abraham Lincoln: Vampire Hunter
  • The Avengers
  • Alice in Wonderland
  • Conan the Barbarian
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Clash of the Titans
  • Drive Angry
  • Dolphin Tale
  • Galapagos: The Enchanted Voyage
  • Green Lantern
  • Gulliver's Travels
  • Hugo
  • Immortals
  • Into the Deep
  • Pirates of the Caribbean: On Stranger Tides
  • Pina
  • Resident Evil: Afterlife
  • Resident Evil: Retribution
  • Sanctum
  • Step Up 3D
  • Step Up Revolution
  • The Amazing Spider-Man
  • The Three Musketeers
  • Wrath of the Titans

Over 100 films are in film list, including:

  • Creature from the Black Lagoon (1954)
  • World War Z (2013)
  • Dredd (2012)
  • Thor (2011)
  • The Hobbit: An Unexpected Journey (2012)
  • Life of Pi (2012)
  • Oz the Great and Powerful (2013)
  • The Legend of Hercules (2014)
  • Men in Black 3 (2012)
  • Dial M for Murder (1954)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Last Airbender (2010)
  • TRON: Legacy (2010)
  • Jack the Giant Slayer (2013)
  • The Great Gatsby (2013)
  • Pacific Rim (2013)
  • The Avengers (2012)

Report 10 (Overall analysis of 105 movies)

Release date: November 1, 2020

Download

Pages: 211;   Figures: 270

105 films are in film list, including:

  • Gravity (2013)
  • The Great Gatsby (2013)
  • Oz the Great and Powerful (2013)
  • Stalingrad (2013)
  • Iron Man 3 (2013)
  • Man of Steel (2013)
  • Pacific Rim (2013)
  • Jack the Giant Slayer (2013)
  • The Hobbit: An Unexpected Journey (2012)
  • The Legend of Hercules (2014)
  • Alice in Wonderland (2010)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Avengers (2012)
  • The Amazing Spiderman (2012)
  • World War Z (2013)
  • Thor (2011)
  • The Last Airbender (2010)
  • Life of Pi (2012)
  • TRON: Legacy (2010)
  • Hugo (2011)

Report 11 (Overall analysis of 10 selected Chinese movies)

Approximate release date: 2021

The film list includes 10 Chinese movies


Publications


When you want to make a reference to this project, please refer one of the following publications:

  1. Mikhail Erofeev, Dmitriy Vatolin, Alexander Voronov, Alexey Fedorov,
    “Toward an Objective Stereo-Video Quality Metric: Depth Perception of Textured Areas,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615120
  2. D. Akimov, A. Shestov, A. Voronov, D. Vatolin,
    “Automatic Left-Right Channel Swap Detection,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615126
  3. A. Voronov, A. Borisov, D. Vatolin,
    “System for Automatic Detection of Distorted Scenes in Stereo Video,” [pdf]
    Proceedings of the Sixth International Workshop on Video Processing and Quality Metrics (VPQM),
    2012.
  4. A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, A. Borisov,
    “Towards Automatic Stereo-video Quality Assessment and Detection of Color and Sharpness Mismatch,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615121
  5. A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, and A. Borisov,
    “Methodology for stereoscopic motion-picture quality assessment,” [pdf]
    Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV,
    vol. 8648, pp. 864810-1–864810-14, March 2013. doi:10.1117/12.2008485
  6. A. Bokov, D. Vatolin, A. Zachesov, A. Belous, and M. Erofeev,
    “Automatic detection of artifacts in converted S3D video,” [pdf]
    Proc. SPIE 9011, Stereoscopic Displays and Applications XXV,
    vol. 9011, pp. 901112-1–901112-14, March 2014. doi:10.1117/12.2054330

Acknowledgments


We wish to acknowledge the help provided by CMC Faculty of Lomonosov Moscow State University.
CMC Faculty provided us with extra computational capabilities and disk space which was needed for our research.

This work is partially supported by the Intel/Cisco Video Aware Wireless Network (VAWN) Program and by grant 10-01-00697a from the Russian Foundation for Basic Research.


Invitation to the Project


We invite stereographers, researchers and proofreaders to join our 3D-film analysis project. We are open for collaboration and appreciate your ideas and contributions. We love to receive feedback and learn from the experience of people in the film-production industry.

If you would like to participate, please contact us: .

Stereographers

Currently, we are preparing our first reports on stereo-video quality of full-length films. We invite professional stereographers to comment on our reports. Our expertise is in research and in creating metrics, but the causes of some artifacts may be unclear for us. Analyzing these causes and estimating the severity of artifacts are a crucial part of our reports, so we welcome expert comments on these issues.

Every comment in the final report will be attributed to its respective author. We expect that some people will select comments of a concrete author, and we wish that your comments will be selected. Our hope is that these comments will all be beneficial for our readers.

If you are currently working on a film project, you may be interested in discussing the possibility of analyzing your film, or some portion thereof, before its release to help improve its 3D quality.

Researchers

Researchers working on stereoscopic quality assessment are welcome to collaborate with us on our project. We can run your algorithms on huge amounts of data and jointly publish the results.

We have developed a system to calculate metrics for full-length films. These metrics are loaded into the system as plug-ins, and our SDK for creating metrics is available on request. Thus, researchers need only provide binariesalgorithms and source code can remain confidential.

Calculations for one film take about a week (this estimate is for a full-length film, with calculations performed using three computers). GPGPU acceleration (CUDA or OpenCL) is available.

For researchers who would like to participate, we recommend sending us metrics that are already or soon to be published. Inclusion in our report may increase your citation index and the reputation of your work among experts. We can provide raw results from your metric for in-depth analysis or for use in literature. If your metric turns out to be useful, we will gladly include your results in our film comparison.

Proofreaders

We welcome readers who have strong English skills or who can help improve the clarity of our literature.

Any reader that offers numerous constructive comments on how to fix errors or otherwise improve the report will be included in the authors list. Everyone who help us improve our reports will be mentioned in the acknowledgments section.

Most importantly, proofreaders who are willing to help us improve our reports will be among the first to receive draft versions (under the condition of a signed nondisclosure agreement).


Contacts


For questions and proposition please contact us  

Video resources:

Last updated: 12-May-2022


Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab