Witbe QoE Snapshot - A look at the Quality of Experience of Google’s cloud gaming platform: Stadia.
Introduction & Setup
- Availability: percentage of sessions for which the Stadia platform was accessible.
- Login: percentage of sessions for which login was successful.
- Login time: time between the robot clicking on the login button (after credentials were input) and it being logged-in.
- Game Availability: percentage of sessions for which the game successfully started.
- Game launch time: time between the robot launching the game on the Stadia platform and the game starting.
- Playability: percentage of sessions for which clicking “resume” (i.e., play) in the main menu of the game successfully started the game’s intro scene.
- Witbe VQ-MOS Score: a score representing the video quality of the first 30 seconds of the game, measured with our Video Quality Mean Opinion Score (VQ-MOS) algorithm.
- Witbe Smartping Latency: Stadia’s network latency measured by our Smartping algorithm. It also gives us information about packet loss rate, and network speed stability.
The KPIs were measured automatically in each city every 30 minutes over a 2-day period, from June 10th to 11th, for a total of more than 295 sessions. Every session included a 30 seconds Witbe VQ-MOS analysis, representing more than 10 000 KPIs measured!All graphs and other visual representations of KPIs in this QoE Snapshot are generated with Witbe Datalab, our restitution interface for fault finding, root cause analysis, and advanced analytics.
Availability issues and game crashes
For more details about the results of this QoE Snapshot, don’t hesitate to contact us!See you soon for the next Witbe QoE Snapshot!
About Witbe QoE Snapshots
In the same way that a consumer report tests a product and publishes an analysis of its overall quality, the Witbe QoE Snapshots test digital services to make available to the market information on the true Quality of Experience delivered internationally. These QoE Snapshots should not serve as benchmarks or as rankings of operators by service or device. Instead, the goal of these QoE Snapshots is to provide a global overview of digital services with multiple configurations and in various environments. Thus, the public will be able to better understand the technological complexity inherent to today’s services, like the distribution of video content. It is quite a technical feat – considering the efforts and means implemented – to broadcast videos on different devices and networks, with a quality that is acceptable by consumers with high expectations.
Since its origin, Witbe relies on a non-intrusive technology, based on Robots measuring the quality truly delivered. The Witbe Robots are placed at the edge of distribution and connected to test devices, the same ones as those used by real users. The Robots measure the Quality of Experience truly delivered to the end-users by providing KPIs on the service’s availability, performance, and integrity.
Each Snapshot is composed of several analytical frames, highlighting interesting findings about the KPIs that were measured. In our last QoE Snapshot, we compared channel change KPIs for video operators in North America and Europe. This time, we are publishing a look at the quality of experience of Google’s cloud gaming platform: Stadia.