{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T16:01:19Z","timestamp":1784390479976,"version":"3.55.0"},"reference-count":44,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T00:00:00Z","timestamp":1613520000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministerio de Asuntos Econ\u00f3micos y Transformaci\u00f3n Digital","award":["red.es, Piloto 5G Andaluc\u00eda, Caso 31 Estudio OpenRAN"],"award-info":[{"award-number":["red.es, Piloto 5G Andaluc\u00eda, Caso 31 Estudio OpenRAN"]}]},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["red.es, Piloto 5G Andaluc\u00eda, Caso 31 Estudio OpenRAN"],"award-info":[{"award-number":["red.es, Piloto 5G Andaluc\u00eda, Caso 31 Estudio OpenRAN"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["proyecto IDADE-5G (UMA18-FEDERJA-201, Programa Operativo FEDER Andaluc\u00eda 2014-2020)"],"award-info":[{"award-number":["proyecto IDADE-5G (UMA18-FEDERJA-201, Programa Operativo FEDER Andaluc\u00eda 2014-2020)"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["proyecto IDADE-5G (UMA18-FEDERJA-201, Programa Operativo FEDER Andaluc\u00eda 2014-2020)"],"award-info":[{"award-number":["proyecto IDADE-5G (UMA18-FEDERJA-201, Programa Operativo FEDER Andaluc\u00eda 2014-2020)"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009473","name":"Universidad de M\u00e1laga","doi-asserted-by":"publisher","award":["Plan Propio de Investigaci\u00f3n - Beca de iniciaci\u00f3n a la investigaci\u00f3n"],"award-info":[{"award-number":["Plan Propio de Investigaci\u00f3n - Beca de iniciaci\u00f3n a la investigaci\u00f3n"]}],"id":[{"id":"10.13039\/100009473","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["FPU19\/04468"],"award-info":[{"award-number":["FPU19\/04468"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cloud Gaming is a cutting-edge paradigm in the video game provision where the graphics rendering and logic are computed in the cloud. This allows a user\u2019s thin client systems with much more limited capabilities to offer a comparable experience with traditional local and online gaming but using reduced hardware requirements. In contrast, this approach stresses the communication networks between the client and the cloud. In this context, it is necessary to know how to configure the network in order to provide service with the best quality. To that end, the present work defines a novel framework for Cloud Gaming performance evaluation. This system is implemented in a real testbed and evaluates the Cloud Gaming approach for different transport networks (Ethernet, WiFi, and LTE (Long Term Evolution)) and scenarios, automating the acquisition of the gaming metrics. From this, the impact on the overall gaming experience is analyzed identifying the main parameters involved in its performance. Hence, the future lines for Cloud Gaming QoE-based (Quality of Experience) optimization are established, this way being of configuration, a trendy paradigm in the new-generation networks, such as 4G and 5G (Fourth and Fifth Generation of Mobile Networks).<\/jats:p>","DOI":"10.3390\/s21041387","type":"journal-article","created":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T01:47:33Z","timestamp":1613526453000},"page":"1387","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":41,"title":["Measuring Key Quality Indicators in Cloud Gaming: Framework and Assessment Over Wireless Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0001-6332-5644","authenticated-orcid":false,"given":"Oswaldo Sebastian","family":"Pe\u00f1aherrera-Pulla","sequence":"first","affiliation":[{"name":"Departamento de Ingenier\u00eda de Comunicaciones, Campus de Teatinos s\/n, Universidad de M\u00e1laga, Andaluc\u00eda Tech, 29071 M\u00e1laga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-7868-1729","authenticated-orcid":false,"given":"Carlos","family":"Baena","sequence":"additional","affiliation":[{"name":"Departamento de Ingenier\u00eda de Comunicaciones, Campus de Teatinos s\/n, Universidad de M\u00e1laga, Andaluc\u00eda Tech, 29071 M\u00e1laga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-5857-6403","authenticated-orcid":false,"given":"Sergio","family":"Fortes","sequence":"additional","affiliation":[{"name":"Departamento de Ingenier\u00eda de Comunicaciones, Campus de Teatinos s\/n, Universidad de M\u00e1laga, Andaluc\u00eda Tech, 29071 M\u00e1laga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-3639-3534","authenticated-orcid":false,"given":"Eduardo","family":"Baena","sequence":"additional","affiliation":[{"name":"Departamento de Ingenier\u00eda de Comunicaciones, Campus de Teatinos s\/n, Universidad de M\u00e1laga, Andaluc\u00eda Tech, 29071 M\u00e1laga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-8993-5229","authenticated-orcid":false,"given":"Raquel","family":"Barco","sequence":"additional","affiliation":[{"name":"Departamento de Ingenier\u00eda de Comunicaciones, Campus de Teatinos s\/n, Universidad de M\u00e1laga, Andaluc\u00eda Tech, 29071 M\u00e1laga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,17]]},"reference":[{"key":"ref_1","unstructured":"Wiljman, T. (2020, October 07). Newzoo Global Games Market Report 2019. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/newzoo.com\/insights\/trend-reports\/newzoo-global-games-market-report-2019-light-version\/."},{"key":"ref_2","unstructured":"Hart, C.B. (2017). The evolution and social impact of video game economics. Inf. Soc., 166."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1080\/00933104.2016.1208596","article-title":"Gaming History: A Framework for What Video Games Teach About the Past","volume":"44","author":"Metzger","year":"2016","journal-title":"Theory Res. Soc. Educ."},{"key":"ref_4","unstructured":"Stephanidis, C. (2019). Computational and Network Utilization in the Application of Thin Clients in Cloud-Based Virtual Applications. HCI International 2019\u2014Posters, Springer. [2019th ed.]."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"289","DOI":"10.3233\/MGS-190313","article-title":"Quality of experience (QoE) in cloud gaming models: A review","volume":"15","author":"Laghari","year":"2019","journal-title":"Multiagent Grid Syst."},{"key":"ref_6","first-page":"259","article-title":"Latency analysis for M2M and Online Gaming traffic in an HSPA network","volume":"31","author":"Svoboda","year":"2016","journal-title":"Ad Hoc Sens. Wirel. Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2078","DOI":"10.1109\/TCSVT.2015.2450173","article-title":"Enabling Adaptive Cloud Gaming in an Open-Source Cloud Gaming Platform","volume":"25","author":"Hong","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Beyer, J., and Varbelow, R. (2015, January 3\u20134). Stream-A-Game: An open-source mobile Cloud Gaming platform. Proceedings of the Annual Workshop on Network and Systems Support for Games, Zagreb, Croatia.","DOI":"10.1109\/NetGames.2015.7383002"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Slivar, I., Su\u017enjevi\u0107, M., Skorin-Kapov, L., and Ili\u0107, V. (2016, January 1\u20132). Cloud gaming in education: Evaluation of multiple game streams in a shared WLAN. Proceedings of the2016 Zooming Innovation in Consumer Electronics International Conference, ZINC 2016, Novi Sad, Serbia.","DOI":"10.1109\/ZINC.2016.7513656"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wu, R. (2016, January 23\u201325). Towards cloudlet-based mobile cloud gaming. Proceedings of the PIC 2016\u2014Proceedings of the 2016 IEEE International Conference on Progress in Informatics and Computing, Shanghai, China.","DOI":"10.1109\/PIC.2016.7949550"},{"key":"ref_11","first-page":"734","article-title":"Leveraging Fog to Extend Cloud Gaming for Thin-Client MMOG with High Quality of Experience","volume":"Volume 2015-July","author":"Lin","year":"2015","journal-title":"Proceedings of the International Conference on Distributed Computing Systems"},{"key":"ref_12","first-page":"500","article-title":"Cloud fog: Towards high quality of experience in cloud gaming","volume":"Volume 2015-December","author":"Lin","year":"2015","journal-title":"Proceedings of the International Conference on Parallel Processing"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sabet, S.S., Schmidt, S., Zadtootaghaj, S., Griwodz, C., and Moller, S. (2020, January 26\u201328). Towards the Impact of Gamers Strategy and User Inputs on the Delay Sensitivity of Cloud Games. Proceedings of the 2020 12th International Conference on Quality of Multimedia Experience (QoMEX 2020), Athlone, Ireland.","DOI":"10.1109\/QoMEX48832.2020.9123138"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1975","DOI":"10.1109\/TCSVT.2015.2452778","article-title":"Video Encoding Acceleration in Cloud Gaming","volume":"25","author":"Semsarzadeh","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ahmadi, H., Khoshnood, S., Hashemi, M.R., and Shirmohammadi, S. (2013, January 26\u201327). Efficient bitrate reduction using a game attention model in cloud gaming. Proceedings of the HAVE 2013\u20142013 IEEE International Symposium on Haptic Audio-Visual Environments and Games, Istanbul, Turkey.","DOI":"10.1109\/HAVE.2013.6679619"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Babaei, E., Hashemi, M.R., and Shirmohammadi, S. (2017, January 22\u201323). A state-based game attention model for cloud gaming. Proceedings of the Annual Workshop on Network and Systems Support for Games, Taipei, Taiwan.","DOI":"10.1109\/NetGames.2017.7991539"},{"key":"ref_17","unstructured":"Wang, R., Xue, M., Chen, K., Li, Z., Dong, T., and Sun, Y. (2015, January 6\u20137). BMA: Bandwidth allocation management for distributed systems under cloud gaming. Proceedings of the 2015 IEEE International Conference on Communication Software and Networks (ICCSN 2015), Chengdu, China."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Seyed Aboutorabi, S.J., and Rezvani, M.H. (2018, January 29\u201330). A Self-organizing Price-based Mechanism for Frame Rate Optimization in Cloud Gaming Networks Considering Quality of Experience. Proceedings of the 2018 2nd National and 1st International Digital Games Research Conference: Trends, Technologies, and Applications (DGRC 2018), Tehran, Iran.","DOI":"10.1109\/DGRC.2018.8712028"},{"key":"ref_19","unstructured":"The Open Group and TeleManagement Forum (2004). \u201cSLA Management Handbook Volume 4 Enterprise Perspective\u201d, The Open Group."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MVT.2019.2938448","article-title":"End-To-End Network Management: Modeling Key Quality Indicators","volume":"14","author":"Fortes","year":"2019","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Fortes, S., Santoyo-Ram\u00f3n, J.A., Palacios, D., Baena, E., Mora-Garc\u00eda, R., Medina, M., Mora, P., and Barco, R. (2019). The Campus as a Smart City: University of M\u00e1laga Environmental, Learning, and Research Approaches. Sensors, 19.","DOI":"10.3390\/s19061349"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1109\/LCOMM.2020.2979713","article-title":"Estimation of Video Streaming KQIs for Radio Access Negotiation in Network Slicing Scenarios","volume":"24","author":"Baena","year":"2020","journal-title":"IEEE Commun. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Vaser, M., and Forconi, S. (2015, January 9\u201311). QoS KPI and QoE KQI Relationship for LTE VIdeo Streaming and VoLTE Services. Proceedings of the NGMAST 2015: The 9th International Conference on Next Generation Mobile Applications, Services and Technologies, Cambridge, UK.","DOI":"10.1109\/NGMAST.2015.34"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Krogfoss, B., Duran, J., Perez, P., and Bouwen, J. (2020, January 26\u201328). Quantifying the Value of 5G and Edge Cloud on QoE for AR\/VR. Proceedings of the 2020 12th International Conference on Quality of Multimedia Experience (QoMEX 2020), Athlone, Ireland.","DOI":"10.1109\/QoMEX48832.2020.9123090"},{"key":"ref_25","unstructured":"Huang, C.Y., Hsu, C.H., Chang, Y.C., and Chen, K.T. (March, January 28). GamingAnywhere: An open cloud gaming system. Proceedings of the 4th ACM Multimedia Systems Conference (MMSys), Oslo, Norway."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MNET.2013.6574660","article-title":"Cloud gaming: Architecture and performance","volume":"27","author":"Shea","year":"2013","journal-title":"IEEE Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MWC.2014.6882299","article-title":"Cloud gaming: A green solution to massive multiplayer online games","volume":"21","author":"Chuah","year":"2014","journal-title":"IEEE Wirel. Commun."},{"key":"ref_28","unstructured":"(2020, November 29). Stadia FAQ\u2014Stadia Official Support Website. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/support.google.com\/stadia\/answer\/9338946?hl=en."},{"key":"ref_29","unstructured":"(2020, November 29). NVIDIA GeForce NOW\u2014GeForce Cloud Games. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/www.nvidia.com\/es-es\/geforce-now\/."},{"key":"ref_30","unstructured":"(2020, September 28). GamingAnywhere: An Open Cloud Gaming System. Available online: https:\/\/2.zoppoz.workers.dev:443\/http\/gaminganywhere.org\/."},{"key":"ref_31","unstructured":"Rainway (2020, November 30). Game Streaming\u2014Play Anywhere|Rainway. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/rainway.com\/."},{"key":"ref_32","unstructured":"Moonlight-Stream (2020, November 30). Moonlight Game Streaming: Play Your PC Games Remotely. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/moonlight-stream.org\/."},{"key":"ref_33","unstructured":"(2021, January 02). Moonlight-Stream Discord Channel. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/moonlight-stream.org\/discord."},{"key":"ref_34","unstructured":"3GPP (2016). Study on Key Quality Indicators (KQIs) for Service Experience, 3rd Generation Partnership Project (3GPP). TS 32.862."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Moller, S., Schmidt, S., and Zadtootaghaj, S. (June, January 29). New ITU-T Standards for Gaming QoE Evaluation and Management. Proceedings of the 2018 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), Cagliari, Italy.","DOI":"10.1109\/QoMEX.2018.8463404"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Vlahovic, S., Suznjevic, M., and Skorin-Kapov, L. (2019, January 5\u20137). The impact of network latency on gaming QoE for an FPS VR game. Proceedings of the 2019 11th International Conference on Quality of Multimedia Experience (QoMEX 2019), Berlin, Germany.","DOI":"10.1109\/QoMEX.2019.8743193"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Vlahovic, S., Suznjevic, M., and Skorin-Kapov, L. (2019, January 3\u20135). Challenges in assessing network latency impact on QoE and in-game performance in VR first person shooter games. Proceedings of the ConTEL 2019\u201415th International Conference on Telecommunications, Graz, Austria.","DOI":"10.1109\/ConTEL.2019.8848531"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1145\/1167838.1167860","article-title":"Latency and Player actions in online games","volume":"49","author":"Claypool","year":"2006","journal-title":"Commun. ACM"},{"key":"ref_39","unstructured":"Beigbeder, T., Coughlan, R., Lusher, C., Plunkett, J., Agu, E., and Claypool, M. (September, January 30). The effects of loss and latency on user performance in unreal tournament 2003\u00ae. Proceedings of the ACM SIGCOMM Workshop on Network and System Support for Games (NetGames\u201904), Portland, OR, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zadtootaghaj, S., Schmidt, S., and Moller, S. (June, January 29). Modeling Gaming QoE: Towards the Impact of Frame Rate and Bit Rate on Cloud Gaming. Proceedings of the 2018 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), Cagliari, Italy.","DOI":"10.1109\/QoMEX.2018.8463416"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Slivar, I., Skorin-Kapov, L., and Suznjevic, M. (2019, January 19\u201321). QoE-Aware Resource Allocation for Multiple Cloud Gaming Users Sharing a Bottleneck Link. Proceedings of the 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN 2019), Paris, France.","DOI":"10.1109\/ICIN.2019.8685890"},{"key":"ref_42","unstructured":"Europapress (2020, October 09). Vodafone, premiada por su tecnolog\u00eda \u2018CrowdCell\u2019 que refuerza la cobertura 4G en interiores. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/www.europapress.es\/economia\/noticia-vodafone-premiada-tecnologia-crowdcell-refuerza-cobertura-4g-interiores-20170531190100.html."},{"key":"ref_43","unstructured":"Rivet Networks (2020, October 22). Killer Networking|Killernetworking|Killer Control Center. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/www.killernetworking.com\/."},{"key":"ref_44","unstructured":"(2020, October 09). World Premiere: Amarisoft Launches the Amari LTE 100\u2014Amarisoft. Available online: https:\/\/2.zoppoz.workers.dev:443\/https\/www.amarisoft.com\/world-premiere-amarisoft-launches-the-amari-lte-100\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.mdpi.com\/1424-8220\/21\/4\/1387\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:25:00Z","timestamp":1760160300000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.mdpi.com\/1424-8220\/21\/4\/1387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,17]]},"references-count":44,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041387"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.3390\/s21041387","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,17]]}}}