{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:57:57Z","timestamp":1777661877699,"version":"3.51.4"},"reference-count":25,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Virtual tours in museums are an ideal solution for those that are not able to visit a museum or those who want to have a small taste of what is presented in the museum before their visit. However, these tours often encounter severe problems while users interact with them. In order to check the status of virtual tours of museums, we present the implementation of an evaluation experiment that uses a combination of two multi-criteria decision making theories, namely the analytic hierarchy process (AHP) and the fuzzy technique for order of preference by similarity to ideal solution (TOPSIS). AHP has been used for the estimation of the weights of the heuristics and fuzzy TOPSIS has been used for the evaluation of virtual tours of museums. This paper presents the exact steps that have to be followed in order to implement such an experiment and run an example experiment for virtual tours of Italian museums.<\/jats:p>","DOI":"10.3390\/info10110351","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T10:56:34Z","timestamp":1573728994000},"page":"351","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["Evaluating Museum Virtual Tours: The Case Study of Italy"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0003-4328-0084","authenticated-orcid":false,"given":"Katerina","family":"Kabassi","sequence":"first","affiliation":[{"name":"Department of Environment, Ionian University, 49100 Corfu, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-3568-636X","authenticated-orcid":false,"given":"Alessia","family":"Amelio","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria Informatica, Modellistica, Elettronica e Sistemistica, University of Calabria, 87036 Arcavacata, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-1955-6135","authenticated-orcid":false,"given":"Vasileios","family":"Komianos","sequence":"additional","affiliation":[{"name":"Department of Audio and Visual Arts, Ionian University, 49100 Corfu, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0001-7279-9710","authenticated-orcid":false,"given":"Konstantinos","family":"Oikonomou","sequence":"additional","affiliation":[{"name":"Department of Informatics, Ionian University, 49100 Corfu, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1109\/MC.2006.108","article-title":"Virtual museum exhibitions","volume":"39","author":"Walczak","year":"2006","journal-title":"Computers"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.culher.2017.02.005","article-title":"Virtual museum systems evaluation through user studies","volume":"26","author":"Barbieri","year":"2017","journal-title":"J. Cult. Herit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"012038","DOI":"10.1088\/1757-899X\/364\/1\/012038","article-title":"Interaction and Information Communication in Virtual Museums","volume":"Volume 364","author":"Latos","year":"2018","journal-title":"IOP Conference Series: Materials Science and Engineering"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1504\/IJCISTUDIES.2015.071184","article-title":"Cultural heritage recommendations and user navigation in large scale virtual environments","volume":"4","author":"Komianos","year":"2015","journal-title":"IJCIStudies"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"363","DOI":"10.15388\/Informatica.2006.143","article-title":"Usability Evaluation of a Virtual Museum Interface","volume":"17","author":"Karoulis","year":"2006","journal-title":"Informatica"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1016\/j.sbspro.2013.10.282","article-title":"Measuring the usability of a smartphone delivered museum guide. The 9th International Conference on Cognitive Science","volume":"97","author":"Othman","year":"2013","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_7","unstructured":"Stanney, K. (2002). Usability engineering of virtual environments. Handbook of Virtual Environments: Design, Implementation and Applications, Lawrence Erlbaum Associates."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1016\/S1071-5819(03)00015-6","article-title":"Usability engineering of virtual environments (VEs): Identifying multiple criteria that drive effective VE system design","volume":"58","author":"Stanney","year":"2003","journal-title":"Intell. J. Hum.-Comput. Stud."},{"key":"ref_9","unstructured":"Bazargan, K., Falquet, G., and Metral, C. (2010, January 28\u201330). Testing the usability of information visualization techniques in interactive 3D virtual environments: A toolkit. Proceedings of the IADIS International Conference Interfaces and Human Computer Interaction, Freiburg, Germany."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1993). Usability Engineering, Academic Press.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1016\/j.intcom.2004.05.001","article-title":"Heuristic evaluation of virtual reality applications","volume":"16","author":"Sutcliffe","year":"2004","journal-title":"Interact. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sylaiou, S., Killintzis, V., Paliokas, I., Mania, K., and Patias, P. (2014, January 22\u201327). Usability evaluation of virtual museums\u2019 interfaces visualization technologies. Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, Crete, Greece.","DOI":"10.1007\/978-3-319-07464-1_12"},{"key":"ref_13","first-page":"1","article-title":"Heuristics and Fuzzy Multi-criteria Decision Making for Evaluating Museum Virtual Tours","volume":"11","author":"Kabassi","year":"2018","journal-title":"Int. J. Incl. Mus."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.ejor.2007.05.006","article-title":"A fuzzy simple additive weighting system under group decision-making for facility location selection with objective\/subjective attributes","volume":"189","author":"Chou","year":"2008","journal-title":"Eur. J. Oper. Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Saaty, T. (1980). The Analytic Hierarchy Process, McGraw-Hill.","DOI":"10.21236\/ADA214804"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0165-0114(97)00377-1","article-title":"Extensions of the TOPSIS for group decision-making under fuzzy environment","volume":"114","author":"Chen","year":"2000","journal-title":"Fuzzy Sets Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"01006","DOI":"10.1051\/matecconf\/20141301006","article-title":"Comparative Analysis between Fuzzy and Traditional Analytical Hierarchy Process","volume":"13","author":"Mulubrhan","year":"2014","journal-title":"MATEC Web Conf."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hwang, C.L., and Yoon, K. (1981). Multiple Attribute Decision Making: Methods and Applications, Springer.","DOI":"10.1007\/978-3-642-48318-9"},{"key":"ref_19","first-page":"1","article-title":"Evaluation of Two Major Online Travel Agencies of US Using TOPSIS Method","volume":"2","author":"Soleymaninejad","year":"2016","journal-title":"Digit. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"31","DOI":"10.14257\/ijmue.2015.10.7.04","article-title":"Group-Buying Websites Evaluation Model Based on AHP-TOPSIS under the Environment of Multi-Attribute Decision-Making","volume":"10","author":"Zhang","year":"2015","journal-title":"Int. J. Multimed. Ubiquitous Eng."},{"key":"ref_21","first-page":"29","article-title":"Rank University Websites Using Fuzzy AHP and Fuzzy TOPSIS Approach on Usability","volume":"1","author":"Nagpal","year":"2015","journal-title":"Int. J. Inf. Eng. Electron. Bus."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1142\/S0218488507004704","article-title":"Evaluating government websites based on a fuzzy multiple criteria decision-making approach","volume":"15","author":"Ruan","year":"2007","journal-title":"Int. J. Uncertain. Fuzziness Knowl.-Based Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sweetnam, M.S., Agosti, M., Orio, N., Ponchia, C., Steiner, C.M., Hillemann, E.-C., Siochr\u00fa, M., and Lawless, S. (2012, January 23\u201327). User needs for enhanced engagement with cultural heritage collections. Proceedings of Second International Conference TPDL, Paphos, Cyprus.","DOI":"10.1007\/978-3-642-33290-6_8"},{"key":"ref_24","first-page":"203","article-title":"PriEsT: An interactive decision support tool to estimate priorities from pair-wise comparison judgments","volume":"22","author":"Sirah","year":"2015","journal-title":"Int. Trans. Oper. Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1016\/j.culher.2009.03.003","article-title":"Virtual museums, a survey and some issues for consideration","volume":"10","author":"Sylaiou","year":"2009","journal-title":"J. Cult. Herit."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.mdpi.com\/2078-2489\/10\/11\/351\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:34:24Z","timestamp":1760189664000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.mdpi.com\/2078-2489\/10\/11\/351"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,14]]},"references-count":25,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["info10110351"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.3390\/info10110351","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,14]]}}}