{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T23:36:07Z","timestamp":1780702567442,"version":"3.54.1"},"reference-count":52,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2018,11,16]],"date-time":"2018-11-16T00:00:00Z","timestamp":1542326400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/2.zoppoz.workers.dev:443\/http\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100004472","name":"Riksbankens Jubileumsfond","doi-asserted-by":"publisher","award":["SGO14\u20101153:1"],"award-info":[{"award-number":["SGO14\u20101153:1"]}],"id":[{"id":"10.13039\/501100004472","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004359","name":"Swedish Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["asistdl.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Asso for Info Science &amp;amp; Tech"],"published-print":{"date-parts":[[2019,1]]},"abstract":"<jats:p>The use of indicators and metrics for research evaluation purposes is well\u2010documented; however, less is known about their use by individual scholars. With a focus on the social sciences, this article contributes to the existing literature on indicators and metrics use in fields with diverse publication practices. Scholars in Australia and Sweden were asked about their use and reasons for using metrics. A total of 581 completed surveys were analyzed to generate descriptive statistics, with textual analysis performed on comments provided to open questions. While just under half of the participant group had used metrics, the Australians reported use in twice the proportion of their Swedish peers. Institutional policies and processes were frequently associated with use, and the scholars' comments suggest a high level of awareness of some metrics as well as strategic behavior in demonstrating research performance. There is also evidence of tensions between scholars' research evaluation environment and their disciplinary values and publication practices.<\/jats:p>","DOI":"10.1002\/asi.24097","type":"journal-article","created":{"date-parts":[[2018,11,16]],"date-time":"2018-11-16T09:50:50Z","timestamp":1542361850000},"page":"16-26","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Quality, impact, and quantification: Indicators and metrics use by social scientists"],"prefix":"10.1002","volume":"70","author":[{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-2038-6436","authenticated-orcid":false,"given":"Gaby","family":"Haddow","sequence":"first","affiliation":[{"name":"Department of Information Studies, School of Media, Communication and Creative Arts Curtin University  Perth WA, 6845 Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-1504-8395","authenticated-orcid":false,"given":"Bj\u00f6rn","family":"Hammarfelt","sequence":"additional","affiliation":[{"name":"Swedish School of Library and Information Science University of Bor\u00e5s  Bor\u00e5s, 501 90 Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2018,11,16]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvv003"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2009.02.001"},{"key":"e_1_2_8_4_1","unstructured":"Australian Bureau of Statistics(2008).Australian and New Zealand Standard Research Classification (ANZSRC). Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/http\/www.abs.gov.au\/ausstats\/abs@.nsf\/0\/6BB427AB9696C225CA2574180004463E"},{"key":"e_1_2_8_5_1","unstructured":"Australian Research Council(2017).Excellence in research for Australia. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/http\/www.arc.gov.au\/excellence-research-australia"},{"issue":"2","key":"e_1_2_8_6_1","first-page":"88","article-title":"FoR codes pendulum: Publishing choices within Australian research assessment","volume":"53","author":"Bennett D.","year":"2011","journal-title":"Australian Universities\u2019 Review"},{"key":"e_1_2_8_7_1","unstructured":"Bourke P.(1994 19\u201325 May). Quantitative research indicators: Citations treatment \u2018deficient\u2019. Campus Review p. 9."},{"key":"e_1_2_8_8_1","doi-asserted-by":"crossref","unstructured":"Box S.(2010). Performance\u2010based funding for public research in tertiary education institutions: Country experiences. In OECD Performance\u2010Based Funding for Public Research in Tertiary Education Institutions: Workshop Proceedings. Paris: OECD Publishing. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/http\/dx.doi.org\/10.1787\/9789264094611-6-en","DOI":"10.1787\/9789264094611-6-en"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-012-0676-y"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-954X.2012.02077.x"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.3354\/esep00077"},{"key":"e_1_2_8_12_1","doi-asserted-by":"crossref","unstructured":"Chartered Association of Business Schools 2015","DOI":"10.4135\/9781473919983.n2"},{"key":"e_1_2_8_13_1","volume-title":"The Evaluation Society","author":"Dahler\u2010Larsen P.","year":"2012"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/14719037.2013.770058"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.3152\/095820211X12941371876346"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvv038"},{"key":"e_1_2_8_17_1","unstructured":"Derrick G.E.&Gillespie J.(2013). \u201cA number you just can't get away from\u201d: Characteristics of adoption and the social construction of metrics use by researchers. In S. Hinze & A. Lottman (Eds.) Proceedings of the 18th International Conference on Science and Technology Indicators (pp. 104\u2013116). Berlin."},{"key":"e_1_2_8_18_1","volume-title":"Mail and Internet Surveys: The Tailored Design Method","author":"Dilman D.A.","year":"2006"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-012-0680-2"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvv048"},{"key":"e_1_2_8_21_1","first-page":"7","article-title":"ERA and the ranking of Australian humanities journals","volume":"46","author":"Genoni P.","year":"2009","journal-title":"Australian Humanities Review"},{"key":"e_1_2_8_22_1","first-page":"149","volume-title":"World social science report: Knowledge divides","author":"Gingras Y.","year":"2010"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvw013"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvv006"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvu029"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvv040"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvx018"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0049-089X(90)90006-5"},{"key":"e_1_2_8_29_1","first-page":"473","volume-title":"Handbook of Quantitative Science and Technology Research","author":"Hicks D.","year":"2004"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21458"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/520429a"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20885"},{"key":"e_1_2_8_33_1","unstructured":"Knott M.(2015 November 17). Universities questioned over alleged \u2018gaming\u2019 of research rankings.Sydney Morning Herald. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/http\/www.smh.com.au\/national\/education\/universities\u2010questioned\u2010over\u2010alleged\u2010gaming\u2010of\u2010research\u2010rankings\u201020151117\u2010gl0yva.html"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/13600800600980130"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1332\/030557310X520270"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026972"},{"issue":"1","key":"e_1_2_8_37_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/pra2.2016.14505301132","article-title":"Scholarly communication and practices in the world of metrics: An exploratory study","volume":"53","author":"Ma L.","year":"2016","journal-title":"Proceedings of the Association for Information Science and Technology"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpa.2014.02.006"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1629\/14149"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/0741088311428566"},{"key":"e_1_2_8_41_1","unstructured":"Organisation for Economic Co\u2010operation and Development. (2007).Revised field of science and technology (FOS) classification in the Frascati Manual. Paris: OECD. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/https\/www.oecd.org\/science\/inno\/38235147.pdf"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2012.03.015"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/00048623.1994.10754876"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-016-1845-1"},{"key":"e_1_2_8_45_1","unstructured":"Statistics Sweden. (2017).Employees in higher education 2016. Swedish Higher Education Authority. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/https\/www.scb.se\/publication\/31450"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpa.2014.02.004"},{"key":"e_1_2_8_47_1","unstructured":"Turner G.&Brass K.. (2014).Mapping the humanities arts and social sciences in Australia. Canberra: Academy of the Humanities. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/https\/www.humanities.org.au\/issue-item\/mapping-humanities-arts-social-sciences-australia"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.22636"},{"key":"e_1_2_8_49_1","unstructured":"vanLeeuwen T.(2013). Bibliometric research evaluations Web of Science and the social sciences and humanities: A problematic relationship?Bibliometrie\u2014Praxis und Forschung 2. Retrieved fromhttps:\/\/2.zoppoz.workers.dev:443\/http\/www.bibliometrie-pf.de\/article\/view\/173"},{"key":"e_1_2_8_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-015-1788-y"},{"key":"e_1_2_8_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2016.01.004"},{"key":"e_1_2_8_52_1","doi-asserted-by":"crossref","first-page":"47","DOI":"10.7551\/mitpress\/9445.003.0006","volume-title":"Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact","author":"Wouters P.","year":"2014"},{"key":"e_1_2_8_53_1","unstructured":"Wouters P. ThelwallM KoushaK WaltmanL deRijckeS RushforthA &FranssenT. (2015). The metric tide: Literature review(supplementary report I to the independent review of the role of metrics in research assessment and management).Bristol UK:HEFCE."}],"container-title":["Journal of the Association for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fasi.24097","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.24097","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/asi.24097","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.24097","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T15:23:16Z","timestamp":1759936996000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/asi.24097"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,16]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,1]]}},"alternative-id":["10.1002\/asi.24097"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1002\/asi.24097","archive":["Portico"],"relation":{},"ISSN":["2330-1635","2330-1643"],"issn-type":[{"value":"2330-1635","type":"print"},{"value":"2330-1643","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,16]]},"assertion":[{"value":"2017-12-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-11","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}