{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T12:17:13Z","timestamp":1782562633162,"version":"3.54.5"},"reference-count":66,"publisher":"Wiley","issue":"12","license":[{"start":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T00:00:00Z","timestamp":1660867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/2.zoppoz.workers.dev:443\/http\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000269","name":"Economic and Social Research Council","doi-asserted-by":"publisher","award":["ES\/N009614\/1"],"award-info":[{"award-number":["ES\/N009614\/1"]}],"id":[{"id":"10.13039\/501100000269","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["asistdl.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Asso for Info Science &amp;amp; Tech"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>An intelligence information system (IIS) is a particular kind of information systems (IS) devoted to the analysis of intelligence relevant to national security. Professional and military intelligence analysts play a key role in this, but their judgments can be inconsistent, mainly due to noise and bias. The team\u2010oriented aspects of the intelligence analysis process complicates the situation further. To enable analysts to achieve better judgments, the authors designed, implemented, and validated an innovative IIS for analyzing UK Military Signals Intelligence (SIGINT) data. The developed tool, the Team Information Decision Engine (TIDE), relies on an innovative preference learning method along with an aggregation procedure that permits combining scores by individual analysts into aggregated scores. This paper reports on a series of validation trials in which the performance of individual and team\u2010oriented analysts was accessed with respect to their effectiveness and efficiency. Results show that the use of the developed tool enhanced the effectiveness and efficiency of intelligence analysis process at both individual and team levels.<\/jats:p>","DOI":"10.1002\/asi.24707","type":"journal-article","created":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T08:25:42Z","timestamp":1660897542000},"page":"1755-1775","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Analysis of noise and bias errors in intelligence information systems"],"prefix":"10.1002","volume":"73","author":[{"given":"Ashraf","family":"Labib","sequence":"first","affiliation":[{"name":"Portsmouth Business School University of Portsmouth  Portsmouth UK"},{"name":"Centre for Operational Research &amp; Logistics University of Portsmouth  Portsmouth UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Salem","family":"Chakhar","sequence":"additional","affiliation":[{"name":"Portsmouth Business School University of Portsmouth  Portsmouth UK"},{"name":"Centre for Operational Research &amp; Logistics University of Portsmouth  Portsmouth UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lorraine","family":"Hope","sequence":"additional","affiliation":[{"name":"Department of Psychology University of Portsmouth  Portsmouth UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Shimell","sequence":"additional","affiliation":[{"name":"Polaris Consulting Limited TP Group plc  Farnborough UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Malinowski","sequence":"additional","affiliation":[{"name":"Polaris Consulting Limited TP Group plc  Farnborough UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2022,8,19]]},"reference":[{"key":"e_1_2_8_2_1","first-page":"353","volume-title":"Proceedings of the ITI 2011, 33rd international conference on information technology interfaces","author":"Achkoski J.","year":"2011"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lmot.2015.11.002"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1080.0172"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470594001"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21601"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24303"},{"key":"e_1_2_8_8_1","volume-title":"Best truth: Intelligence and security in the information age","author":"Berkowitz B.","year":"2000"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1090.1000"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.11.4.366.11871"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-74759-0_495"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2015.10.060"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/02684527.2017.1400230"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.2307\/41703503"},{"key":"e_1_2_8_15_1","first-page":"42","volume-title":"New inquiries in reading research and instruction","author":"Cunningham J.","year":"1982"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0033951"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.3233\/FI-2013-887"},{"key":"e_1_2_8_18_1","volume-title":"Data mining and data analysis for counterterrorism","author":"DeRosa M.","year":"2004"},{"key":"e_1_2_8_19_1","unstructured":"Duvenage M.(2010).Intelligence analysis in the knowledge age: An analysis of the challenges facing the practice of intelligence analysis(PhD dissertation) University of Stellenbosch Stellenbosch South Africa."},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479854608.001.0001"},{"key":"e_1_2_8_21_1","volume-title":"Intelligence analysis: Behavioral and social scientific foundations","author":"Fischhoff B.","year":"2011"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(00)00167-3"},{"key":"e_1_2_8_23_1","first-page":"118","article-title":"The hidden traps in decision making","volume":"84","author":"Hammond J.","year":"2006","journal-title":"Harvard Business Review"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1080\/02684527.2015.1115238"},{"key":"e_1_2_8_25_1","first-page":"169","volume-title":"Behavioral and social scientific foundations","author":"Hastie R.","year":"2011"},{"key":"e_1_2_8_26_1","volume-title":"Psychology of intelligence analysis","author":"Heuer R.","year":"1999"},{"key":"e_1_2_8_27_1","volume-title":"Structured analytic techniques for intelligence analysis","author":"Heuer R.","year":"2014"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24255"},{"key":"e_1_2_8_29_1","first-page":"281","volume-title":"Expertise out of context: Proceedings of the sixth international conference on naturalistic decision making","author":"Hutchins S.","year":"2007"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1108\/ITP-08-2020-0566"},{"issue":"4","key":"e_1_2_8_31_1","first-page":"153","article-title":"Taking health information behaviour into account in the design of e\u2010health services","volume":"8","author":"Huvila I.","year":"2016","journal-title":"Finnish Journal of eHealth and eWelfare"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24611"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140130050084914"},{"issue":"10","key":"e_1_2_8_34_1","first-page":"38","article-title":"Noise: How to overcome the high, hidden cost on inconsistent decision making","volume":"94","author":"Kahneman D.","year":"2016","journal-title":"Harvard Business Review"},{"key":"e_1_2_8_35_1","volume-title":"Noise: A flaw in human judgment","author":"Kahneman D.","year":"2021"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2018.0130"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.2307\/2332226"},{"key":"e_1_2_8_38_1","volume-title":"Rank correlation methods","author":"Kendall M.","year":"1990"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.103.4.687"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2010.02.001"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2019.3491"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.12.1.63.9717"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24555"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocw105"},{"key":"e_1_2_8_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23204"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-65052-4_15"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1111\/risa.12360"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720810376055"},{"issue":"1","key":"e_1_2_8_49_1","first-page":"3","article-title":"Next generation digital platforms: Toward human\u2010AI hybrids","volume":"43","author":"Rai A.","year":"2019","journal-title":"MIS Quarterly"},{"key":"e_1_2_8_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797613497022"},{"key":"e_1_2_8_51_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2018.0773"},{"key":"e_1_2_8_52_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2020.3882"},{"key":"e_1_2_8_53_1","doi-asserted-by":"publisher","DOI":"10.1163\/9789004381650"},{"key":"e_1_2_8_54_1","first-page":"1","article-title":"Learning and unlearning from disasters: An analysis of the Virginia Tech, USA shooting and the Lion Air 610 Airline crash","volume":"1","author":"Schmidt B.","year":"2021","journal-title":"Journal of Surveillance, Security and Safety"},{"key":"e_1_2_8_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC48688.2020.00-95"},{"key":"e_1_2_8_56_1","doi-asserted-by":"publisher","DOI":"10.1093\/0198292279.001.0001"},{"key":"e_1_2_8_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-30440-3_460"},{"key":"e_1_2_8_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45813-1_6"},{"key":"e_1_2_8_59_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24544"},{"key":"e_1_2_8_60_1","volume-title":"Superforecasting: The art and science of prediction","author":"Tetlock P.","year":"2000"},{"key":"e_1_2_8_61_1","volume-title":"Assessing the tradecraft of intelligence analysis","author":"Treverton G.","year":"2008"},{"key":"e_1_2_8_62_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24398"},{"key":"e_1_2_8_63_1","volume-title":"Qualitative social research: Contemporary methods for the digital age","author":"Waller V.","year":"2015"},{"issue":"6","key":"e_1_2_8_64_1","first-page":"517","article-title":"A comparison of group and individual performance among subject experts and untrained workers at the document retrieval task","volume":"49","author":"Wilbur W.","year":"1998","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"e_1_2_8_65_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1100.1167"},{"key":"e_1_2_8_66_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23366"},{"key":"e_1_2_8_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2014.06.010"}],"container-title":["Journal of the Association for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.24707","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/asi.24707","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.24707","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T21:05:27Z","timestamp":1759957527000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/asi.24707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,19]]},"references-count":66,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1002\/asi.24707"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1002\/asi.24707","archive":["Portico"],"relation":{},"ISSN":["2330-1635","2330-1643"],"issn-type":[{"value":"2330-1635","type":"print"},{"value":"2330-1643","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,19]]},"assertion":[{"value":"2021-11-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-08-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-08-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}