{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T18:13:11Z","timestamp":1780942391153,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,8,4]]},"DOI":"10.1145\/3715928.3737491","type":"proceedings-article","created":{"date-parts":[[2025,7,29]],"date-time":"2025-07-29T07:33:43Z","timestamp":1753774423000},"page":"113-128","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Gotta Catch 'Em All... Or Not?: How LLMs Bypass Traditional Checks & Mimic Human Response Behavior in Web Surveys"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0003-1811-6557","authenticated-orcid":false,"given":"Saijal","family":"Shahania","sequence":"first","affiliation":[{"name":"German Centre for Higher Education Research and Science Studies (DZHW), Hannover, Germany and Otto-von-Guericke University, Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-1828-5759","authenticated-orcid":false,"given":"Myra","family":"Spiliopoulou","sequence":"additional","affiliation":[{"name":"Otto-von-Guericke University, Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-9580-740X","authenticated-orcid":false,"given":"David","family":"Broneske","sequence":"additional","affiliation":[{"name":"German Centre for Higher Education Research and Science Studies (DZHW), Hannover, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,8,3]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"crossref","unstructured":"R\u00a0Michael Alvarez Lonna\u00a0Rae Atkeson Ines Levin and Yimeng Li. 2019. Paying attention to inattentive survey respondents. Political Analysis 27 2 (2019) 145\u2013162.","DOI":"10.1017\/pan.2018.57"},{"key":"e_1_3_3_2_3_2","unstructured":"Kathrin Bogner and Uta Landrock. 2016. Response Biases in Standardised Surveys. GESIS Survey Guidelines (2016)."},{"key":"e_1_3_3_2_4_2","unstructured":"Bernard\u00a0CK Choi and Anita\u00a0WP Pak. 2004. A Catalog of Biases in Questionnaires. Preventing Chronic Disease 2 1 (2004) A13."},{"key":"e_1_3_3_2_5_2","doi-asserted-by":"crossref","unstructured":"Mick\u00a0P. Couper. 2017. New Developments in Survey Data Collection. Annual Review of Sociology 43 2017 (2017) 121\u2013145.","DOI":"10.1146\/annurev-soc-060116-053613"},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"crossref","unstructured":"Alexandra\u00a0M Dunn Eric\u00a0D Heggestad Linda\u00a0R Shanock and Nels Theilgard. 2018. Intra-individual Response Variability as an Indicator of Insufficient Effort Responding: Comparison to Other Indicators and Relationships with Individual Differences. Journal of Business and Psychology 33 (2018) 105\u2013121.","DOI":"10.1007\/s10869-016-9479-0"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"crossref","unstructured":"Dan Friesner Carl\u00a0S Bozman Matthew McPherson Faith Valente and Anqing Zhang. 2023. Information Entropy as a Quality Control Tool in Survey Research. Journal of Marketing Development and Competitiveness 17 1 (2023) 46\u201361.","DOI":"10.33423\/jmdc.v17i1.5909"},{"key":"e_1_3_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Philippe Goldammer Peter\u00a0Lucas St\u00f6ckli Hubert Annen and Annika Schmitz-Wilhelmy. 2024. A comparison of conventional and resampled personal reliability in detecting careless responding. Behavior Research Methods 56 8 (2024) 8831\u20138851.","DOI":"10.3758\/s13428-024-02506-0"},{"key":"e_1_3_3_2_9_2","unstructured":"Robert Greszki Marco Meyer and Harald Schoen. 2015. Identifying Careless Responding in Surveys. SAGE Open 5 3 (2015) 1\u201311."},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Tobias Gummer Joss Ro\u00dfmann and Henning Silber. 2021. Using Instructed Response Items as Attention Checks in Web Surveys: Properties and Implementation. Sociological Methods & Research 50 1 (2021) 238\u2013264.","DOI":"10.1177\/0049124118769083"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Walid Khalifa\u00a0Abdullah Hasan. 2016. A survey of current research on captcha. International Journal of Computer Science and Engineering Survey (IJCSES) 7 3 (2016) 141\u2013157.","DOI":"10.5121\/ijcses.2016.7301"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"crossref","unstructured":"Jan\u00a0Karem H\u00f6hne Joshua Claassen Saijal Shahania and David Broneske. 2025. Bots in web survey interviews: A showcase. International Journal of Market Research 67 1 (2025) 3\u201312.","DOI":"10.1177\/14707853241297009"},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"crossref","unstructured":"Yujin Kim Jennifer Dykema John Stevenson Penny Black and D\u00a0Paul Moberg. 2019. Straightlining: Overview of Measurement Comparison of Indicators and Effects in Mail\u2013Web Mixed-Mode Surveys. Social Science Computer Review 37 2 (2019) 214\u2013233.","DOI":"10.1177\/0894439317752406"},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"crossref","unstructured":"Ivar Krumpal. 2013. Determinants of social desirability bias in sensitive surveys: a literature review. Quality & Quantity 47 4 (2013) 2025\u20132047.","DOI":"10.1007\/s11135-011-9640-9"},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Benjamin Lebrun Sharon Temtsin Andrew Vonasch and Christoph Bartneck. 2024. Detecting the corruption of online questionnaires by artificial intelligence. Frontiers in Robotics and AI 10 (2024) 1277635.","DOI":"10.3389\/frobt.2023.1277635"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"crossref","unstructured":"Jianhua Lin. 1991. Divergence measures based on the Shannon entropy. IEEE Transactions on Information theory 37 1 (1991) 145\u2013151.","DOI":"10.1109\/18.61115"},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Zdravko Marjanovic Ronald Holden Ward Struthers Robert Cribbie and Esther Greenglass. 2015. The inter-item standard deviation (ISD): An index that discriminates between conscientious and random responders. Personality and Individual Differences 84 (2015) 79\u201383.","DOI":"10.1016\/j.paid.2014.08.021"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Adam\u00a0W Meade and S\u00a0Bartholomew Craig. 2012. Identifying careless responses in survey data. Psychological methods 17 3 (2012) 437.","DOI":"10.1037\/a0028085"},{"key":"e_1_3_3_2_19_2","unstructured":"OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia\u00a0Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et\u00a0al. 2023. GPT-4 Technical Report. arXiv preprint arXiv:https:\/\/2.zoppoz.workers.dev:443\/https\/arXiv.org\/abs\/2303.08774 (2023)."},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Caroline Roberts Emily Gilbert Nick Allum and L\u00e9\u00efla Eisner. 2019. Research Synthesis: Satisficing in Surveys: A Systematic Review of the Literature. Public Opinion Quarterly 83 3 (2019) 598\u2013626.","DOI":"10.1093\/poq\/nfz035"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"crossref","unstructured":"Emma Ruby Serine Ramlawi Alexa\u00a0Clare Bowie Stephanie Boyd Alysha Dingwall-Harvey Ruth Rennicks\u00a0White Darine El-Cha\u00e2r and Mark Walker. 2025. Identifying Fraudulent Responses in a Study Exploring Delivery Options for Pregnancies Impacted by Gestational Diabetes: Lessons Learned From a Web-Based Survey. Journal of Medical Internet Research 27 (2025) e58450.","DOI":"10.2196\/58450"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"crossref","unstructured":"Aadesh Salecha Molly\u00a0E Ireland Shashanka Subrahmanya Jo\u00e3o Sedoc Lyle\u00a0H Ungar and Johannes\u00a0C Eichstaedt. 2024. Large language models display human-like social desirability biases in Big Five personality surveys. PNAS nexus 3 12 (2024) pgae533.","DOI":"10.1093\/pnasnexus\/pgae533"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Andie Storozuk Marilyn Ashley V\u00e9ronic Delage and Erin\u00a0A Maloney. 2020. Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks. The Quantitative Methods for Psychology 16 5 (2020) 472\u2013481.","DOI":"10.20982\/tqmp.16.5.p472"},{"key":"e_1_3_3_2_24_2","unstructured":"Gemini Team Rohan Anil Sebastian Borgeaud Jean-Baptiste Alayrac Jiahui Yu Radu Soricut Johan Schalkwyk Andrew\u00a0M Dai Anja Hauth Katie Millican et\u00a0al. 2023. Gemini: A Family of Highly Capable Multimodal Models. arXiv preprint arXiv:https:\/\/2.zoppoz.workers.dev:443\/https\/arXiv.org\/abs\/2312.11805 (2023)."},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"crossref","unstructured":"Lindia Tjuatja Valerie Chen Tongshuang Wu Ameet Talwalkwar and Graham Neubig. 2024. Do LLMs Exhibit Human-like Response Biases? A Case Study in Survey Design. Transactions of the Association for Computational Linguistics 12 (2024) 1011\u20131026.","DOI":"10.1162\/tacl_a_00685"},{"key":"e_1_3_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511819322"},{"key":"e_1_3_3_2_27_2","unstructured":"Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar et\u00a0al. 2023. LLaMA: Open and Efficient Foundation Language Models. arXiv preprint arXiv:https:\/\/2.zoppoz.workers.dev:443\/https\/arXiv.org\/abs\/2302.13971 (2023)."},{"key":"e_1_3_3_2_28_2","unstructured":"Mengwei Xu Wangsong Yin Dongqi Cai Rongjie Yi Daliang Xu Qipeng Wang Bingyang Wu Yihao Zhao Chen Yang Shihe Wang et\u00a0al. 2024. A Survey of Resource-efficient LLM and Multimodal Foundation Models. arXiv preprint arXiv:https:\/\/2.zoppoz.workers.dev:443\/https\/arXiv.org\/abs\/2401.08092 (2024)."},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Yanfeng Xu Sarah Pace Jaeseung Kim Aidyn Iachini L\u00a0Bailey King Theresa Harrison Dana DeHart Sue\u00a0E Levkoff Teri\u00a0A Browne Ashlee\u00a0A Lewis et\u00a0al. 2022. Threats to Online Surveys: Recognizing Detecting and Preventing Survey Bots. Social Work Research 46 4 (2022) 343\u2013350.","DOI":"10.1093\/swr\/svac023"}],"event":{"name":"CI 2025: ACM Collective Intelligence Conference","location":"San Diego CA USA","acronym":"CI 2025","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the ACM Collective Intelligence Conference"],"original-title":[],"deposited":{"date-parts":[[2025,7,29]],"date-time":"2025-07-29T09:46:46Z","timestamp":1753782406000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3715928.3737491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,3]]},"references-count":28,"alternative-id":["10.1145\/3715928.3737491","10.1145\/3715928"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3715928.3737491","relation":{},"subject":[],"published":{"date-parts":[[2025,8,3]]},"assertion":[{"value":"2025-08-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}