{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T16:06:06Z","timestamp":1781885166714,"version":"3.54.5"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS 1755908"],"award-info":[{"award-number":["IIS 1755908"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>Effective collaboration in data science can leverage domain expertise from each team member and thus improve the quality and efficiency of the work. Computational notebooks give data scientists a convenient interactive solution for sharing and keeping track of the data exploration process through a combination of code, narrative text, visualizations, and other rich media. In this paper, we report how synchronous editing in computational notebooks changes the way data scientists work together compared to working on individual notebooks. We first conducted a formative survey with 195 data scientists to understand their past experience with collaboration in the context of data science. Next, we carried out an observational study of 24 data scientists working in pairs remotely to solve a typical data science predictive modeling problem, working on either notebooks supported by synchronous groupware or individual notebooks in a collaborative setting. The study showed that working on the synchronous notebooks improves collaboration by creating a shared context, encouraging more exploration, and reducing communication costs. However, the current synchronous editing features may lead to unbalanced participation and activity interference without strategic coordination. The synchronous notebooks may also amplify the tension between quick exploration and clear explanations. Building on these findings, we propose several design implications aimed at better supporting collaborative editing in computational notebooks, and thus improving efficiency in teamwork among data scientists.<\/jats:p>","DOI":"10.1145\/3359141","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-30","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":104,"title":["How Data Scientists Use Computational Notebooks for Real-Time Collaboration"],"prefix":"10.1145","volume":"3","author":[{"given":"April Yi","family":"Wang","sequence":"first","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anant","family":"Mittal","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Brooks","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steve","family":"Oney","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Readings in Human-Computer Interaction","author":"Baecker Ronald M","unstructured":"Ronald M Baecker , Dimitrios Nastos , Ilona R Posner , and Kelly L Mawby . 1995. The user-centred iterative design of collaborative writing software . In Readings in Human-Computer Interaction . Elsevier , 775--782. Ronald M Baecker, Dimitrios Nastos, Ilona R Posner, and Kelly L Mawby. 1995. The user-centred iterative design of collaborative writing software. In Readings in Human-Computer Interaction. Elsevier, 775--782."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370114.1370119"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466123"},{"key":"e_1_2_2_4_1","volume-title":"Beyond Interactive: Notebook Innovation at Netflix. https:\/\/2.zoppoz.workers.dev:443\/https\/medium.com\/netflix-techblog\/notebook-innovation-591ee3221233","author":"Blog Netflix Technology","year":"2018","unstructured":"Netflix Technology Blog . 2018 . Beyond Interactive: Notebook Innovation at Netflix. https:\/\/2.zoppoz.workers.dev:443\/https\/medium.com\/netflix-techblog\/notebook-innovation-591ee3221233 Netflix Technology Blog. 2018. Beyond Interactive: Notebook Innovation at Netflix. https:\/\/2.zoppoz.workers.dev:443\/https\/medium.com\/netflix-techblog\/notebook-innovation-591ee3221233"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.03.005"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025972"},{"key":"e_1_2_2_7_1","volume-title":"Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16)","author":"Chen Yan","unstructured":"Yan Chen , Steve Oney , and Walter S. Lasecki . 2016. Towards Providing On-Demand Expert Support for Software Developers . In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16) . ACM, New York, NY, USA, 3192--3203. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/2858036.2858512 10.1145\/2858036.2858512 Yan Chen, Steve Oney, and Walter S. Lasecki. 2016. Towards Providing On-Demand Expert Support for Software Developers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3192--3203. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/2858036.2858512"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242600"},{"key":"e_1_2_2_9_1","volume-title":"Basics of qualitative research: Techniques and procedures for developing grounded theory","author":"Corbin Juliet","unstructured":"Juliet Corbin and Anselm Strauss . 2008. Basics of qualitative research: Techniques and procedures for developing grounded theory , 3 rd ed. Sage Publications, Inc. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.4135\/9781452230153 10.4135\/9781452230153 Juliet Corbin and Anselm Strauss. 2008. Basics of qualitative research: Techniques and procedures for developing grounded theory, 3rd ed. Sage Publications, Inc. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.4135\/9781452230153","edition":"3"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274310"},{"key":"e_1_2_2_11_1","volume-title":"Data Scientist: The Sexiest Job of the 21st Century.","author":"Davenport Thomas H.","year":"2012","unstructured":"Thomas H. Davenport and D. J. Patil . 2012 . Data Scientist: The Sexiest Job of the 21st Century. (2012). Issue October 2012. https:\/\/2.zoppoz.workers.dev:443\/https\/hbr.org\/2012\/10\/data-scientist-the-sexiest-job-of-the-21st-century Thomas H. Davenport and D. J. Patil. 2012. Data Scientist: The Sexiest Job of the 21st Century. (2012). Issue October 2012. https:\/\/2.zoppoz.workers.dev:443\/https\/hbr.org\/2012\/10\/data-scientist-the-sexiest-job-of-the-21st-century"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.179149"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.2017.1384734"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143468"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2389176.2389194"},{"key":"e_1_2_2_16_1","volume-title":"The critical incident technique. Psychological bulletin","author":"Flanagan John C","year":"1954","unstructured":"John C Flanagan . 1954. The critical incident technique. Psychological bulletin , Vol. 51 , 4 ( 1954 ), 327. John C Flanagan. 1954. The critical incident technique. Psychological bulletin, Vol. 51, 4 (1954), 327."},{"key":"e_1_2_2_18_1","volume-title":"Proceedings of the 32Nd ACM\/IEEE International Conference on Software Engineering -","volume":"2","author":"Goldman Max","year":"2010","unstructured":"Max Goldman . 2010 . Test-driven Roles for Pair Programming . In Proceedings of the 32Nd ACM\/IEEE International Conference on Software Engineering - Volume 2 (ICSE '10). ACM, New York, NY, USA, 515--516. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/ 1810295.1810458 10.1145\/1810295.1810458 Max Goldman. 2010. Test-driven Roles for Pair Programming. In Proceedings of the 32Nd ACM\/IEEE International Conference on Software Engineering - Volume 2 (ICSE '10). ACM, New York, NY, USA, 515--516. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/1810295.1810458"},{"key":"e_1_2_2_20_1","volume-title":"Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11)","author":"Goldman Max","year":"2047","unstructured":"Max Goldman , Greg Little , and Robert C. Miller . 2011. Real-time Collaborative Coding in a Web IDE . In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11) . ACM, New York, NY, USA, 155--164. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/ 2047 196.2047215 10.1145\/2047196.2047215 Max Goldman, Greg Little, and Robert C. Miller. 2011. Real-time Collaborative Coding in a Web IDE. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 155--164. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/2047196.2047215"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807469"},{"key":"e_1_2_2_23_1","volume-title":"Proceedings of the 4th USENIX Conference on Theory and Practice of Provenance (TaPP'12)","author":"Philip","unstructured":"Philip J. Guo and Margo Seltzer. 2012. BURRITO: Wrapping Your Lab Notebook in Computational Infrastructure . In Proceedings of the 4th USENIX Conference on Theory and Practice of Provenance (TaPP'12) . USENIX Association, 7--7. https:\/\/2.zoppoz.workers.dev:443\/http\/dl.acm.org\/citation.cfm?id=2342875.2342882 Philip J. Guo and Margo Seltzer. 2012. BURRITO: Wrapping Your Lab Notebook in Computational Infrastructure. In Proceedings of the 4th USENIX Conference on Theory and Practice of Provenance (TaPP'12). USENIX Association, 7--7. https:\/\/2.zoppoz.workers.dev:443\/http\/dl.acm.org\/citation.cfm?id=2342875.2342882"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/274644.274713"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021271517844"},{"key":"e_1_2_2_26_1","volume-title":"Introduction: Computer-Mediated Collaborative Practices.","author":"Haythornthwaite Caroline","year":"2005","unstructured":"Caroline Haythornthwaite . 2005 . Introduction: Computer-Mediated Collaborative Practices. , Vol. 10 , 4 (2005). https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1111\/j.1083--6101.2005.tb00274.x 10.1111\/j.1083--6101.2005.tb00274.x Caroline Haythornthwaite. 2005. Introduction: Computer-Mediated Collaborative Practices., Vol. 10, 4 (2005). https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1111\/j.1083--6101.2005.tb00274.x"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300500"},{"key":"e_1_2_2_28_1","volume-title":"Design Considerations for Collaborative Visual Analytics. In 2007 IEEE Symposium on Visual Analytics Science and Technology. 171--178","author":"Heer Jeffery","year":"2007","unstructured":"Jeffery Heer and Maneesh Agrawala . 2007 . Design Considerations for Collaborative Visual Analytics. In 2007 IEEE Symposium on Visual Analytics Science and Technology. 171--178 . https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1109\/VAST.2007.4389011 10.1109\/VAST.2007.4389011 Jeffery Heer and Maneesh Agrawala. 2007. Design Considerations for Collaborative Visual Analytics. In 2007 IEEE Symposium on Visual Analytics Science and Technology. 171--178. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1109\/VAST.2007.4389011"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/949952.940091"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1473871611412817"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-018-07196-1"},{"key":"e_1_2_2_32_1","volume-title":"Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences","volume":"138","author":"Ilona","year":"1992","unstructured":"Ilona R. Posner and Ron Baecker. 1992. How people write together (groupware) . In Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences , Vol. iv. 127-- 138 vol.4. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1109\/HICSS. 1992 .183420 10.1109\/HICSS.1992.183420 Ilona R. Posner and Ron Baecker. 1992. How people write together (groupware). In Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, Vol. iv. 127--138 vol.4. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1109\/HICSS.1992.183420"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/JCDL.2017.7991618"},{"key":"e_1_2_2_34_1","volume-title":"Aiding Collaborative Reuse of Computational Notebooks with Annotated Cell Folding. Proc. ACM Hum.-Comput. Interact.","volume":"2","author":"Rule Adam","year":"2018","unstructured":"Adam Rule , Ian Drosos , Aur\u00e9lien Tabard , and James D. Hollan . 2018a . Aiding Collaborative Reuse of Computational Notebooks with Annotated Cell Folding. Proc. ACM Hum.-Comput. Interact. , Vol. 2 ( 2018 ), 150:1--150:12. Issue CSCW. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3274419 10.1145\/3274419 Adam Rule, Ian Drosos, Aur\u00e9lien Tabard, and James D. Hollan. 2018a. Aiding Collaborative Reuse of Computational Notebooks with Annotated Cell Folding. Proc. ACM Hum.-Comput. Interact., Vol. 2 (2018), 150:1--150:12. Issue CSCW. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3274419"},{"key":"e_1_2_2_35_1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18)","author":"Rule Adam","unstructured":"Adam Rule , Aur\u00e9lien Tabard , and James D. Hollan . 2018b. Exploration and Explanation in Computational Notebooks . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18) . ACM, New York, NY, USA, Article 32, 12 pages. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3173574.3173606 10.1145\/3173574.3173606 Adam Rule, Aur\u00e9lien Tabard, and James D. Hollan. 2018b. Exploration and Explanation in Computational Notebooks. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 32, 12 pages. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3173574.3173606"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125461"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460653"},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the 2007 ACM SIGMIS CPR Conference on Computer Personnel Research: The Global Information Technology Workforce (SIGMIS CPR '07). ACM","author":"Thissen M. Rita","unstructured":"M. Rita Thissen , Jean M. Page , Madhavi C. Bharathi , and Toyia L. Austin . 2007. Communication Tools for Distributed Software Development Teams . In Proceedings of the 2007 ACM SIGMIS CPR Conference on Computer Personnel Research: The Global Information Technology Workforce (SIGMIS CPR '07). ACM , New York, NY, USA, 28--35. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/1235000.1235007 10.1145\/1235000.1235007 M. Rita Thissen, Jean M. Page, Madhavi C. Bharathi, and Toyia L. Austin. 2007. Communication Tools for Distributed Software Development Teams. In Proceedings of the 2007 ACM SIGMIS CPR Conference on Computer Personnel Research: The Global Information Technology Workforce (SIGMIS CPR '07). ACM, New York, NY, USA, 28--35. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/1235000.1235007"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69566-0_28"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134742"},{"key":"e_1_2_2_42_1","volume-title":"Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17)","author":"Warner Jeremy","unstructured":"Jeremy Warner and Philip J. Guo . 2017. CodePilot: Scaffolding End-to-End Collaborative Software Development for Novice Programmers . In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17) . ACM, New York, NY, USA, 1136--1141. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3025453.3025876 10.1145\/3025453.3025876 Jeremy Warner and Philip J. Guo. 2017. CodePilot: Scaffolding End-to-End Collaborative Software Development for Novice Programmers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1136--1141. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3025453.3025876"},{"key":"e_1_2_2_43_1","volume-title":"Proceedings of the Twenty-fourth SIGCSE Technical Symposium on Computer Science Education (SIGCSE '93)","author":"Wilson Judith D.","unstructured":"Judith D. Wilson , Nathan Hoskin , and John T. Nosek . 1993. The Benefits of Collaboration for Student Programmers . In Proceedings of the Twenty-fourth SIGCSE Technical Symposium on Computer Science Education (SIGCSE '93) . ACM, New York, NY, USA, 160--164. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/169070.169383 10.1145\/169070.169383 Judith D. Wilson, Nathan Hoskin, and John T. Nosek. 1993. The Benefits of Collaboration for Student Programmers. In Proceedings of the Twenty-fourth SIGCSE Technical Symposium on Computer Science Education (SIGCSE '93). ACM, New York, NY, USA, 160--164. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/169070.169383"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998356"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17)","author":"Zhang Xiong","unstructured":"Xiong Zhang and Philip J. Guo . 2017. DS.Js: Turn Any Webpage into an Example-Centric Live Programming Environment for Learning Data Science . In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17) . ACM, New York, NY, USA, 691--702. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3126594.3126663 10.1145\/3126594.3126663 Xiong Zhang and Philip J. Guo. 2017. DS.Js: Turn Any Webpage into an Example-Centric Live Programming Environment for Learning Data Science. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 691--702. https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3126594.3126663"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3359141","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/pdf\/10.1145\/3359141","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/pdf\/10.1145\/3359141","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:40Z","timestamp":1750202620000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3359141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":41,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359141"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1145\/3359141","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}