TENCompetence Workshop, Manchester 2007 Designing Systems for Managing Collaborative Research Processes Scott Wilson, CETIS; Yoichi Takayama, Ernie Ghiglione, James Dalziel, MELCOE This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence
Context Two linked projects: RAMS & DRAMA Research by MELCOE Funded by DEST as part of programme backing Australia’s research capability
Why  collaborative  research workflow? Plenty of work to date in process automation, especially data analysis Relatively little work on communication and collaboration-heavy processes Emphasis in funding on collaborative work (e.g. multi-partner) but patchy practice Possibility of scaffolding collaborative processes to improve effectiveness
Which kinds of processes? Research management Research quality assessment Online research collaboration Data collection Monitoring, positioning new opportunities Proposal development Scheduling
Research process characteristics May be weakly structured While some processes may be pre-determined, the majority exhibit dynamic properties, and may diverge from design at runtime Alternate periods of individual and team activity
Potential benefits Greater standardisation of common or repeatable research processes, leading to higher quality outcomes and improved efficiency;  The ability to share descriptions of common research processes both within institutions, and between institutions – including the ability to adapt and localise shared research processes; Greatly improved accountability and audit for processes involving multiple actors across multiple steps – such as for research assessment (e.g., RQF/RAE assessor workflows), as well as for research itself (e.g., as a deterrent to academic fraud); and  Providing a process-oriented checklist to ensure the ordered completion of relevant research tasks.
Potential risks The technology may be costly when compared to the actual benefits The technology may require new competences to devise and execute research processes, placing control of such processes into the hands of IT specialists rather than researchers themselves The technology may restrict unnecessarily the diversity of activities and approaches to conducting research The technology may be perceived as an attempt to control rather than enable the work of researchers
Six Lenses (so far…) BPM HIM BPOKM CSC Learning Design VSM
Simple workflow…
… can exhibit complex behaviour
Is it worth the trouble? “ One might argue that in a world where routine processes have been automated by systems, these value-adding, creative, innovative human activities are what business is all about.  An organisation in which people interacted only via scripts loaded into machines could not think, could not respond, could not change and could not possibly provide effective support for its customers.  And if human-driven processes are indeed critical, they deserve effective computer support.” (Harrison-Broninski (2004)
Cybernetic Analysis using the VSM Attempt to identify design principles using structured approach the VSM by Stafford Beer Previously applied in pedagogic analysis of elearning systems (Liber & Britain, 1999 & 2004)
Simplified VSM (Liber & Britain, 2004)
Topics of analysis Distribution of work Monitoring Audit Self-organisation Reverberation Strategy
Distribution of work How do users end up in process roles? How are resources managed? Useful perspectives: Winograd and Flores (1986): CFA Russell et al (2004): workflow resource patterns
Simplistic concepts of work distribution abound in IT systems…
But simplicity can be deceptive! In some cases it just pushes complexity to the outside
 
 
Other considerations in work distribution Capability management Role-capability mapping and user-capability assessment
Monitoring (system 3) Monitoring for variety management Monitoring and self-regulation Challenge: identifying process states in dynamic, diverging processes Solutions: minimal representations (van der Alst, 2001); analog roll-up; declaration Issues: assumptions of control Requirement for openness in monitoring
Audit (System 3*) Process auditing Rewind and reflect Sampling Intervention
Self-organisation Self-organization can dramatically reduce the management demands of a system Delegation of process design Delegation of process initiation Requirement for workflow tools to be usable by process participants, not specialists
Reverberation Avoiding ‘process blindness’ or blinkered viewpoint leading to clashing activities Cross-cutting communication; openness of processes across related groups
Unforeseen events In work distribution, requiring reallocation, escalation, delegation… In process development, requiring redesign, termination, suspension… Monitoring and intervention Algedonic channel
Strategy (System 4) Forecasting Monitoring trends in the wider world Implementing strategy
Recursions and perspectives Work Item Work Package Project  Team Unit Department University/Company Consortium
From LAMS to RAMS Flexible role definitions supporting dynamic processes and shared ownership Choice of work distribution models, not just “simple assignment” Processes able to be redesigned while running by the participants Monitoring interfaces available for all participants, not just “teacher” role Analog and asserted digital indicators for monitoring Dashboard for multiple-level monitoring Tools to interact with more structured processes (e.g. bid/RQF submission, grid data processes)
Modified WfMC Reference Model
 
 
 
Observations Collaborative processes do not lend themselves to todays BPM methods Requirements for eResearch turned up using VSM-driven approach are also useful in eLearning
Future work Aligning process and policy (and the gray area inbetween) Capability management Validation of the approach
Cheers! [email_address] http://www.cetis.ac.uk/members/scott

More Related Content

PPT
SSADM
PPT
Defining Systems
PPTX
SYSTEM ANALYSIS AND DESIGN Assignment help
PPT
The Pragmatic Evaluation of Tool System Interoperability
PPTX
Software Development Methodologies-HSM, SSADM
PDF
Unit 11-systems-analysis-and-design
DOCX
Structured systems analysis and design methodology
PPTX
System analysis and design Part2
SSADM
Defining Systems
SYSTEM ANALYSIS AND DESIGN Assignment help
The Pragmatic Evaluation of Tool System Interoperability
Software Development Methodologies-HSM, SSADM
Unit 11-systems-analysis-and-design
Structured systems analysis and design methodology
System analysis and design Part2

What's hot (8)

PPT
Monica Crocker Implementing Ecm Aiim 2009
PDF
Success Factors for Enterprise Systems in the Higher Education Sector: A Case...
PPT
SAD 1st PPT
PDF
Determining Requirements Complexity - White Paper
PPT
Requirements Engineering Processes in Software Engineering SE6
PPT
W3 requirements engineering processes
PPT
Requirement Determination Process
Monica Crocker Implementing Ecm Aiim 2009
Success Factors for Enterprise Systems in the Higher Education Sector: A Case...
SAD 1st PPT
Determining Requirements Complexity - White Paper
Requirements Engineering Processes in Software Engineering SE6
W3 requirements engineering processes
Requirement Determination Process
Ad

Viewers also liked (20)

PPT
Õpidisaini põhimõtted
PPT
Fertilisers
ODP
Encyclopedie van de japanologie
PPT
elearning4
PPTX
Stylita
PDF
Katy Fit Kids Calendar
PPT
The New Gathering Place - Social Media for Arts Businessess
PDF
TEDx talk: How digital ecosystem changes learning
PDF
Castillo de Ainsa
PPT
Czy wlasciciel serwisu moze wpływac na jakosc User Generated Content?
PDF
Wplyw UGC na decyzje konsumentow
PPT
Esitluse loomise metoodika ja avaldamine veebis
PDF
Thurrock Cabinet Paper
PDF
Trappers Traders Cabin
PPT
Getting the Maximum Benefit from Free and Open Source Software
PPT
Den 2 geocaching_day_2010[1]
PPT
Presentatie Slm 4 Dec 2008
PPT
Unit 3 - Introduction
PPTX
Integrating figshare into our RDM workflow: University of Salford
PPT
Exploring New Technologies
Õpidisaini põhimõtted
Fertilisers
Encyclopedie van de japanologie
elearning4
Stylita
Katy Fit Kids Calendar
The New Gathering Place - Social Media for Arts Businessess
TEDx talk: How digital ecosystem changes learning
Castillo de Ainsa
Czy wlasciciel serwisu moze wpływac na jakosc User Generated Content?
Wplyw UGC na decyzje konsumentow
Esitluse loomise metoodika ja avaldamine veebis
Thurrock Cabinet Paper
Trappers Traders Cabin
Getting the Maximum Benefit from Free and Open Source Software
Den 2 geocaching_day_2010[1]
Presentatie Slm 4 Dec 2008
Unit 3 - Introduction
Integrating figshare into our RDM workflow: University of Salford
Exploring New Technologies
Ad

Similar to Designing systems for managing dynamic collaborative research processes (20)

PDF
Climbing the tree of unreachable fruits, reusing processes
PPT
Content workflow amber_swope_submitted
PPT
Begining The Analysys Invetigating System Requirement
PDF
S-CUBE LP: Chemical Modeling: Workflow Enactment based on the Chemical Metaphor
PDF
Towards an Open and Scientific Approach to Innovation Processes
PPTX
Socio organizational issues ppt
PPT
Vcs platform verhaal final
PPT
Situational Method Engineering
PPT
LIMS_ASQ.pptx
PDF
9 madderi sivalingamsaravanan_106-110
PDF
Traditional to Agile Development
ODT
Workflow Usage Best Practices
PPT
Rsc 2009 Process Management Yesterday Today Tomorrow
PPT
PPTX
Workflow User Interfaces Patterns
PPT
OLE Regional Workshop, Utah, Day One
PPT
Call2013
PPTX
Workflow systems
PDF
Speedbump or Springboard? Leveraging Change to Move Nintex Promapp Forward
PDF
chapter04-120827115356-phpapp01.pdf
Climbing the tree of unreachable fruits, reusing processes
Content workflow amber_swope_submitted
Begining The Analysys Invetigating System Requirement
S-CUBE LP: Chemical Modeling: Workflow Enactment based on the Chemical Metaphor
Towards an Open and Scientific Approach to Innovation Processes
Socio organizational issues ppt
Vcs platform verhaal final
Situational Method Engineering
LIMS_ASQ.pptx
9 madderi sivalingamsaravanan_106-110
Traditional to Agile Development
Workflow Usage Best Practices
Rsc 2009 Process Management Yesterday Today Tomorrow
Workflow User Interfaces Patterns
OLE Regional Workshop, Utah, Day One
Call2013
Workflow systems
Speedbump or Springboard? Leveraging Change to Move Nintex Promapp Forward
chapter04-120827115356-phpapp01.pdf

More from scottw (20)

PPT
How to engage students in real open source projects
PPT
Free, Libre and Open Source Software and Further Education
PDF
Open Forges and App Stores
PPT
Delivering Web To Mobile
PPT
Creating mobile web apps
PDF
Widgets and Mashups for Personal and Institutional Technologies
PDF
Open Source Junction: Apache Wookie and W3C Widgets
PDF
Dissemination beyond academic circles
PDF
Android
PDF
Wookie Intro
PDF
Build Widgets
PPT
Wookie Meetup
PPT
Wookie Meetup
PPT
Life of a Wookie
PPT
CRM & HE
PDF
Presence
PDF
FeedForward at RSP
PPT
Boxcri
PDF
Widgets And Wookies
PPT
Widgets - the Wookie project
How to engage students in real open source projects
Free, Libre and Open Source Software and Further Education
Open Forges and App Stores
Delivering Web To Mobile
Creating mobile web apps
Widgets and Mashups for Personal and Institutional Technologies
Open Source Junction: Apache Wookie and W3C Widgets
Dissemination beyond academic circles
Android
Wookie Intro
Build Widgets
Wookie Meetup
Wookie Meetup
Life of a Wookie
CRM & HE
Presence
FeedForward at RSP
Boxcri
Widgets And Wookies
Widgets - the Wookie project

Recently uploaded (20)

PDF
Be ready for tomorrow’s needs with a longer-lasting, higher-performing PC
PDF
EGCB_Solar_Project_Presentation_and Finalcial Analysis.pdf
PDF
FASHION-DRIVEN TEXTILES AS A CRYSTAL OF A NEW STREAM FOR STAKEHOLDER CAPITALI...
PDF
The Basics of Artificial Intelligence - Understanding the Key Concepts and Te...
PPTX
Blending method and technology for hydrogen.pptx
PDF
NewMind AI Journal Monthly Chronicles - August 2025
PDF
CCUS-as-the-Missing-Link-to-Net-Zero_AksCurious.pdf
PPTX
Strategic Picks — Prioritising the Right Agentic Use Cases [2/6]
PDF
Altius execution marketplace concept.pdf
PPT
Overviiew on Intellectual property right
PDF
State of AI in Business 2025 - MIT NANDA
PDF
eBook Outline_ AI in Cybersecurity – The Future of Digital Defense.pdf
PDF
Human Computer Interaction Miterm Lesson
PDF
ELLIE29.pdfWETWETAWTAWETAETAETERTRTERTER
PDF
Uncertainty-aware contextual multi-armed bandits for recommendations in e-com...
PDF
Rooftops detection with YOLOv8 from aerial imagery and a brief review on roof...
PPTX
AQUEEL MUSHTAQUE FAKIH COMPUTER CENTER .
PDF
TicketRoot: Event Tech Solutions Deck 2025
PDF
Intravenous drug administration application for pediatric patients via augmen...
PDF
Applying Agentic AI in Enterprise Automation
Be ready for tomorrow’s needs with a longer-lasting, higher-performing PC
EGCB_Solar_Project_Presentation_and Finalcial Analysis.pdf
FASHION-DRIVEN TEXTILES AS A CRYSTAL OF A NEW STREAM FOR STAKEHOLDER CAPITALI...
The Basics of Artificial Intelligence - Understanding the Key Concepts and Te...
Blending method and technology for hydrogen.pptx
NewMind AI Journal Monthly Chronicles - August 2025
CCUS-as-the-Missing-Link-to-Net-Zero_AksCurious.pdf
Strategic Picks — Prioritising the Right Agentic Use Cases [2/6]
Altius execution marketplace concept.pdf
Overviiew on Intellectual property right
State of AI in Business 2025 - MIT NANDA
eBook Outline_ AI in Cybersecurity – The Future of Digital Defense.pdf
Human Computer Interaction Miterm Lesson
ELLIE29.pdfWETWETAWTAWETAETAETERTRTERTER
Uncertainty-aware contextual multi-armed bandits for recommendations in e-com...
Rooftops detection with YOLOv8 from aerial imagery and a brief review on roof...
AQUEEL MUSHTAQUE FAKIH COMPUTER CENTER .
TicketRoot: Event Tech Solutions Deck 2025
Intravenous drug administration application for pediatric patients via augmen...
Applying Agentic AI in Enterprise Automation

Designing systems for managing dynamic collaborative research processes

  • 1. TENCompetence Workshop, Manchester 2007 Designing Systems for Managing Collaborative Research Processes Scott Wilson, CETIS; Yoichi Takayama, Ernie Ghiglione, James Dalziel, MELCOE This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence
  • 2. Context Two linked projects: RAMS & DRAMA Research by MELCOE Funded by DEST as part of programme backing Australia’s research capability
  • 3. Why collaborative research workflow? Plenty of work to date in process automation, especially data analysis Relatively little work on communication and collaboration-heavy processes Emphasis in funding on collaborative work (e.g. multi-partner) but patchy practice Possibility of scaffolding collaborative processes to improve effectiveness
  • 4. Which kinds of processes? Research management Research quality assessment Online research collaboration Data collection Monitoring, positioning new opportunities Proposal development Scheduling
  • 5. Research process characteristics May be weakly structured While some processes may be pre-determined, the majority exhibit dynamic properties, and may diverge from design at runtime Alternate periods of individual and team activity
  • 6. Potential benefits Greater standardisation of common or repeatable research processes, leading to higher quality outcomes and improved efficiency; The ability to share descriptions of common research processes both within institutions, and between institutions – including the ability to adapt and localise shared research processes; Greatly improved accountability and audit for processes involving multiple actors across multiple steps – such as for research assessment (e.g., RQF/RAE assessor workflows), as well as for research itself (e.g., as a deterrent to academic fraud); and Providing a process-oriented checklist to ensure the ordered completion of relevant research tasks.
  • 7. Potential risks The technology may be costly when compared to the actual benefits The technology may require new competences to devise and execute research processes, placing control of such processes into the hands of IT specialists rather than researchers themselves The technology may restrict unnecessarily the diversity of activities and approaches to conducting research The technology may be perceived as an attempt to control rather than enable the work of researchers
  • 8. Six Lenses (so far…) BPM HIM BPOKM CSC Learning Design VSM
  • 10. … can exhibit complex behaviour
  • 11. Is it worth the trouble? “ One might argue that in a world where routine processes have been automated by systems, these value-adding, creative, innovative human activities are what business is all about. An organisation in which people interacted only via scripts loaded into machines could not think, could not respond, could not change and could not possibly provide effective support for its customers. And if human-driven processes are indeed critical, they deserve effective computer support.” (Harrison-Broninski (2004)
  • 12. Cybernetic Analysis using the VSM Attempt to identify design principles using structured approach the VSM by Stafford Beer Previously applied in pedagogic analysis of elearning systems (Liber & Britain, 1999 & 2004)
  • 13. Simplified VSM (Liber & Britain, 2004)
  • 14. Topics of analysis Distribution of work Monitoring Audit Self-organisation Reverberation Strategy
  • 15. Distribution of work How do users end up in process roles? How are resources managed? Useful perspectives: Winograd and Flores (1986): CFA Russell et al (2004): workflow resource patterns
  • 16. Simplistic concepts of work distribution abound in IT systems…
  • 17. But simplicity can be deceptive! In some cases it just pushes complexity to the outside
  • 18.  
  • 19.  
  • 20. Other considerations in work distribution Capability management Role-capability mapping and user-capability assessment
  • 21. Monitoring (system 3) Monitoring for variety management Monitoring and self-regulation Challenge: identifying process states in dynamic, diverging processes Solutions: minimal representations (van der Alst, 2001); analog roll-up; declaration Issues: assumptions of control Requirement for openness in monitoring
  • 22. Audit (System 3*) Process auditing Rewind and reflect Sampling Intervention
  • 23. Self-organisation Self-organization can dramatically reduce the management demands of a system Delegation of process design Delegation of process initiation Requirement for workflow tools to be usable by process participants, not specialists
  • 24. Reverberation Avoiding ‘process blindness’ or blinkered viewpoint leading to clashing activities Cross-cutting communication; openness of processes across related groups
  • 25. Unforeseen events In work distribution, requiring reallocation, escalation, delegation… In process development, requiring redesign, termination, suspension… Monitoring and intervention Algedonic channel
  • 26. Strategy (System 4) Forecasting Monitoring trends in the wider world Implementing strategy
  • 27. Recursions and perspectives Work Item Work Package Project Team Unit Department University/Company Consortium
  • 28. From LAMS to RAMS Flexible role definitions supporting dynamic processes and shared ownership Choice of work distribution models, not just “simple assignment” Processes able to be redesigned while running by the participants Monitoring interfaces available for all participants, not just “teacher” role Analog and asserted digital indicators for monitoring Dashboard for multiple-level monitoring Tools to interact with more structured processes (e.g. bid/RQF submission, grid data processes)
  • 30.  
  • 31.  
  • 32.  
  • 33. Observations Collaborative processes do not lend themselves to todays BPM methods Requirements for eResearch turned up using VSM-driven approach are also useful in eLearning
  • 34. Future work Aligning process and policy (and the gray area inbetween) Capability management Validation of the approach