Methods for Identifying and Analysing
      Learning Communities

                       Richard	
  A.	
  Schwier
          Virtual	
  Community	
  Research	
  Laboratory
             Educa;onal	
  Technology	
  and	
  Design
                University	
  of	
  Saskatchewan




                                          Higher	
  Educa;on	
  Development	
  Centre
                                                      University	
  of	
  Otago
                                                     Dunedin,	
  New	
  Zealand
                                                       February	
  7,	
  2011
Central	
  Concerns
•   ShiNing	
  focus	
  of	
  research
•   Atomized	
  view	
  of	
  communi;es
•   Tools	
  for	
  analysis
•   Genera;on	
  of	
  models
•   Using	
  research	
  to	
  inform	
  development	
  
    of	
  online	
  learning	
  environments
Community


Modeling                Cons;tuents




           Comparison
Research Methods for Identifying and Analysing Virtual Learning Communities
Research Methods for Identifying and Analysing Virtual Learning Communities
Sense	
  of	
  Community
• Chavis’	
  “Sense	
  of	
  Community	
  Index”
• Rovai	
  &	
  Jordan’s	
  “Classroom	
  Community	
  
  Scale”	
  (Chronbach’s	
  alpha	
  =	
  .93)
   – Connectedness	
  (.92)
   – Learning	
  (.87)

• Pre-­‐post	
  design	
  (t-­‐Test,	
  p<.005)
Interac;on	
  Analysis
• Fahy,	
  Crawford	
  &	
  Ally	
  (TAT)
• Intensity
   – “levels of participation," or the degree to which the
     number of postings observed in a group exceed the
     number of required postings

   – 858 actual/490 required = 1.75
Interac;on	
  analysis
• Density	
  
   – Included	
  only	
  peripheral	
  interac;ons
   – the	
  ra;o	
  of	
  the	
  actual	
  number	
  of	
  connec;ons	
  
     observed,	
  to	
  the	
  total	
  poten;al	
  number	
  of	
  
     possible	
  connec;ons

   2a/N(N-­‐1)	
  =	
  2(122)/13(12)	
  =	
  .78
Reciprocity	
  ra;o
the parity of communication among participants
Plodng
	
  Reciprocity
Characteris;cs	
  of	
  Community
    • Transcript	
  analysis
    • Interviews
    • Focus	
  groups
Characteris;cs
• Awareness             •   Par;cipa;on
• Social	
  protocols   •   Trust
• Historicity           •   Trajectory
• Iden;ty               •   Technology
• Mutuality             •   Learning
• Plurality             •   Reflec;on
• Autonomy              •   Intensity
Comparison	
  of	
  characteris;cs
• Thurstone	
  analysis
Thurstone	
  Scale
Modeling
Bayesian	
  Belief	
  Network	
  Model	
  of	
  a	
  Virtual	
  
             Learning	
  Community
BBN	
  -­‐	
  Query	
  the	
  network
BBN	
  -­‐	
  Query	
  the	
  network
Sense	
  of	
  Community
       Rovai	
  &	
  Jordan’s	
  “Classroom	
  Community	
  Scale”	
  (Chronbach’s	
  alpha	
  =	
  .93)




90.0

67.5

45.0
                     Formal
22.5                                                   Non-Formal
   0
Intensity
        Fahy,	
  Crawford	
  &	
  Ally	
  (TAT)



2.0

1.5

1.0
      Formal
0.5

  0                      Non-Formal
Density
        Fahy,	
  Crawford	
  &	
  Ally	
  (TAT)



0.8

0.6

0.4
      Formal
0.2                      Non-Formal
  0
Reciprocity	
  ra;o	
  
                Instructors



15.0

11.3

 7.5

 3.8               Non-Formal

   0   Formal
Reciprocity
                    par;cipants



1.0

0.8

0.5
      Mean                        Mean     sd
0.3
             sd
  0
        Formal
                                   Non-Formal


                                                0.376276399
Order	
  of	
  importance	
  -­‐	
  elements
           Element   Formal    Non-­‐formal
   Trust                1             7
   Learning            2            3
   Par;cipa;on         3            6
   Mutuality           4           10
   Intensity           5            7
   Protocols           6           10
   Reflec;on            7            2
   Autonomy             8          10
   Awareness            9           1
   Iden;ty             10           4
   Trajectory          11          13
   Technology          12           4
   Historicity         13          13
   Plurality           14           7
And	
  lately...
Par;cipa;on	
  Pakerns
Interac;on	
  analysis
     • Thread	
  density	
  and	
  depth	
  (Wiley,	
  2010)

            – Calcula;on	
  of	
  levels	
  of	
  replies	
  in	
  conversa;on	
  
              threads
            – Data	
  flawed,	
  but	
  useful

Mean	
  Reply	
  Depth	
  (MRD	
  crude)	
  =	
  sum	
  of	
  reply	
  depth	
  for	
  all	
  messages/messages	
  in	
  the	
  thread

Mean	
  Reply	
  Depth	
  (corrected)=	
  MRD	
  (crude)	
  x	
  ((n-­‐b(childless	
  messages)/n)
Do	
  not	
  akempt	
  to	
  read	
  this!
Do	
  not	
  akempt	
  to	
  read	
  this!

                      Mulitlogue/discussion




                      Simple	
  Q&A/chit-­‐chat




                     Monologue/no	
  discussion
SNAPP




hkp://research.uow.edu.au/learningnetworks/seeing/snapp/
Keep	
  an	
  eye	
  on...
Technology	
  Enhanced	
  Knowledge	
  Research	
  
  Ins;tute	
  (TEKRI)-­‐	
  hkps://tekri.athabascau.ca/
     George	
  Siemens	
  &	
  data	
  analy;cs
Conclusions
• Cycle	
  of	
  analysis	
  is	
  more	
  important	
  than	
  specific	
  
  tools	
  used
• Mixed	
  methods	
  seems	
  reasonable,	
  and	
  worked	
  well	
  
  in	
  prac;ce
• Baseline	
  data	
  are	
  needed	
  to	
  situate	
  findings
• Modeling	
  is	
  an	
  act	
  of	
  systema;c	
  specula;on	
  
  influenced	
  by	
  data	
  (not	
  limited	
  by	
  data)
• Most	
  enjoyable	
  part:	
  the	
  hunt

More Related Content

PPTX
Action research for_librarians_carl2012
PDF
DLA2009 Presentation S Porto
PPT
Participation Patterns in Formal, Non-Formal, and Informal Online Learning En...
PDF
Drupal - LinuxDay 2010 (Pistoia)
PDF
What's the Deal with Open Standards and Open Source Software
PDF
What Is A Distance Educator?
PDF
LPI Points on Facts and Focus
PDF
Qt Mobile: Sviluppo mobile con Python e Qt Framework
Action research for_librarians_carl2012
DLA2009 Presentation S Porto
Participation Patterns in Formal, Non-Formal, and Informal Online Learning En...
Drupal - LinuxDay 2010 (Pistoia)
What's the Deal with Open Standards and Open Source Software
What Is A Distance Educator?
LPI Points on Facts and Focus
Qt Mobile: Sviluppo mobile con Python e Qt Framework

Viewers also liked (20)

PPTX
Rubricas
PPS
Pets in the US
PPTX
Porto China-US Distance Education Research & Exchange 2011
PDF
Designing for Change
PDF
Mde Presentation Semana EAD 2009
ODP
Presentazione Ubuntu Oneiric 11.10 - LinuxDay 2011
PPTX
Agenda gadla-event-08-19-2011
PDF
Innovatie en Kennisdeling
PDF
Drupal - LinuxDay 2010 (Pistoia)
PDF
Life In Finland, blog texts in Chinese and Images
PDF
Manhattan Elite Prep GMAT Tip: Get to the Right Answer Quickly
PDF
Gevangen in de Wolken (saMBO-ICT versie)
PDF
Creating a custom Django Middleware
PDF
Porto USDLA'2009 Presentation
KEY
Mountain
PDF
L'uso del VOIP in azienda (LinuxDay 2010 - Pistoia)
PPTX
Managing Online Programs
PPT
Git preso to valtech cfml team
PPTX
Scad de l2010-s_porto
PDF
USDLA 2010 - S.Porto
Rubricas
Pets in the US
Porto China-US Distance Education Research & Exchange 2011
Designing for Change
Mde Presentation Semana EAD 2009
Presentazione Ubuntu Oneiric 11.10 - LinuxDay 2011
Agenda gadla-event-08-19-2011
Innovatie en Kennisdeling
Drupal - LinuxDay 2010 (Pistoia)
Life In Finland, blog texts in Chinese and Images
Manhattan Elite Prep GMAT Tip: Get to the Right Answer Quickly
Gevangen in de Wolken (saMBO-ICT versie)
Creating a custom Django Middleware
Porto USDLA'2009 Presentation
Mountain
L'uso del VOIP in azienda (LinuxDay 2010 - Pistoia)
Managing Online Programs
Git preso to valtech cfml team
Scad de l2010-s_porto
USDLA 2010 - S.Porto
Ad

Similar to Research Methods for Identifying and Analysing Virtual Learning Communities (20)

DOC
Did we become a community - A Literature Review
PDF
Exploring the Use of Social Networking In the College Classroom
PPTX
Anatomy of a ph d terry final
PPTX
Information Superhighway for the Networked Teachers IATEFL 2013
PPTX
Paredes chung lak12 v4.0
KEY
Pursuing the elusive metaphor of community in e-learning environments
PPT
Holmes online learning communities nl2012
PPT
Grand Junction 2011 Presentation
PPTX
Learning Analytics for Online Discussions: A Pedagogical Model for Intervent...
PPT
Social Learning Analytics, Southern SoLAR Flare
PPTX
Strategies to Engage Students in Collaborative Online Learning
KEY
USING SOCIAL MEDIA TO ENGAGE TEACHER CANDIDATES IN RELEVANT, TIMELY, AND RICH...
PPTX
Communities of inquiry and Assessment
PPTX
Student perception of collaborative small group projects using synchronous an...
PPTX
Modelling Learning & Performance: A Social Networks Perspective
PPT
Basic principles of interaction for learning in web based environment
PPTX
Data Archeology - A theory- and context-informed approach to analyzing data t...
PDF
Online students initiate informal learning practices using social tools
PDF
Measuring Communities of Practice
PPTX
Building community
Did we become a community - A Literature Review
Exploring the Use of Social Networking In the College Classroom
Anatomy of a ph d terry final
Information Superhighway for the Networked Teachers IATEFL 2013
Paredes chung lak12 v4.0
Pursuing the elusive metaphor of community in e-learning environments
Holmes online learning communities nl2012
Grand Junction 2011 Presentation
Learning Analytics for Online Discussions: A Pedagogical Model for Intervent...
Social Learning Analytics, Southern SoLAR Flare
Strategies to Engage Students in Collaborative Online Learning
USING SOCIAL MEDIA TO ENGAGE TEACHER CANDIDATES IN RELEVANT, TIMELY, AND RICH...
Communities of inquiry and Assessment
Student perception of collaborative small group projects using synchronous an...
Modelling Learning & Performance: A Social Networks Perspective
Basic principles of interaction for learning in web based environment
Data Archeology - A theory- and context-informed approach to analyzing data t...
Online students initiate informal learning practices using social tools
Measuring Communities of Practice
Building community
Ad

More from Richard Schwier (7)

PPTX
Connections and Contexts: The Birth, Growth and Death of Online Learning Comm...
PPT
Open Scholarship of Teaching and Learning
PPT
ID as Social Process
PPT
Agency and Instructional Design
PPT
Some History Of Educational Technology
PPT
Technology for Important Things: TLt Keynote 2008
PPT
WBE 08 - VLC Comparison
Connections and Contexts: The Birth, Growth and Death of Online Learning Comm...
Open Scholarship of Teaching and Learning
ID as Social Process
Agency and Instructional Design
Some History Of Educational Technology
Technology for Important Things: TLt Keynote 2008
WBE 08 - VLC Comparison

Recently uploaded (20)

PDF
Physical pharmaceutics two in b pharmacy
PDF
Kalaari-SaaS-Founder-Playbook-2024-Edition-.pdf
PPTX
principlesofmanagementsem1slides-131211060335-phpapp01 (1).ppt
PPTX
Neurological complocations of systemic disease
PDF
Chevening Scholarship Application and Interview Preparation Guide
PPTX
IT infrastructure and emerging technologies
PPTX
Cite It Right: A Compact Illustration of APA 7th Edition.pptx
PPSX
namma_kalvi_12th_botany_chapter_9_ppt.ppsx
PDF
Diabetes Mellitus , types , clinical picture, investigation and managment
PDF
Laparoscopic Imaging Systems at World Laparoscopy Hospital
PPTX
Theoretical for class.pptxgshdhddhdhdhgd
PPTX
Power Point PR B.Inggris 12 Ed. 2019.pptx
PPTX
Copy of ARAL Program Primer_071725(1).pptx
PPTX
PAIN PATHWAY & MANAGEMENT OF ACUTE AND CHRONIC PAIN SPEAKER: Dr. Rajasekhar ...
PDF
Review of Related Literature & Studies.pdf
PPTX
GW4 BioMed Candidate Support Webinar 2025
PPTX
operating_systems_presentations_delhi_nc
PDF
English 2nd semesteNotesh biology biopsy results from the other day and I jus...
PDF
African Communication Research: A review
PDF
Health aspects of bilberry: A review on its general benefits
Physical pharmaceutics two in b pharmacy
Kalaari-SaaS-Founder-Playbook-2024-Edition-.pdf
principlesofmanagementsem1slides-131211060335-phpapp01 (1).ppt
Neurological complocations of systemic disease
Chevening Scholarship Application and Interview Preparation Guide
IT infrastructure and emerging technologies
Cite It Right: A Compact Illustration of APA 7th Edition.pptx
namma_kalvi_12th_botany_chapter_9_ppt.ppsx
Diabetes Mellitus , types , clinical picture, investigation and managment
Laparoscopic Imaging Systems at World Laparoscopy Hospital
Theoretical for class.pptxgshdhddhdhdhgd
Power Point PR B.Inggris 12 Ed. 2019.pptx
Copy of ARAL Program Primer_071725(1).pptx
PAIN PATHWAY & MANAGEMENT OF ACUTE AND CHRONIC PAIN SPEAKER: Dr. Rajasekhar ...
Review of Related Literature & Studies.pdf
GW4 BioMed Candidate Support Webinar 2025
operating_systems_presentations_delhi_nc
English 2nd semesteNotesh biology biopsy results from the other day and I jus...
African Communication Research: A review
Health aspects of bilberry: A review on its general benefits

Research Methods for Identifying and Analysing Virtual Learning Communities

  • 1. Methods for Identifying and Analysing Learning Communities Richard  A.  Schwier Virtual  Community  Research  Laboratory Educa;onal  Technology  and  Design University  of  Saskatchewan Higher  Educa;on  Development  Centre University  of  Otago Dunedin,  New  Zealand February  7,  2011
  • 2. Central  Concerns • ShiNing  focus  of  research • Atomized  view  of  communi;es • Tools  for  analysis • Genera;on  of  models • Using  research  to  inform  development   of  online  learning  environments
  • 3. Community Modeling Cons;tuents Comparison
  • 6. Sense  of  Community • Chavis’  “Sense  of  Community  Index” • Rovai  &  Jordan’s  “Classroom  Community   Scale”  (Chronbach’s  alpha  =  .93) – Connectedness  (.92) – Learning  (.87) • Pre-­‐post  design  (t-­‐Test,  p<.005)
  • 7. Interac;on  Analysis • Fahy,  Crawford  &  Ally  (TAT) • Intensity – “levels of participation," or the degree to which the number of postings observed in a group exceed the number of required postings – 858 actual/490 required = 1.75
  • 8. Interac;on  analysis • Density   – Included  only  peripheral  interac;ons – the  ra;o  of  the  actual  number  of  connec;ons   observed,  to  the  total  poten;al  number  of   possible  connec;ons 2a/N(N-­‐1)  =  2(122)/13(12)  =  .78
  • 9. Reciprocity  ra;o the parity of communication among participants
  • 11. Characteris;cs  of  Community • Transcript  analysis • Interviews • Focus  groups
  • 12. Characteris;cs • Awareness • Par;cipa;on • Social  protocols • Trust • Historicity • Trajectory • Iden;ty • Technology • Mutuality • Learning • Plurality • Reflec;on • Autonomy • Intensity
  • 13. Comparison  of  characteris;cs • Thurstone  analysis
  • 15. Modeling Bayesian  Belief  Network  Model  of  a  Virtual   Learning  Community
  • 16. BBN  -­‐  Query  the  network
  • 17. BBN  -­‐  Query  the  network
  • 18. Sense  of  Community Rovai  &  Jordan’s  “Classroom  Community  Scale”  (Chronbach’s  alpha  =  .93) 90.0 67.5 45.0 Formal 22.5 Non-Formal 0
  • 19. Intensity Fahy,  Crawford  &  Ally  (TAT) 2.0 1.5 1.0 Formal 0.5 0 Non-Formal
  • 20. Density Fahy,  Crawford  &  Ally  (TAT) 0.8 0.6 0.4 Formal 0.2 Non-Formal 0
  • 21. Reciprocity  ra;o   Instructors 15.0 11.3 7.5 3.8 Non-Formal 0 Formal
  • 22. Reciprocity par;cipants 1.0 0.8 0.5 Mean Mean sd 0.3 sd 0 Formal Non-Formal 0.376276399
  • 23. Order  of  importance  -­‐  elements Element Formal Non-­‐formal Trust 1 7 Learning 2 3 Par;cipa;on 3 6 Mutuality 4 10 Intensity 5 7 Protocols 6 10 Reflec;on 7 2 Autonomy 8 10 Awareness 9 1 Iden;ty 10 4 Trajectory 11 13 Technology 12 4 Historicity 13 13 Plurality 14 7
  • 26. Interac;on  analysis • Thread  density  and  depth  (Wiley,  2010) – Calcula;on  of  levels  of  replies  in  conversa;on   threads – Data  flawed,  but  useful Mean  Reply  Depth  (MRD  crude)  =  sum  of  reply  depth  for  all  messages/messages  in  the  thread Mean  Reply  Depth  (corrected)=  MRD  (crude)  x  ((n-­‐b(childless  messages)/n)
  • 27. Do  not  akempt  to  read  this!
  • 28. Do  not  akempt  to  read  this! Mulitlogue/discussion Simple  Q&A/chit-­‐chat Monologue/no  discussion
  • 30. Keep  an  eye  on... Technology  Enhanced  Knowledge  Research   Ins;tute  (TEKRI)-­‐  hkps://tekri.athabascau.ca/ George  Siemens  &  data  analy;cs
  • 31. Conclusions • Cycle  of  analysis  is  more  important  than  specific   tools  used • Mixed  methods  seems  reasonable,  and  worked  well   in  prac;ce • Baseline  data  are  needed  to  situate  findings • Modeling  is  an  act  of  systema;c  specula;on   influenced  by  data  (not  limited  by  data) • Most  enjoyable  part:  the  hunt