Peer Assessment of Collaborative Work Supported by Wikis and Google docs   Jože Rugelj (joze.rugelj@pef.uni-lj.si) Irena Nančovska Šerbec  (irena.nancovska@pef.uni-lj.si) University  of Ljubljana Slovenia
Survey Introduction Collaborative learning Educational assessment (self and peer assessment) Handout activities Conclusion http://hrast.pef.uni-lj.si/moodle / Rugelj, N. Šerbec JTEL 2010
Purpose We present a form of  wiki/google docs supported collaborative learning  followed by  collaborative  and  peer assessment .  Rugelj, N. Šerbec JTEL 2010
Rugelj, N. Šerbec JTEL 2010 What do we expect?
Introduction Importance of active learning Collaborative knowledge construction  Wikis/Google docs Peer assessment  Experience Faculty of Education, University of Ljubljana future computer science teachers.  first year students course on Introduction to the Internet Rugelj, N. Šerbec JTEL 2010
Introduction The acquisition of skills and competences for  collaborative work and  assessment  are  highly desired in the education of  teachers .  To develop the skills and competencies required for teaching, students have to  reflect on their own behaviour .  Rugelj, N. Šerbec JTEL 2010
Collaborative knowledge construction In the past: teacher assigned a learning activity that is carried out autonomously by the student Learning process ->  low  amount of social dimension.  Efficient learning:  collaborative learning  as a situation in which two or more people learn or attempt to learn something  together,  Creating the conditions for  individual cognitive development  as a result of  group interaction Rugelj, N. Šerbec JTEL 2010
Collaborative knowledge construction In  networked collaborative learning , assigning a group of students with the task of: collaboratively discovering the solution to a given problem ( collaborative problem- solving ) or  developing a written text ( co-writing ) based on a given argument (wikis , Google docs ),  Rugelj, N. Šerbec JTEL 2010
Collaborative knowledge construction Wiki unique and powerful  information-sharing redistribution of responsibility  to all group members; collaborat ion  in the various stages e valuation  and monitoring of activities : comments, linkers, tags, versioning Google docs free,  w eb-based word  processor   data storage   used to  c reate  and  edit documents  online while collaborating in real-time with other users versioning (revisions)  Rugelj, N. Šerbec JTEL 2010
Collaborative knowledge construction Teachers often experience  difficulty in evaluation students contributions  involved in co-writing activities :   the  level of learning  produced by the process itself  gauging the actual degree to which the individual has  actively participated  in and  contributed  to the shared written work .  Qualitative  and  quantitative  factors which influence the assessment Rugelj, N. Šerbec JTEL 2010
Assessment Rugelj, N. Šerbec JTEL 2010 Educational assessment  is the process of documenting,  usually in measurable terms, knowledge, skills, attitudes and beliefs. (wikipedia)
Assessment Rugelj, N. Šerbec JTEL 2010 What do we expect ?
Assessment of the 21st Century http://edorigami.wikispaces.com/21st+Century+Assessment  Allowing students input into the development of the assessment is a key step to achieving student  ownership  and  engagement .  Rugelj, N. Šerbec JTEL 2010
Educational Assessment  Self-, peer- and co-assessment  refer to activities of learners in which they evaluate their own  results  of work and those of their peers with similar learning backgrounds.  C oassessment   ->  assessment of the  project Peer assessment  is a process where students consider and specify the level or quality of a  result  or performance of other student s  within  the group. P eer-assessment   ->  assessment of individual ’ s  contribution  in the group . C riteria which reflect quality and quantity of individual’s contribution.  Rugelj, N. Šerbec JTEL 2010
Educational assessment Expected advantages (Sluijsmans, 1999) : Students' feelings of  ownership for their own learning Students’  motivation  students and  encouragement Assessment -  shared activity  rather than a lone one Promotes genuine  interchange of ideas Leads to  more directed  and  effective learning Autonomy  in learning Students’  judgments are respected Transferable personal skills Community of learning in which students feel that they have influence and  involvement Reduces  teachers workload Make students  think more deeply … Rugelj, N. Šerbec JTEL 2010
Educational assessment Questions: Do students feel uncomfortable when evaluating their peers?  Can students can give honest and fair assessment?  Is peer assessment reliable, valid? Reliability  is defined as "an indication of the consistency of scores across evaluators or over time.” Validity  is defined as "an indication of how well an assessment actually measures what it is supposed to measure” wikipedia What did we measure?  agreement with teacher judgments? agreement with an objective criterion?  Rugelj, N. Šerbec JTEL 2010
Handout activities Topic of collaborative learning: ICT in the schools Go to Moodle:  http://hrast.pef.uni-lj.si/moodle/   JTEL10 course Collaborative editing of wiki /google_docs  with peer assessment  Wikis in Moodle Google docs JTEL10 Ohrid 1..3 Peer assessment in the JTEL10 workshop Rugelj, N. Šerbec JTEL 2010
Assessment  of collab. learning Sem _grade =70%  project grade  + 30%  peer_ass_in_the_group project grade= co_wiki + t_wiki Rugelj, N. Šerbec JTEL 2010 Criteria  for project (intergroup) evaluation : quality   of result adequacy of topic descriptions ( adequacy ) clarity/structure   Scale d  from 0 to 10. We  combine teachers ( t_*)  and grades of peers for collaboration ( co_*) Criteria  for intragroup evaluation : quality   of individual contribution “ fresh”  ideas motivating  for collaboration Scale -4, -2, 0, 2, 4.  average level  =  0   (member_i)=0
Assessment  of collab. learning Research questions How the individual wiki /google_docs  grade is related to other grades achieved for particular seminar works (learning activities) and writing examination? How the co-assessment grade is related to teachers grade? Which criteria for individual wiki /google_docs  assessment is the most important?  Rugelj, N. Šerbec JTEL 2010
Experience at Faculty of Education Rugelj, N. Šerbec JTEL 2010 Peer-and co-assessment / teacher’s grade Which criteria for  individual wiki  assessment  are the most important?
Experience at Faculty of Education The  individual wiki grade  is strongly correlated with  teacher ratings .  Punctuality  and criteria that estimates whether the member stimulated and contributed to the effectiveness of  work within the group  are the most correlated to individual wikis grade. These criteria are related to  qualitative  properties of project work .  Quantitative  data , such as frequency of editing, are not strongly correlated to individual’s contribution assessment in wikis. Rugelj, N. Šerbec JTEL 2010
Further work Finish the project work in wikis/google_docs Evaluate other projects in the Moodle workshop ( http://hrast.pef.uni-lj.si/moodle  ) Evaluation how different ICT supported environments influence the assessment of project work. Rugelj, N. Šerbec JTEL 2010
Peer review in the scientific world Rugelj, N. Šerbec JTEL 2010

More Related Content

PPTX
Final Presentation
PDF
21 cld student work rubrics
PPTX
Esai april2015
PPT
SCDICT 2011 Keynote - Exploring Models of Effective Primary and Secondary E-L...
PPTX
Carpe diem pre workshop example
PDF
From Product to Process: The Analytics of Teamwork and Sensemaking
PPTX
2020_09_23 "Supporting teachers as designers with community and learning anal...
PPTX
Challenges in designing for horizontal learning - in the Danish VET system
Final Presentation
21 cld student work rubrics
Esai april2015
SCDICT 2011 Keynote - Exploring Models of Effective Primary and Secondary E-L...
Carpe diem pre workshop example
From Product to Process: The Analytics of Teamwork and Sensemaking
2020_09_23 "Supporting teachers as designers with community and learning anal...
Challenges in designing for horizontal learning - in the Danish VET system

What's hot (20)

PDF
Cantanet westnet
PPTX
Learning design
PPT
Book Launch: Designing effective feedback processes
PDF
SNS messages Recommendation for Learning Motivation (AIED 2015)
PPTX
Putting a Stake in the Ground: Institutionalizing a University and School Pa...
PPTX
Systemic Framework Supports Sustainability: University – Elementary School P...
PPTX
PATT38 - DESIGN FUTURES: Combining Design Thinking and Maker Education in ele...
PPTX
UDL and Assessment for Assessment and Learning
PPTX
Creating learning environments for self-generated feedback to thrive
PPTX
Personal Learning Graph (PLeG)
PDF
ASLD 2011 Opening
PPTX
INQUIRY INTO THE DEVELOPMENT OF A FLIPPED CLASSROOM PROJECT FOR TRAINING FUTU...
PPT
CEN launch, Diana Laurillard
PPT
Diana Laurillard: The Conversational Framework - an approach to Evaluating e-...
PPTX
Winning hearts and minds: tools and techniques to engage staff in curriculum ...
PPTX
Conole mexico keynote
PDF
Helping teachers to think about their design problem: a pilot study to stimul...
PPT
Project Based Learning Ppt For Oct 20 And 22nd
PDF
2015 11-17 Venia Legendi Kairit Tammets
PDF
21cld learning activity rubrics 2012
Cantanet westnet
Learning design
Book Launch: Designing effective feedback processes
SNS messages Recommendation for Learning Motivation (AIED 2015)
Putting a Stake in the Ground: Institutionalizing a University and School Pa...
Systemic Framework Supports Sustainability: University – Elementary School P...
PATT38 - DESIGN FUTURES: Combining Design Thinking and Maker Education in ele...
UDL and Assessment for Assessment and Learning
Creating learning environments for self-generated feedback to thrive
Personal Learning Graph (PLeG)
ASLD 2011 Opening
INQUIRY INTO THE DEVELOPMENT OF A FLIPPED CLASSROOM PROJECT FOR TRAINING FUTU...
CEN launch, Diana Laurillard
Diana Laurillard: The Conversational Framework - an approach to Evaluating e-...
Winning hearts and minds: tools and techniques to engage staff in curriculum ...
Conole mexico keynote
Helping teachers to think about their design problem: a pilot study to stimul...
Project Based Learning Ppt For Oct 20 And 22nd
2015 11-17 Venia Legendi Kairit Tammets
21cld learning activity rubrics 2012
Ad

Viewers also liked (8)

PPTX
Claudia Ribeiro
PPT
The tensions between expected and actual engagement in digitally–mediated com...
PPTX
Andriani Piki
PPTX
Niruwan
PPT
Ramon Ovelar
PPT
Nina Heinze
PPT
Turkan Karakus
PPT
Nuri Kara
Claudia Ribeiro
The tensions between expected and actual engagement in digitally–mediated com...
Andriani Piki
Niruwan
Ramon Ovelar
Nina Heinze
Turkan Karakus
Nuri Kara
Ad

Similar to Peer Assessment of Collaborative Work Supported by Wikis and Google docs (20)

PPTX
Setting the stage for student collaboration - Peter Levrai & Averil Bolster
PPTX
Hybrid Assessment: the key to assessing collaborative assignments​
PPSX
A definition for student collaboration in EAP: Implications for practice
PPTX
Looking Behind the Curtain: using technology to facilitate & assess group ess...
PPTX
Instructional Methods in Engineering Education.pptx
PPTX
The thorny issue of assessing collaborative assignments - a way forward - IAT...
PPTX
EAP practitioner attitudes to collaborative assignments (BALEAP Conference, 2...
PPTX
Rubric training .pptx
PPT
Ashok Iec2008 Presentation V2
PPTX
Assessment for, of, and as learning
PPTX
Quality, that complex issue: collaborative design for quality networked learn...
PPSX
Supporting teachers to support student collaboration
PPTX
Developing sustainable staff development for online teachers: What works and ...
PPTX
Tinoca & oliveira promoting formative assessment in online professional dev...
PPTX
Leading collaborative curriculum transformation by Nina Brooke, Michael Kilmi...
PDF
Sawamura assessment
PPTX
Assessment 101 -- Collaborative Tasks in Program- and Institution-Level Commi...
PPTX
2022-07-13 RE Setting Academic Standards (INSET) 2.pptx
PPTX
Lef information sessions
PPTX
Online and Blended learning courses of high pedagogical quality for professio...
Setting the stage for student collaboration - Peter Levrai & Averil Bolster
Hybrid Assessment: the key to assessing collaborative assignments​
A definition for student collaboration in EAP: Implications for practice
Looking Behind the Curtain: using technology to facilitate & assess group ess...
Instructional Methods in Engineering Education.pptx
The thorny issue of assessing collaborative assignments - a way forward - IAT...
EAP practitioner attitudes to collaborative assignments (BALEAP Conference, 2...
Rubric training .pptx
Ashok Iec2008 Presentation V2
Assessment for, of, and as learning
Quality, that complex issue: collaborative design for quality networked learn...
Supporting teachers to support student collaboration
Developing sustainable staff development for online teachers: What works and ...
Tinoca & oliveira promoting formative assessment in online professional dev...
Leading collaborative curriculum transformation by Nina Brooke, Michael Kilmi...
Sawamura assessment
Assessment 101 -- Collaborative Tasks in Program- and Institution-Level Commi...
2022-07-13 RE Setting Academic Standards (INSET) 2.pptx
Lef information sessions
Online and Blended learning courses of high pedagogical quality for professio...

More from jtelss10 (13)

PDF
Data Quality in data-driven projects
PPT
Jtel summer school2010 - pechakucha session
PPT
Olga Pustovalova
PPT
Maria Perifanou
PPT
Jo Dugstad Wake
PPT
Alev Elci
PPT
Carl Smith
PPT
Andrej Afonin
PPT
Elena Railean
PPT
Begum CUBUKCUOGLU
PPTX
The innovative, creative, and engaging educator in Academia
PPT
Scratch and pair programming
PDF
Orchestrating learning: survey
Data Quality in data-driven projects
Jtel summer school2010 - pechakucha session
Olga Pustovalova
Maria Perifanou
Jo Dugstad Wake
Alev Elci
Carl Smith
Andrej Afonin
Elena Railean
Begum CUBUKCUOGLU
The innovative, creative, and engaging educator in Academia
Scratch and pair programming
Orchestrating learning: survey

Recently uploaded (20)

PDF
horaris de grups del curs 2025-2026 de l'institut
PDF
[Medicalstudyzone.com] 1. AIIMS NOV EMBER 2015 SOLVED PAPER.pdf
PDF
Jana-Ojana Finals 2025 - School Quiz by Pragya - UEMK Quiz Club
PDF
Physical pharmaceutics two in b pharmacy
DOCX
HELMET DETECTION AND BIOMETRIC BASED VEHICLESECURITY USING MACHINE LEARNING.docx
PDF
Teacher's Day Quiz 2025
PPTX
Environmental Sciences and Sustainability Chapter 2
PDF
HSE and their team are going through the hazards of the issues with learning ...
PDF
Jana Ojana 2025 Prelims - School Quiz by Pragya - UEMK Quiz Club
PDF
BP303T PHARMACEUTICALMICROBIOLOGY UNIT 1
PDF
IS1343_2012...........................pdf
PDF
Design and Evaluation of a Inonotus obliquus-AgNP-Maltodextrin Delivery Syste...
PPTX
CHF refers to the condition wherein heart unable to pump a sufficient amount ...
PPTX
FILIPINO 8 Q2 WEEK 1(DAY 1).power point presentation
PDF
Global strategy and action plan on oral health 2023 - 2030.pdf
PPTX
Unit1_Kumod_deeplearning.pptx DEEP LEARNING
PDF
BA-1ST(Education)-Education and Society.pdf
PDF
BA-1ST(Education)-Education and Society.pdf
PDF
Unleashing the Potential of the Cultural and creative industries
horaris de grups del curs 2025-2026 de l'institut
[Medicalstudyzone.com] 1. AIIMS NOV EMBER 2015 SOLVED PAPER.pdf
Jana-Ojana Finals 2025 - School Quiz by Pragya - UEMK Quiz Club
Physical pharmaceutics two in b pharmacy
HELMET DETECTION AND BIOMETRIC BASED VEHICLESECURITY USING MACHINE LEARNING.docx
Teacher's Day Quiz 2025
Environmental Sciences and Sustainability Chapter 2
HSE and their team are going through the hazards of the issues with learning ...
Jana Ojana 2025 Prelims - School Quiz by Pragya - UEMK Quiz Club
BP303T PHARMACEUTICALMICROBIOLOGY UNIT 1
IS1343_2012...........................pdf
Design and Evaluation of a Inonotus obliquus-AgNP-Maltodextrin Delivery Syste...
CHF refers to the condition wherein heart unable to pump a sufficient amount ...
FILIPINO 8 Q2 WEEK 1(DAY 1).power point presentation
Global strategy and action plan on oral health 2023 - 2030.pdf
Unit1_Kumod_deeplearning.pptx DEEP LEARNING
BA-1ST(Education)-Education and Society.pdf
BA-1ST(Education)-Education and Society.pdf
Unleashing the Potential of the Cultural and creative industries

Peer Assessment of Collaborative Work Supported by Wikis and Google docs

  • 1. Peer Assessment of Collaborative Work Supported by Wikis and Google docs Jože Rugelj ([email protected]) Irena Nančovska Šerbec ([email protected]) University of Ljubljana Slovenia
  • 2. Survey Introduction Collaborative learning Educational assessment (self and peer assessment) Handout activities Conclusion http://hrast.pef.uni-lj.si/moodle / Rugelj, N. Šerbec JTEL 2010
  • 3. Purpose We present a form of wiki/google docs supported collaborative learning followed by collaborative and peer assessment . Rugelj, N. Šerbec JTEL 2010
  • 4. Rugelj, N. Šerbec JTEL 2010 What do we expect?
  • 5. Introduction Importance of active learning Collaborative knowledge construction Wikis/Google docs Peer assessment Experience Faculty of Education, University of Ljubljana future computer science teachers. first year students course on Introduction to the Internet Rugelj, N. Šerbec JTEL 2010
  • 6. Introduction The acquisition of skills and competences for collaborative work and assessment are highly desired in the education of teachers . To develop the skills and competencies required for teaching, students have to reflect on their own behaviour . Rugelj, N. Šerbec JTEL 2010
  • 7. Collaborative knowledge construction In the past: teacher assigned a learning activity that is carried out autonomously by the student Learning process -> low amount of social dimension. Efficient learning: collaborative learning as a situation in which two or more people learn or attempt to learn something together, Creating the conditions for individual cognitive development as a result of group interaction Rugelj, N. Šerbec JTEL 2010
  • 8. Collaborative knowledge construction In networked collaborative learning , assigning a group of students with the task of: collaboratively discovering the solution to a given problem ( collaborative problem- solving ) or developing a written text ( co-writing ) based on a given argument (wikis , Google docs ), Rugelj, N. Šerbec JTEL 2010
  • 9. Collaborative knowledge construction Wiki unique and powerful information-sharing redistribution of responsibility to all group members; collaborat ion in the various stages e valuation and monitoring of activities : comments, linkers, tags, versioning Google docs free, w eb-based word processor data storage used to c reate and edit documents online while collaborating in real-time with other users versioning (revisions) Rugelj, N. Šerbec JTEL 2010
  • 10. Collaborative knowledge construction Teachers often experience difficulty in evaluation students contributions involved in co-writing activities : the level of learning produced by the process itself gauging the actual degree to which the individual has actively participated in and contributed to the shared written work . Qualitative and quantitative factors which influence the assessment Rugelj, N. Šerbec JTEL 2010
  • 11. Assessment Rugelj, N. Šerbec JTEL 2010 Educational assessment is the process of documenting, usually in measurable terms, knowledge, skills, attitudes and beliefs. (wikipedia)
  • 12. Assessment Rugelj, N. Šerbec JTEL 2010 What do we expect ?
  • 13. Assessment of the 21st Century http://edorigami.wikispaces.com/21st+Century+Assessment Allowing students input into the development of the assessment is a key step to achieving student ownership and engagement . Rugelj, N. Šerbec JTEL 2010
  • 14. Educational Assessment Self-, peer- and co-assessment refer to activities of learners in which they evaluate their own results of work and those of their peers with similar learning backgrounds. C oassessment -> assessment of the project Peer assessment is a process where students consider and specify the level or quality of a result or performance of other student s within the group. P eer-assessment -> assessment of individual ’ s contribution in the group . C riteria which reflect quality and quantity of individual’s contribution. Rugelj, N. Šerbec JTEL 2010
  • 15. Educational assessment Expected advantages (Sluijsmans, 1999) : Students' feelings of ownership for their own learning Students’ motivation students and encouragement Assessment - shared activity rather than a lone one Promotes genuine interchange of ideas Leads to more directed and effective learning Autonomy in learning Students’ judgments are respected Transferable personal skills Community of learning in which students feel that they have influence and involvement Reduces teachers workload Make students think more deeply … Rugelj, N. Šerbec JTEL 2010
  • 16. Educational assessment Questions: Do students feel uncomfortable when evaluating their peers? Can students can give honest and fair assessment? Is peer assessment reliable, valid? Reliability is defined as "an indication of the consistency of scores across evaluators or over time.” Validity is defined as "an indication of how well an assessment actually measures what it is supposed to measure” wikipedia What did we measure? agreement with teacher judgments? agreement with an objective criterion? Rugelj, N. Šerbec JTEL 2010
  • 17. Handout activities Topic of collaborative learning: ICT in the schools Go to Moodle: http://hrast.pef.uni-lj.si/moodle/ JTEL10 course Collaborative editing of wiki /google_docs with peer assessment Wikis in Moodle Google docs JTEL10 Ohrid 1..3 Peer assessment in the JTEL10 workshop Rugelj, N. Šerbec JTEL 2010
  • 18. Assessment of collab. learning Sem _grade =70% project grade + 30% peer_ass_in_the_group project grade= co_wiki + t_wiki Rugelj, N. Šerbec JTEL 2010 Criteria for project (intergroup) evaluation : quality of result adequacy of topic descriptions ( adequacy ) clarity/structure Scale d from 0 to 10. We combine teachers ( t_*) and grades of peers for collaboration ( co_*) Criteria for intragroup evaluation : quality of individual contribution “ fresh” ideas motivating for collaboration Scale -4, -2, 0, 2, 4. average level = 0  (member_i)=0
  • 19. Assessment of collab. learning Research questions How the individual wiki /google_docs grade is related to other grades achieved for particular seminar works (learning activities) and writing examination? How the co-assessment grade is related to teachers grade? Which criteria for individual wiki /google_docs assessment is the most important? Rugelj, N. Šerbec JTEL 2010
  • 20. Experience at Faculty of Education Rugelj, N. Šerbec JTEL 2010 Peer-and co-assessment / teacher’s grade Which criteria for individual wiki assessment are the most important?
  • 21. Experience at Faculty of Education The individual wiki grade is strongly correlated with teacher ratings . Punctuality and criteria that estimates whether the member stimulated and contributed to the effectiveness of work within the group are the most correlated to individual wikis grade. These criteria are related to qualitative properties of project work . Quantitative data , such as frequency of editing, are not strongly correlated to individual’s contribution assessment in wikis. Rugelj, N. Šerbec JTEL 2010
  • 22. Further work Finish the project work in wikis/google_docs Evaluate other projects in the Moodle workshop ( http://hrast.pef.uni-lj.si/moodle ) Evaluation how different ICT supported environments influence the assessment of project work. Rugelj, N. Šerbec JTEL 2010
  • 23. Peer review in the scientific world Rugelj, N. Šerbec JTEL 2010