EFFECTS OF A DIGITAL INTERVENTION ON
THE DEVELOPMENT OF ALGEBRAIC EXPERTISE




                                     xkcd.com

            Christian Bokhove
         FIsme, Utrecht University

            July 14th, ICME-12
Rationale




Algebraic skills
Year 12 students
Netherlands
often
disappointing
But even when rewriting
     skills are OK…




  …many things can go wrong
So conceptual understanding and
pattern recognition are important!
Use of ICT
So can’t we use ICT for
  acquiring, practicing and
assessing algebraic expertise?
Research questions:
What is the effect of an intervention on the
development of algebraic
expertise, including both procedural skills
and symbol sense?
Which factors predict the resulting
algebraic performance?
   Conceptual framework, elements of:
   • Symbol sense – basic skills (e.g. Arcavi)
   • Formative – summative assessment
     (e.g. Black & Wiliam)
   • Feedback
Research set-up
Rnd Focus                   Target           N
Pre   What software, what   Experts
      characteristics?
1     Could it work?        1-to-1s,         N=5
                            qualitative
2     In what way can it    2 classes in 1   N=31
      work?                 school
3     Does it work?         9 schools,       N=324
                            quantitative
Research set-up
Rnd Focus                   Target           N
Pre   What software, what   Experts
      characteristics?
1     Could it work?        1-to-1s,         N=5
                            qualitative
2     In what way can it    2 classes in 1   N=31
      work?                 school
3     Does it work?         9 schools,       N=324
                            quantitative
Third round design
• 324 students in 9 schools (N=324)
• Year 12, nature and health stream
• Digital module: 6 hours, 6 parts
• Teachers were free in how to deploy the
  module, but were asked afterwards
• Data collection
   – Scores pen-and-paper pre- and posttests
   – Scores and logfiles
   – Questionnaires
Some features of the digital module1




   www.algebrametinzicht.nl
          1Made  with the authoring environment of
          the Digital Mathematical Environment,
Equations: in-between steps, multiple
strategies allowed
Store student results, and use these as a
teacher to study misconceptions and for
starting classroom discussions




         students
Feedback
Feedback: worked examples and hints




          IDEAS feedback, webservice with Jeuring
Other features of the digital tool
• Intentional “crises” tasks: hard-to-solve
  tasks to force students to rethink
  strategies
• Formative scenarios: at first feedback at
  every step, but gradually fading it away
  towards the end of the module
• Instructional screencasts
• Randomization
Effect
Posttest (M=78.71, SE=15.175) is significantly higher
than the pretest score (M=51.55, SE=21.094), t(285)=-
22.589, p<.001, r=.801.

Symbol sense score on the posttest (M=1.462,
SE=1.504) is significantly higher than the pretest score
(M=-1.493, SE=2.339), t(285)=-20.602, p<.001, r=.773.
Predictors
Significant             Non-significant
predictors higher       predictors higher
posttest score          posttest score
• Previous knowledge     • Gender
• Time spent in self-    • Attitude towards ICT
  test and summative-    • Total time spent on
  test modes               module
• General attitude       • More time spent at
  towards mathematics      home or at school
New developments
Thank you                               감사합니다
               Christian Bokhove
               Twitter: cb1601ej
             cbokhove@gmail.com
            www.fi.uu.nl/~christianb
            www.algebrametinzicht.nl
             (also for pdf of thesis)
Crises
 “Failure is, in a
 sense, the highway
 to success” Keats

• Van Hiele: crisis of learning
• Productive failure (Kapur)
• Impasse (VanLehn et al)
• Perturbation (Doll)
• Disequilibrium (Piaget)
Extra: example of crisis task
Many students work towards…
http://msmcculloughsmathclass.blogspot.com/2010/12/quadratic-formula.html
Crisis-task
xkcd.com
Overcoming a crisis




                 Feedback



               Youtube clips
Formative scenarios
ICME-12 presentation
ICME-12 presentation
ICME-12 presentation

More Related Content

PPTX
Math fluency for all students ppt
PPTX
Algebraic thinking: generalizations, patterns and functions
PPTX
Math fluency for all students ppt
PDF
Bar modeling
PDF
Using bar models 35
PPTX
Bar Modeling in Math Instruction
PDF
Using bar models
PPTX
AQT February PLC 2012
Math fluency for all students ppt
Algebraic thinking: generalizations, patterns and functions
Math fluency for all students ppt
Bar modeling
Using bar models 35
Bar Modeling in Math Instruction
Using bar models
AQT February PLC 2012

What's hot (20)

PDF
Scott Brewster - Leveraging Serious Games to Promote STEM Competency for Pre-...
PPTX
Mathematics at roxy
PDF
Early Logic sales pitchdeck
DOCX
Kindergarten math sheet
PPT
2011Using Data Analytics
PDF
Using Cognitive Modeling in Mathematics Instruction
PPTX
Strategy 1.3 - September
PPT
Blog virtual manipulatives research ppt
PDF
Computational Thinking as an Emergent Learning Trajectory of Mathematics
PDF
A Gamified Tutorial for Learning about Security Requirements Engineering
PDF
Investing in laboratory and field experiences in support of undergraduate sci...
PDF
Making the most of math manipulatives
PPT
Southampton, seminar june 2013
PDF
Offering adaptive support for self-regulated learning with learning analytics...
PPT
Mathematical knowledgeforteaching
PPTX
The Future Teacher
PPT
Inter-Phase Teaching and Learning
PDF
Self-regulated learning skills matter in dashboard sense-making
PDF
CSU Long Beach, Math Redesign Project
PDF
Increasing students’ motivation by using virtual learning environments based ...
Scott Brewster - Leveraging Serious Games to Promote STEM Competency for Pre-...
Mathematics at roxy
Early Logic sales pitchdeck
Kindergarten math sheet
2011Using Data Analytics
Using Cognitive Modeling in Mathematics Instruction
Strategy 1.3 - September
Blog virtual manipulatives research ppt
Computational Thinking as an Emergent Learning Trajectory of Mathematics
A Gamified Tutorial for Learning about Security Requirements Engineering
Investing in laboratory and field experiences in support of undergraduate sci...
Making the most of math manipulatives
Southampton, seminar june 2013
Offering adaptive support for self-regulated learning with learning analytics...
Mathematical knowledgeforteaching
The Future Teacher
Inter-Phase Teaching and Learning
Self-regulated learning skills matter in dashboard sense-making
CSU Long Beach, Math Redesign Project
Increasing students’ motivation by using virtual learning environments based ...
Ad

Viewers also liked (20)

PPT
Presentation MASE meeting on MC2
PDF
Getal en Ruimte docentendag 10-4-2012
PPTX
Nwd 010213 def
PPT
Dudoc 160111 1
PPT
Using Web Science for Educational Research
PPTX
Authoring Your OWN creative, electronic book for mathematics: the MC-squared ...
PPTX
Co-designing electronic books: boundary objects for social creativity
PDF
Use of ICT for acquiring, practicing and assessing algebraic expertise
PPT
Public Lecture Hong Kong University, 18 November 2015
PPTX
Narratives in Contemporary Games
PPTX
Presentation geogebra 250912
PPTX
La cogeneration au service de l'entreprise pour une croissance durable et per...
PPT
Opportunity to learn secondary maths: A curriculum approach with TIMSS 2011 data
PPT
Geogebra intro
PPTX
Presentatie researchED Amsterdam
PPTX
Textbook use in England: Mining OFSTED reports for views on mathematics text...
PPTX
Exploring classroom interaction with dynamic social network analysis
PPTX
SLAMA Frères, Bilan du Projet Cogénération après
PPTX
Research on internet use and sexual behaviour
PPT
The Impact of Change in the Support Networks of Trainee Secondary School Teac...
Presentation MASE meeting on MC2
Getal en Ruimte docentendag 10-4-2012
Nwd 010213 def
Dudoc 160111 1
Using Web Science for Educational Research
Authoring Your OWN creative, electronic book for mathematics: the MC-squared ...
Co-designing electronic books: boundary objects for social creativity
Use of ICT for acquiring, practicing and assessing algebraic expertise
Public Lecture Hong Kong University, 18 November 2015
Narratives in Contemporary Games
Presentation geogebra 250912
La cogeneration au service de l'entreprise pour une croissance durable et per...
Opportunity to learn secondary maths: A curriculum approach with TIMSS 2011 data
Geogebra intro
Presentatie researchED Amsterdam
Textbook use in England: Mining OFSTED reports for views on mathematics text...
Exploring classroom interaction with dynamic social network analysis
SLAMA Frères, Bilan du Projet Cogénération après
Research on internet use and sexual behaviour
The Impact of Change in the Support Networks of Trainee Secondary School Teac...
Ad

Similar to ICME-12 presentation (20)

PPTX
Presentation MaSE 18-102012
PPTX
Presentation BCME8 April 17th 2014
PPT
Presentation Mathmaster 031210
PPTX
Roadmap Southampton
PPTX
Ictmt10 050711 v2s
DOCX
Running head INTERVENTION FOR EDUCATIONEdwards 1INTERVENTION F.docx
PPTX
Cadgme2016 keynote final
PPT
Agilemind presentation
PPTX
Using technology to support mathematics education and research
POTX
MLCS Presentation ICTCM 2012
PPTX
Putting the world to work for ITS
PPTX
Seminar University of Loughborough: Using technology to support mathematics e...
PDF
Invalsi appam rapporteur_innovation
PPT
micro testing teaching learning analytics
PDF
Automatic Assessment In Math Education
PPTX
Lessons Learned: Our Journey to Digital
PDF
Linux In Education
PPTX
Help-seeking in an online maths environment: A sequence analysis of log files
PPTX
10 Years of E-assessment & Math
DOCX
cimt543AssureLessonPlan
Presentation MaSE 18-102012
Presentation BCME8 April 17th 2014
Presentation Mathmaster 031210
Roadmap Southampton
Ictmt10 050711 v2s
Running head INTERVENTION FOR EDUCATIONEdwards 1INTERVENTION F.docx
Cadgme2016 keynote final
Agilemind presentation
Using technology to support mathematics education and research
MLCS Presentation ICTCM 2012
Putting the world to work for ITS
Seminar University of Loughborough: Using technology to support mathematics e...
Invalsi appam rapporteur_innovation
micro testing teaching learning analytics
Automatic Assessment In Math Education
Lessons Learned: Our Journey to Digital
Linux In Education
Help-seeking in an online maths environment: A sequence analysis of log files
10 Years of E-assessment & Math
cimt543AssureLessonPlan

More from Christian Bokhove (20)

PPTX
This is the new m*th! 2024 edition (researchEd Belfast 28-9-24)
PPTX
THE POTENTIAL OF SEQUENCE ANALYSIS FOR ANALYSING DATA FROM AN ONLINE MATHEM...
PPTX
Master Mathematics Teachers in Chinese primary schools
PPTX
Can data from largescale assessments ever be useful For mathematics education?
PPTX
Creating interactive digital books for the transition from secondary to under...
PPTX
Research on school inspections: What do we know?
PPTX
Master mathematics teachers: What do Chinese primary schools look like?
PPTX
The role of non-cognitive factors in science achievement: an analysis of PISA...
PPTX
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
PPTX
Cryptography
PPTX
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
PPTX
The challenge of proof in the transition from A-level mathematics to university
PPTX
How can we develop expansive, research-informed ITE ?
PPTX
Discussant EARLI sig 27
PPTX
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
PPTX
Transparency in Data Analysis
PPTX
Proof by induction in Calculus: Investigating first-year students’ examinatio...
PPTX
Evidence informed: Waar is de Bijsluiter?
PPTX
Methodological innovation for mathematics education research
PPTX
Roundtable slides RiTE Paderborn 24/9/2021
This is the new m*th! 2024 edition (researchEd Belfast 28-9-24)
THE POTENTIAL OF SEQUENCE ANALYSIS FOR ANALYSING DATA FROM AN ONLINE MATHEM...
Master Mathematics Teachers in Chinese primary schools
Can data from largescale assessments ever be useful For mathematics education?
Creating interactive digital books for the transition from secondary to under...
Research on school inspections: What do we know?
Master mathematics teachers: What do Chinese primary schools look like?
The role of non-cognitive factors in science achievement: an analysis of PISA...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Cryptography
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
The challenge of proof in the transition from A-level mathematics to university
How can we develop expansive, research-informed ITE ?
Discussant EARLI sig 27
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
Transparency in Data Analysis
Proof by induction in Calculus: Investigating first-year students’ examinatio...
Evidence informed: Waar is de Bijsluiter?
Methodological innovation for mathematics education research
Roundtable slides RiTE Paderborn 24/9/2021

Recently uploaded (20)

PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PDF
IGGE1 Understanding the Self1234567891011
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PPTX
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
Trump Administration's workforce development strategy
PPTX
Computer Architecture Input Output Memory.pptx
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PDF
Empowerment Technology for Senior High School Guide
PDF
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
Complications of Minimal Access-Surgery.pdf
Uderstanding digital marketing and marketing stratergie for engaging the digi...
IGGE1 Understanding the Self1234567891011
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
TNA_Presentation-1-Final(SAVE)) (1).pptx
Trump Administration's workforce development strategy
Computer Architecture Input Output Memory.pptx
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
Environmental Education MCQ BD2EE - Share Source.pdf
AI-driven educational solutions for real-life interventions in the Philippine...
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Empowerment Technology for Senior High School Guide
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
Practical Manual AGRO-233 Principles and Practices of Natural Farming
A powerpoint presentation on the Revised K-10 Science Shaping Paper
History, Philosophy and sociology of education (1).pptx
Complications of Minimal Access-Surgery.pdf

ICME-12 presentation

  • 1. EFFECTS OF A DIGITAL INTERVENTION ON THE DEVELOPMENT OF ALGEBRAIC EXPERTISE xkcd.com Christian Bokhove FIsme, Utrecht University July 14th, ICME-12
  • 2. Rationale Algebraic skills Year 12 students Netherlands often disappointing
  • 3. But even when rewriting skills are OK… …many things can go wrong
  • 4. So conceptual understanding and pattern recognition are important!
  • 6. So can’t we use ICT for acquiring, practicing and assessing algebraic expertise?
  • 7. Research questions: What is the effect of an intervention on the development of algebraic expertise, including both procedural skills and symbol sense? Which factors predict the resulting algebraic performance? Conceptual framework, elements of: • Symbol sense – basic skills (e.g. Arcavi) • Formative – summative assessment (e.g. Black & Wiliam) • Feedback
  • 8. Research set-up Rnd Focus Target N Pre What software, what Experts characteristics? 1 Could it work? 1-to-1s, N=5 qualitative 2 In what way can it 2 classes in 1 N=31 work? school 3 Does it work? 9 schools, N=324 quantitative
  • 9. Research set-up Rnd Focus Target N Pre What software, what Experts characteristics? 1 Could it work? 1-to-1s, N=5 qualitative 2 In what way can it 2 classes in 1 N=31 work? school 3 Does it work? 9 schools, N=324 quantitative
  • 10. Third round design • 324 students in 9 schools (N=324) • Year 12, nature and health stream • Digital module: 6 hours, 6 parts • Teachers were free in how to deploy the module, but were asked afterwards • Data collection – Scores pen-and-paper pre- and posttests – Scores and logfiles – Questionnaires
  • 11. Some features of the digital module1 www.algebrametinzicht.nl 1Made with the authoring environment of the Digital Mathematical Environment,
  • 12. Equations: in-between steps, multiple strategies allowed
  • 13. Store student results, and use these as a teacher to study misconceptions and for starting classroom discussions students
  • 15. Feedback: worked examples and hints IDEAS feedback, webservice with Jeuring
  • 16. Other features of the digital tool • Intentional “crises” tasks: hard-to-solve tasks to force students to rethink strategies • Formative scenarios: at first feedback at every step, but gradually fading it away towards the end of the module • Instructional screencasts • Randomization
  • 17. Effect Posttest (M=78.71, SE=15.175) is significantly higher than the pretest score (M=51.55, SE=21.094), t(285)=- 22.589, p<.001, r=.801. Symbol sense score on the posttest (M=1.462, SE=1.504) is significantly higher than the pretest score (M=-1.493, SE=2.339), t(285)=-20.602, p<.001, r=.773.
  • 18. Predictors Significant Non-significant predictors higher predictors higher posttest score posttest score • Previous knowledge • Gender • Time spent in self- • Attitude towards ICT test and summative- • Total time spent on test modes module • General attitude • More time spent at towards mathematics home or at school
  • 20. Thank you 감사합니다 Christian Bokhove Twitter: cb1601ej [email protected] www.fi.uu.nl/~christianb www.algebrametinzicht.nl (also for pdf of thesis)
  • 21. Crises “Failure is, in a sense, the highway to success” Keats • Van Hiele: crisis of learning • Productive failure (Kapur) • Impasse (VanLehn et al) • Perturbation (Doll) • Disequilibrium (Piaget)
  • 22. Extra: example of crisis task
  • 23. Many students work towards…
  • 27. Overcoming a crisis Feedback Youtube clips