Unpacking Standards through CST Released Items, Benchmark Assessment Results, and Student Work November 16, 2010 San Diego Unified School District
Whole group session Introduce a process Provide a “snapshot” of each component Breakout groups Hands-on experience with three elements of the process – exposure to the practice and the type of conversation it may generate among teachers Leadership conversation about what you might take back to your site
 
2008 2009 2010 Cluster Average % Correct “ Gap” to Min.  Prof. Average % Correct “ Gap” to Min.  Prof. Average % Correct “ Gap” to Min.  Prof. Word Analysis & Vocabulary  (11) 65% -5 67% -1 68% 0 Reading Comp.  (18) 64% -5 67% -1 71% 0 Literary Response & Analysis  (13) 59% -5 62% -2 66% -1 Written Conventions  (16) 60% -5 64% -3 67% -2 Writing Strategies  (17) 57% -2 59% +3 59% +5
California Content Standards CST Blueprints CST Released Items Statewide item analysis statistics Local Assessment Information School or district items & item analysis stats Student Work
CST Cluster Results and Blueprints Select a content strand / cluster of interest based on CST results Using the standards and test blueprints, identify big ideas that group standards within the strand/cluster
GRADE 7 ENGLISH LANGUAGE ARTS  Reading Comprehension Structural Features of Informational Materials (RC 2.1, 2.2, 2.3) Comprehension & Analysis of Grade-Level Appropriate Text (RC 2.4, 2.5) Expository Critique (RC 2.6)                      
CST Released Items Map sample items to the big ideas Add item analysis data where available   Analyze the items to better understand the concepts within the standards and the rigor of the thinking required of students
 
New website  ( www.starsamplequestions.org )  provides access to a bank of CST released items linked to performance levels, with item analysis statistics Performance level indicates which students were most likely to answer the question correctly An “Advanced” item was answered correctly by about two-thirds of students scoring advanced on the overall test, and by fewer students at lower levels  A “Basic” item was answered correctly by about two-thirds of students scoring at basic overall
Map local assessment items to the big ideas from the identified strand/cluster Add item analysis data if available Analyze the level of rigor between local assessment items and the state items Analyze student performance to identify strengths, weaknesses, possible misconceptions  (e.g., distractor analysis)
 
Based on the analysis of CST Cluster Results and Local Assessment Results, predict and observe: What do students know or do well? What do students need additional practice at? What do students need additional instruction in?
 
Bring in student work related to an area in which students struggled / need further instruction (e.g., a common task) Map the student work to the big ideas within the strand/cluster What were students able to do? Where did they struggle? Analyze student approaches to the concepts in the standards
 
Identify knowledge and skills that are important to student success in other subject areas Think about how these skills and strategies could be supported within each content area
 
 
We are introducing a multi-step process that can help teachers better understand the standards through the lens of how they are assessed and what they look like in student work This does not happen all in one sitting! Think about how some or all parts of this process might work in your context!
Experience – albeit briefly – three aspects of the process Analyzing CST released items Analyzing local benchmark assessment items Identifying learning strengths and needs
CST Released Items  Look at each item and try to determine which aspect of the strand / cluster it assesses Discuss the knowledge and reasoning the item requires of students Look at the student performance data (item statistics) What might have made this item easier or more difficult for students? What can you learn from the distractors (wrong answers) students selected?
Benchmark Assessment Items (Blue) Identify which aspect of the strand each item assesses Discuss the knowledge / reasoning required of students Look at the student performance data (item statistics) What might have made this item easier or more difficult for students? What can you learn from the distractors (wrong answers) students selected?
CST / Benchmark Assessment Comparison Do the CST and benchmark items assess the standards in similar or in different ways? Are students being asked to think / respond in similar or in different ways? What is the comparative level of rigor? Learning Needs Statement Based on student performance on the CST released items and the Benchmark Assessment items: What do students know / do well? What do students need additional practice at? What do students need further instruction in?
What might be next steps at your site to help teachers further unpack the standards through test items and student work? Analyzing the standards through CST and local assessment items Identifying what students know / do well, what they need practice at, what they need further instruction in Developing common assessment tasks related to areas of student misunderstanding / weakness Looking at student work
Sally Bennett-Schmidt, Assessment Director [email_address] 858-292-3688  Karla Groth, EL/Assessment Coordinator [email_address] 858-569-3104 Shannon Coulter, Assessment Project Specialist [email_address] 858-292-3593

More Related Content

PPTX
Cdl research methods.2011
PPTX
Research questions and hypotheses_Hang_Vietnam
PPT
Comparative and Non-Comparative
PPT
Ch05 instrumentation
PPT
Ch01 intro
PPT
Level 3 Thinking & WebQuests
PPTX
Rubric Development
PDF
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...
Cdl research methods.2011
Research questions and hypotheses_Hang_Vietnam
Comparative and Non-Comparative
Ch05 instrumentation
Ch01 intro
Level 3 Thinking & WebQuests
Rubric Development
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...

What's hot (16)

PDF
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
PPTX
Challenges and opportunities in research evaluation: toward a better evaluati...
PPTX
ADP L6 Results
PPTX
Surveys and tests, colleen kelly
PPTX
DOCX
Psyc 355 lab project overview and instructions complete solutions correct ans...
PDF
Creating Meaningful Rubrics
PDF
Data, decisions, action slideshare
PPT
Assessment of Learning in Universal Design for Learning
PPTX
Getting to grips with TESTA methods
PPTX
Divergent Insights- Qualitative Research VS. Quantitative Research
PPTX
Revising instructional materials
DOC
Ash edu 675 week 4 assignment formative evaluation interpretation new
DOCX
Assessment brief – component 1 academic year 2021 2022semeste
DOC
Ash edu 675 week 4 assignment formative evaluation interpretation new
PPT
Coursework Data Interpretation
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
Challenges and opportunities in research evaluation: toward a better evaluati...
ADP L6 Results
Surveys and tests, colleen kelly
Psyc 355 lab project overview and instructions complete solutions correct ans...
Creating Meaningful Rubrics
Data, decisions, action slideshare
Assessment of Learning in Universal Design for Learning
Getting to grips with TESTA methods
Divergent Insights- Qualitative Research VS. Quantitative Research
Revising instructional materials
Ash edu 675 week 4 assignment formative evaluation interpretation new
Assessment brief – component 1 academic year 2021 2022semeste
Ash edu 675 week 4 assignment formative evaluation interpretation new
Coursework Data Interpretation
Ad

Similar to Cst analysis overview sdusd princ 11-16-10 (20)

PPTX
Advanced Foundations and Methods in EL (Lecture 1)
PPTX
Rti inservice training 2015
PPTX
Supt presentation sept-26-12.ppt
PPT
Common Core Presentation Feb2010
PPTX
Budget of Work and Table of Specification EST CONSTRUCTION.pptx
PPTX
Common core plc part two
PPTX
Coherence assess share
PPTX
Coherence cas cop assess share
PPTX
Common Core: New Opportunities for Deeper Learning
PPT
2013 crw training day 2
PDF
Ccss and the special educator(10 8-13) (1)
PPT
Cstclsuter Present 09 10
PPTX
CrICET: Learning Studios
PPTX
Week 1 lecture data in our classrooms
PPTX
Summer 2012 presentation team evaluation
PPTX
Day 1 training
PPT
Common Core State Standards
DOCX
Discussion 1Common Core State StandardsCommon Core State Standar.docx
PPTX
Plainville Data Resources
PPTX
110912 sp mid-point_review_board
Advanced Foundations and Methods in EL (Lecture 1)
Rti inservice training 2015
Supt presentation sept-26-12.ppt
Common Core Presentation Feb2010
Budget of Work and Table of Specification EST CONSTRUCTION.pptx
Common core plc part two
Coherence assess share
Coherence cas cop assess share
Common Core: New Opportunities for Deeper Learning
2013 crw training day 2
Ccss and the special educator(10 8-13) (1)
Cstclsuter Present 09 10
CrICET: Learning Studios
Week 1 lecture data in our classrooms
Summer 2012 presentation team evaluation
Day 1 training
Common Core State Standards
Discussion 1Common Core State StandardsCommon Core State Standar.docx
Plainville Data Resources
110912 sp mid-point_review_board
Ad

More from cesperez1 (17)

PPTX
The history of islam 2
PPTX
Geography of islam
PPTX
The history of islam
PPTX
History of islam
PPTX
Islam
PPTX
The History of Islam
PPTX
History of Islam
PPTX
El trabajo final
PPTX
History of islam
PPT
Pop point
PPT
History of islam
PPTX
History of islam
PPTX
Islam
PPTX
History of islam
PPTX
History of Islam
PPTX
Egypt sample
PPT
Buddhism
The history of islam 2
Geography of islam
The history of islam
History of islam
Islam
The History of Islam
History of Islam
El trabajo final
History of islam
Pop point
History of islam
History of islam
Islam
History of islam
History of Islam
Egypt sample
Buddhism

Recently uploaded (20)

PDF
MICROENCAPSULATION_NDDS_BPHARMACY__SEM VII_PCI Syllabus.pdf
PDF
M.Tech in Aerospace Engineering | BIT Mesra
PDF
Empowerment Technology for Senior High School Guide
PDF
fundamentals-of-heat-and-mass-transfer-6th-edition_incropera.pdf
PDF
LIFE & LIVING TRILOGY - PART (3) REALITY & MYSTERY.pdf
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
Journal of Dental Science - UDMY (2020).pdf
PPTX
What’s under the hood: Parsing standardized learning content for AI
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
PDF
Literature_Review_methods_ BRACU_MKT426 course material
PPTX
INSTRUMENT AND INSTRUMENTATION PRESENTATION
PDF
Race Reva University – Shaping Future Leaders in Artificial Intelligence
PDF
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PPTX
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
PDF
Climate and Adaptation MCQs class 7 from chatgpt
PDF
plant tissues class 6-7 mcqs chatgpt.pdf
MICROENCAPSULATION_NDDS_BPHARMACY__SEM VII_PCI Syllabus.pdf
M.Tech in Aerospace Engineering | BIT Mesra
Empowerment Technology for Senior High School Guide
fundamentals-of-heat-and-mass-transfer-6th-edition_incropera.pdf
LIFE & LIVING TRILOGY - PART (3) REALITY & MYSTERY.pdf
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Journal of Dental Science - UDMY (2020).pdf
What’s under the hood: Parsing standardized learning content for AI
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
Environmental Education MCQ BD2EE - Share Source.pdf
LEARNERS WITH ADDITIONAL NEEDS ProfEd Topic
Literature_Review_methods_ BRACU_MKT426 course material
INSTRUMENT AND INSTRUMENTATION PRESENTATION
Race Reva University – Shaping Future Leaders in Artificial Intelligence
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
AI-driven educational solutions for real-life interventions in the Philippine...
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
Climate and Adaptation MCQs class 7 from chatgpt
plant tissues class 6-7 mcqs chatgpt.pdf

Cst analysis overview sdusd princ 11-16-10

  • 1. Unpacking Standards through CST Released Items, Benchmark Assessment Results, and Student Work November 16, 2010 San Diego Unified School District
  • 2. Whole group session Introduce a process Provide a “snapshot” of each component Breakout groups Hands-on experience with three elements of the process – exposure to the practice and the type of conversation it may generate among teachers Leadership conversation about what you might take back to your site
  • 3.  
  • 4. 2008 2009 2010 Cluster Average % Correct “ Gap” to Min. Prof. Average % Correct “ Gap” to Min. Prof. Average % Correct “ Gap” to Min. Prof. Word Analysis & Vocabulary (11) 65% -5 67% -1 68% 0 Reading Comp. (18) 64% -5 67% -1 71% 0 Literary Response & Analysis (13) 59% -5 62% -2 66% -1 Written Conventions (16) 60% -5 64% -3 67% -2 Writing Strategies (17) 57% -2 59% +3 59% +5
  • 5. California Content Standards CST Blueprints CST Released Items Statewide item analysis statistics Local Assessment Information School or district items & item analysis stats Student Work
  • 6. CST Cluster Results and Blueprints Select a content strand / cluster of interest based on CST results Using the standards and test blueprints, identify big ideas that group standards within the strand/cluster
  • 7. GRADE 7 ENGLISH LANGUAGE ARTS Reading Comprehension Structural Features of Informational Materials (RC 2.1, 2.2, 2.3) Comprehension & Analysis of Grade-Level Appropriate Text (RC 2.4, 2.5) Expository Critique (RC 2.6)                      
  • 8. CST Released Items Map sample items to the big ideas Add item analysis data where available Analyze the items to better understand the concepts within the standards and the rigor of the thinking required of students
  • 9.  
  • 10. New website ( www.starsamplequestions.org ) provides access to a bank of CST released items linked to performance levels, with item analysis statistics Performance level indicates which students were most likely to answer the question correctly An “Advanced” item was answered correctly by about two-thirds of students scoring advanced on the overall test, and by fewer students at lower levels A “Basic” item was answered correctly by about two-thirds of students scoring at basic overall
  • 11. Map local assessment items to the big ideas from the identified strand/cluster Add item analysis data if available Analyze the level of rigor between local assessment items and the state items Analyze student performance to identify strengths, weaknesses, possible misconceptions (e.g., distractor analysis)
  • 12.  
  • 13. Based on the analysis of CST Cluster Results and Local Assessment Results, predict and observe: What do students know or do well? What do students need additional practice at? What do students need additional instruction in?
  • 14.  
  • 15. Bring in student work related to an area in which students struggled / need further instruction (e.g., a common task) Map the student work to the big ideas within the strand/cluster What were students able to do? Where did they struggle? Analyze student approaches to the concepts in the standards
  • 16.  
  • 17. Identify knowledge and skills that are important to student success in other subject areas Think about how these skills and strategies could be supported within each content area
  • 18.  
  • 19.  
  • 20. We are introducing a multi-step process that can help teachers better understand the standards through the lens of how they are assessed and what they look like in student work This does not happen all in one sitting! Think about how some or all parts of this process might work in your context!
  • 21. Experience – albeit briefly – three aspects of the process Analyzing CST released items Analyzing local benchmark assessment items Identifying learning strengths and needs
  • 22. CST Released Items Look at each item and try to determine which aspect of the strand / cluster it assesses Discuss the knowledge and reasoning the item requires of students Look at the student performance data (item statistics) What might have made this item easier or more difficult for students? What can you learn from the distractors (wrong answers) students selected?
  • 23. Benchmark Assessment Items (Blue) Identify which aspect of the strand each item assesses Discuss the knowledge / reasoning required of students Look at the student performance data (item statistics) What might have made this item easier or more difficult for students? What can you learn from the distractors (wrong answers) students selected?
  • 24. CST / Benchmark Assessment Comparison Do the CST and benchmark items assess the standards in similar or in different ways? Are students being asked to think / respond in similar or in different ways? What is the comparative level of rigor? Learning Needs Statement Based on student performance on the CST released items and the Benchmark Assessment items: What do students know / do well? What do students need additional practice at? What do students need further instruction in?
  • 25. What might be next steps at your site to help teachers further unpack the standards through test items and student work? Analyzing the standards through CST and local assessment items Identifying what students know / do well, what they need practice at, what they need further instruction in Developing common assessment tasks related to areas of student misunderstanding / weakness Looking at student work
  • 26. Sally Bennett-Schmidt, Assessment Director [email_address] 858-292-3688 Karla Groth, EL/Assessment Coordinator [email_address] 858-569-3104 Shannon Coulter, Assessment Project Specialist [email_address] 858-292-3593