As a Special Education Director, I spend a lot of time in IEP meetings talking about skills that matter beyond a single class period: communication, self-advocacy, problem-solving, and the ability to evaluate information. Increasingly, those conversations intersect with computing education—coding clubs, robotics electives, STEM units, and now Artificial Intelligence (AI) lessons. The common thread is critical thinking.
A 2025 systematic mapping study published in Informatics in Education examined a key question: how are schools and researchers assessing critical thinking (or parts of it) in K-12 computing education? The findings are both encouraging and clarifying—especially for district leaders trying to select assessments that are meaningful, equitable, and instructionally useful.
Why critical thinking assessment matters in computing (and beyond)
Computing is no longer a niche subject. It shapes how students learn, communicate, and participate in civic life. The study emphasizes that computing education can strengthen critical thinking skills that students need to navigate:
- Algorithms and programming (planning, debugging, evaluating solutions)
- Information literacy (identifying credible sources and combating misinformation)
- Robotics (reasoning through hardware/software interactions and sensor data)
- AI (understanding bias, privacy, ethics, and the limits of AI outputs)
In special education, we also care about how students generalize skills. Critical thinking is a “transfer” skill—students should be able to apply it in reading, science labs, social media use, and workplace training. That makes assessment especially important: if we cannot measure growth, we cannot reliably improve instruction or provide targeted supports.
What the research mapped: 18 studies, concentrated in a few places
The researchers reviewed a large body of literature and ultimately identified 18 relevant primary studies that assessed critical thinking in K-12 computing education. A few patterns stood out:
- Most studies were recent (many published from 2018 onward).
- Most were conducted in Asia, with a notable cluster in China and Turkey.
- Most focused on programming concepts such as algorithms, logic, and coding—often in extracurricular courses.
- Fewer studies addressed robotics and STEM integration, and only one study in the set focused on AI in a STEAM high school context.
From a district leadership perspective, this matters because it suggests our evidence base is growing but still narrow. If your district is building AI literacy programs or expanding robotics, the assessment research is not yet as mature as it is for block-based programming.
How “critical thinking” is defined: still not one shared definition
The study highlights a persistent challenge: there is no single agreed-upon definition of critical thinking across K-12 computing research. Some studies treat critical thinking as a sub-skill of computational thinking; others use broader educational definitions.
One widely referenced framework is the Delphi Report (Facione, 1990), which describes core critical thinking skills:
- Interpretation
- Analysis
- Evaluation
- Inference
- Explanation
- Self-regulation
Additional skills (Yeh, 2003) sometimes included are:
- Recognition of assumptions
- Induction
- Deduction
In practice, the mapping found that studies selected critical thinking skills based on the needs of the course or research design. That flexibility can be helpful, but it also makes it difficult for schools to compare results across programs or grade levels.
Which skills were assessed most often?
Across the 18 studies, evaluation appeared in all of them. Analysis and inference were also commonly assessed. Interpretation was assessed least often.
This is an important takeaway for educators: if we only measure what is easiest to measure (often “evaluation” through rating scales), we may miss other essential components—like interpretation and explanation—that are critical for academic writing, science reasoning, and social problem-solving.
How critical thinking was assessed: heavy reliance on student self-assessment
The strongest and most consistent finding is that most studies used student self-assessment to measure critical thinking. In other words, students rated their own critical thinking growth, typically using Likert-scale surveys.
Only two studies used tests (multiple-choice instruments) as the primary assessment method. The mapping strongly suggests a need for broader assessment approaches beyond self-report.
Common instruments used
Many studies used established instruments rather than creating new ones. Frequently used tools included:
- CTLS (Computational Thinking Skill Level – Secondary School) and related scales (Korkmaz et al.)
- CTS (Computational Thinking Scales) and translated/adapted versions
- TER (Test of Everyday Reasoning) (Facione et al.)
- CTT-Level I (Yeh)
- Other critical thinking tendency or questionnaire tools adapted for local contexts
From an implementation standpoint, this raises a practical question districts often ask: “Is the tool valid for our students?” The answer depends on language, age, disability-related accessibility, cultural context, and whether the tool measures performance or perception.
Quality of the assessments: reliability is reported more often than validity
Most studies evaluated the reliability of their instruments, commonly using Cronbach’s alpha. Results were generally favorable (often above .8), suggesting good internal consistency.
However, fewer studies reported validity evidence (for example, confirmatory factor analysis). When validity was evaluated, results were typically acceptable to excellent—but the limited reporting is a caution flag for schools making high-stakes decisions based on these measures.
What this means for schools right now
As district leaders, we have to translate research into workable systems. Here are practical implications drawn from the mapping:
1) Balance self-assessment with observable evidence
Self-assessment can build metacognition and student ownership, but it should not be the only measure. Consider pairing it with:
- Performance-based assessments (projects, code artifacts, design documentation)
- Rubrics aligned to specific critical thinking skills (analysis, inference, explanation)
- Teacher observation checklists during debugging, collaboration, and reflection
- Short interviews or student conferences to probe reasoning
2) Ensure accessibility and equity in assessment design
For students with disabilities, critical thinking may be present even when language output, processing speed, or fine motor demands interfere. District teams should check whether assessments:
- Allow multiple means of expression (oral explanation, visuals, guided prompts)
- Reduce irrelevant barriers (reading load, timed constraints, complex navigation)
- Support executive functioning (planning templates, chunked tasks, exemplars)
3) Expand beyond programming-only measures
The research base is strongest in programming contexts, but students also need critical thinking in AI, media literacy, and robotics. Schools can intentionally assess critical thinking during:
- AI lessons (bias detection, privacy trade-offs, evaluating AI-generated outputs)
- Robotics troubleshooting (hypothesis testing, evidence-based revisions)
- STEM integration projects (data interpretation and justification of conclusions)
4) Use assessment results to guide instruction, not just “score” students
Critical thinking grows through feedback-rich learning. The mapping reinforces the need for assessments that help educators adjust instruction—especially through formative and performance-based methods.
A note for districts facing staffing shortages
Many districts are balancing ambitious instructional goals with real staffing constraints, including shortages in specialized instructional support personnel. This is where online service models can help schools maintain continuity and consistency. When therapy and instructional supports are stable, educators can better implement classroom routines that build critical thinking: structured reflection, guided questioning, and explicit teaching of reasoning language.
At TinyEYE, we often see that when schools strengthen systems (clear goals, consistent progress monitoring, collaboration between educators and therapists), students are better positioned to access higher-order learning—including computing and digital citizenship skills.
For more information, please follow this link.
