Schools are navigating a practical question that shows up in classrooms, intervention blocks, and even IEP meetings: when does technology genuinely improve learning, and when is it simply a different format for the same work?
A research study published in the Journal of Behavioral Education examined this exact issue by comparing mobile learning (mLearning) on an iPad with traditional paper-and-pencil practice for a classic elementary skill: telling time to the minute. The findings are useful because they are not “technology is always better” or “worksheets are always best.” Instead, they highlight what many educators and related service providers observe every day: student outcomes depend on the learner, the task, and the design of the practice.
Why telling time is a meaningful test case
Telling time is deceptively complex. Students must coordinate visual-spatial skills (clock face), number sense (minute intervals), language concepts (past/to, quarter after), and sustained attention. For some learners—especially those who need explicit instruction, repetition, and feedback—practice format can meaningfully change engagement and performance.
The study focused on a specific math concept (telling time to the minute) and asked a straightforward question: what happens to student attention and accuracy when practice is delivered through an iPad app compared to worksheets?
Study snapshot: who, where, and what was compared
The researchers worked in a public third-grade classroom in the Midwest. Four boys were selected because they scored below 50% on a one-minute telling-time assessment. In other words, these were students with a clear skill gap who needed targeted practice.
The study used an alternating-treatments design (a type of single-subject research). Each student rotated between:
- mLearning practice using an iPad app (“Interactive Telling Time—Learning to tell time is fun”), and
- Paper-and-pencil practice using teacher-created worksheets aligned to the same telling-time skills.
Practice sessions were short and structured: 10 minutes per session during independent work time, across 10 days, with conditions balanced across sessions.
What the researchers measured: attention, accuracy, and productivity
To make the comparison meaningful, the study tracked three practical outcomes educators care about:
- On-task behavior (attention): Was the student engaged with the practice task?
- Percent correct (accuracy): Of completed problems, how many were correct?
- Number of problems completed (productivity): How much practice did students actually finish in the time available?
This combination matters. A student can be highly engaged but not accurate. Another can be accurate but complete very little. Instructional decisions should consider all three.
Key finding #1: Attention improved for some students with the iPad
Results for on-task behavior were mixed, but leaned in a direction many educators will recognize: several students were more consistently engaged when using the iPad.
- Two students were more on-task during mLearning practice.
- Two students showed similar on-task behavior across both conditions.
In practical terms, the iPad helped some students sustain attention—likely due to interactivity, novelty, and the “game-like” feel that students often report. This aligns with broader literature suggesting that well-designed technology can increase engagement.
Key finding #2: Accuracy did not consistently favor mLearning
Accuracy outcomes were also mixed:
- Two students performed similarly across both conditions.
- Two students completed a higher percentage of problems correctly with paper and pencil.
This is an important caution for teams that assume engagement automatically translates into better learning. Increased attention can create better conditions for learning, but the practice tool still has to support correct responding, efficient feedback, and enough repetitions to build fluency.
Key finding #3: Students completed far more problems on worksheets
The most consistent result in the study was productivity: all students completed more problems during paper-and-pencil practice.
- On average, students completed about 25 problems with worksheets.
- On average, students completed about 11 problems with the iPad app.
The researchers noted a likely reason: the app required time to load each item and time to manipulate controls (for example, selecting hour and minute values). When each item takes longer to complete due to interface design, students naturally get fewer practice opportunities in the same 10-minute window.
For skills like telling time—where repetition and immediate correction are critical—fewer practice trials can matter.
What students said: preference, focus, and confidence
Student feedback added an important layer. Even when students enjoyed the iPad activity, they still preferred worksheets for practicing telling time.
- Most students reported enjoying the iPad more because it felt like a game.
- All four students said they preferred worksheets for telling-time practice.
- Three of four felt they focused better and got more correct using worksheets.
This is a valuable reminder: “fun” is not the same as “effective,” and student preference can reflect where they feel most competent and in control (for example, being able to see many problems at once, write answers directly, and track progress).
Implications for schools: choosing tools intentionally, not automatically
The study’s discussion section offers a balanced takeaway that applies well beyond telling time. Technology can be effective—especially for engagement—but it must be selected and implemented with purpose.
In the SAMR framework (Substitution, Augmentation, Modification, Redefinition), the iPad in this study largely functioned as substitution: it replaced worksheets with a digital version of similar practice. Substitution can still be useful, but it doesn’t guarantee improved outcomes. The details of the tool (speed, usability, feedback, clarity) and the learner profile make the difference.
Practical recommendations educators can use tomorrow
Based on the study’s findings (and what we commonly see in skill-building interventions), here are practical ways to apply the research without oversimplifying it.
1) Match the tool to the goal: engagement vs. efficiency
- If the immediate goal is increasing time on task during independent practice, a well-designed app may help certain students persist.
- If the goal is maximizing repetitions in a short time (fluency building), worksheets or other rapid-response formats may be more efficient.
2) Evaluate the app’s “learning friction” before adopting it
Ask what the interface demands from the student besides the target skill:
- Does it take time to load each problem?
- Does the student have to scroll, switch screens, or use multiple controls?
- Is feedback immediate and understandable?
- Can the student quickly attempt another item after an error?
If the app adds extra steps, students may complete fewer practice trials—especially students with attention, motor planning, or executive functioning needs.
3) Use a blended approach: practice digitally, check mastery traditionally
The study suggests a sensible sequence many teachers already use:
- Use mLearning for daily practice and engagement during a unit.
- Use paper-and-pencil checks for quick formative assessment, or when time is limited.
- Apply a clear mastery criterion (the study referenced 80% accuracy as a common benchmark).
4) Consider learner variability (especially for students receiving services)
Students who receive special education or related services often show uneven profiles: strong interest in technology but variable accuracy, or good accuracy but low stamina. The “best” medium may differ by student and even by day. Data-based decision-making—short probes of attention, accuracy, and completion—can guide individualized choices.
How this connects to TinyEYE and school-based support
At TinyEYE, we work alongside school teams who are balancing instruction, intervention, and student support across in-person and digital environments. Research like this helps teams move beyond “tech vs. no tech” and toward a more useful question: What conditions help this student learn this skill most efficiently and accurately?
Whether a student is building classroom routines, strengthening attention during independent work, or improving academic-related skills that intersect with communication and executive functioning, the format of practice matters. And importantly, it can be adjusted without changing the learning target—simply by changing how practice is delivered and monitored.
For more information, please follow this link.
