Lesson 1: Claim Boundaries

The single most important skill in a defense is claim calibration. Examiners are testing whether you understand the boundaries of your evidence. One overclaim and credibility drops. One honest hedge and credibility rises.

Your Study's Claim Space

Your thesis sits in a specific methodological position: a one-group pretest-posttest pilot study. This design constrains what you can claim. Here is the complete map:

The One-Sentence Safe Answer

What happened	You can say	You cannot say
Mean score went from 7.06 → 7.77	"Students showed a positive score direction after the activity"	"Kit-Build improved reading comprehension"
No control group existed	"This is a preliminary pilot to establish feasibility and direction"	"Kit-Build is effective for Japanese reading"
Same questions in pre-test and post-test	"Score change may partly reflect practice effect"	"Learning gains demonstrate comprehension improvement"
Dictionaries + reading material were allowed	"We measured assisted reading comprehension"	"Students can now read Japanese independently"
TAM scores above 3.5	"Participants reported positive initial acceptance"	"The platform is user-friendly and ready for deployment"
N=35 from two Marketing classes	"Findings suggest feasibility for this learner group"	"This applies to all beginner Japanese learners"

Your default answer to any "what does this prove?" question:
"This study shows that Yomilink is feasible for conducting a preliminary online Kit-Build activity in Japanese reading comprehension, with positive initial score direction and user acceptance. Future controlled studies are needed to confirm effectiveness."

Why This Matters

Examiners ask questions not to trap you, but to check if you understand the difference between what you found and what it means. A pilot study that honestly reports limitations is more valuable than an overclaimed one. Your contribution is the platform, the procedure, and the feasibility evidence — not a proof of effectiveness.

Core Methodology Terms

⚡ Quick Check

1. Which sentence is the safest way to describe your result?

Kit-Build significantly improved Japanese reading comprehension.
Students showed a positive score direction after the Kit-Build activity.
Yomilink is an effective tool for teaching Japanese.
Beginner learners can now read Japanese with concept maps.

2. A student scored 9/10 on pre-test and 10/10 on post-test. What is the most honest interpretation?

The Kit-Build activity helped them learn the missing concept.
They improved by 1 point due to the intervention.
Their pre-test score was already near the ceiling, so the small gain may reflect practice effect or ceiling limitation.
They fully mastered the material after using Yomilink.

3. Why is "assisted reading comprehension" the correct term?

Because participants received help from the researcher during the test.
Because participants could use dictionaries and view the passage with furigana during the test.
Because the platform provided automated hints during the post-test.
Because the reading material was simplified for beginners.

Primary Source

Read Creswell & Creswell (2018), Chapter 10, sections on pre-experimental designs — specifically the one-group pretest-posttest design and its internal validity threats.

Reminder

Ask me anything that's unclear. I'm your teacher — if a term like "within-group" or "ceiling effect" doesn't click yet, say so and I'll explain it differently.