2nd Prototype: Interpretation of Testing & Results

Testing session has been finished and here comes interpretation and analysis of the results. I had 9 test participants - all of them played the game. My main concern or limitation of the testing approach is that all of the participants were adults rather than kids.

Let's start analysis with validation or invalidation of the 2 initial hypothesis.

Hypothesis #1: 

Increasing game complexity in sets of 10 questions will sustain kids interest in the game and make it fun. 

Pass Criteria: A test will fail if a test participant fails to answer correctly from the very beginning until the end of the set. Thus - waiting for 10 questions to pass to assess the results would be too long, as kids get dissatisfied with continuous failure. 

Fail Criteria: Results are distributed evenly - and participants failing the first 2 questions may provide correct answer at the end of the game.

What I observed: 
The first 2 test participants failed to answer correctly on the first few questions (mainly because they didn't figure out the instructions at once). So, I'd say that the hypothesis passed, as the participants did recover closer to the end of the set of 10 questions.

Limitation: some participants answered incorrectly just to see what will happen next (in the middle of the game)

Conclusion: Sets of 10 questions are an efficient way to give out Maths tasks.

Hypothesis #2: 

On average it will take a user 3 - 5 seconds to respond a question. If it takes more than 5 seconds - a user is unlikely to provide a correct answer at all and there is a need to change the question or provide support/positive reinforcement.

Pass Criteria:

If answering a question takes longer than 5 seconds - and users do not provide correct results - the hypothesis is right.

Fail Criteria: 

If answering a question takes longer than 5 seconds - and users still provide correct results - the hypothesis is wrong. 

What I observed: 
Test participants answered all questions correctly. So, the hypothesis is either valid or - the game has to be tested on kids.

Considerations for future: I probably should have changed the concept, since it's difficult to evaluate test results on adults while the game is designed for kids.

Here are Participant results:
Participant 1:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 295sec; Wrong answers: 8; Accuracy: 55%;
Round: 2; Complexity: Easy; Questions: 10; Time spent: 24sec; Wrong answers: 0; Accuracy: 100%;

Participant 2:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 201sec; Wrong answers: 8; Accuracy: 55%;
Round: 2; Complexity: Easy; Questions: 10; Time spent: 29sec; Wrong answers: 5; Accuracy: 66%;

Participant 3:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 392sec; Wrong answers: 0; Accuracy: 100%;

Participant 4:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 108sec; Wrong answers: 0; Accuracy: 100%;

Round: 2; Complexity: Difficult; Questions: 10; Time spent: 26sec; Wrong answers: 1; Accuracy: 90%;

Participant 5:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 29sec; Wrong answers: 0; Accuracy: 100%;
Round: 2; Complexity: Difficult; Questions: 10; Time spent: 22sec; Wrong answers: 0; Accuracy: 100%;

Participant 6:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 40sec; Wrong answers: 3; Accuracy: 76%;

Participant 7:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 28sec; Wrong answers: 0; Accuracy: 100%;

Participant 8:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 23sec; Wrong answers: 0; Accuracy: 100%;

Participant 9:
Round: 1; Complexity: Basic; Questions: 10; Time spent: 30sec; Wrong answers: 0; Accuracy: 100%;

Round: 2; Complexity: Difficult; Questions: 10; Time spent: 21sec; Wrong answers: 0; Accuracy: 100%;

Round: 3; Complexity: Difficult; Questions: 10; Time spent: 20sec; Wrong answers: 0; Accuracy: 100%;