Elvin 070606 - Feedback On Study 3

Feedback on Study 3

Feedback on Question Groupings

Concentration

1) Did the game grab your attention and maintain your focus?
2) Can you concentrate on the tasks at hand in the game?
These 2 questions can be grouped together because they fundamentally ask the same question: Is the player concentrating on the game.

Challenge

3) Does the game skills needed match yours?
4) Do you think the game provide different levels of challenge for different players?
5) As the game progresses does it become more challenging?
These 3 questions cannot be grouped together. Q3 ask whether it meets our challenge. Q4 ask whether there are different settings for difficulty which is much different from what Q3 is asking. Q5 is asking about gameplay mechanics and is also totally different from the other 2 asked. They are in itself their own set of questions.

Player Skills

6) Are you able to play the game without spending too much time at the instructions?
7) Is learning how to play the game fun?
These 2 are in effect asking different questions as well and cannot be grouped together. Fun and spending too much time are not mutually exclusive and vice versa. Not spending too much time learning the game doesn’t make learning the game fun.

Control

8) Do you feel in control of your character in the game?
9) Do you feel in control of the game shell (starting, stopping, saving etc.)?
These 2 questions are asking different aspects of the game (Q8 is more on gameplay interface while Q9 is more on the game shell which is not related to the previous question).

Clear Goals

10) Is the objective of the game clear and presented early?
11) Are intermediate game goals clear and presented at appropriate times?
These 2 can be grouped together because they answer the same fundamental question: Are you aware of the goals?

Feedback

12) Do you have a clear picture of your progress to the game goals at any point of time?
13) Does the game give you immediate feedback of your actions?
14) Do you always know your health points and time remaining?
These can be grouped together. They all ask about whether the game gives necessary feedback at the right time.

Connection

15) During gameplay are you less aware of what is happening physically around you?
16) Are you aware of the passing time during gameplay?
17) Do you feel emotionally involved in the game?
These can be grouped together because they ask how absorbed a person is in the game. However Q17 is weak because people may not understand what emotionally involved means and is a potential confounder.

Social Interaction

18) Do you feel the competition against the pets and other players (if any)?
19) Does the game support social communities (for both human players and pets)
inside and outside the game?
These 2 questions are asking about VERY DIFFERENT social interactions. They cannot be grouped together.

Human-animal interaction

20) Are you aware that you are playing with a hamster during gameplay?
21) Do you feel more connected to the pets after gameplay?
Awareness does not equate to being connected. These 2 questions cannot be grouped together.

Feedback on Questions

  • The questions which are grouped together are not measuring the same thing i.e. questions on challenge are all asking about different aspect of challenge, namely
    • Selectable degree of challenge
    • Suitable to players level
    • Progression of difficulty
  • To make the survey more reliable, questions must be asked in accord to these questions each, i.e the 2nd point of difficulty suitable to players level should have its own subset of questions that goes something like this:
    • Is the game too difficult for you?
    • I found the game much too easy
    • I found the game within my abilities
    • The game was frustratingly difficult
    • I feel that the game was manageable and not too difficult to play
  • In this way can the same measure then be properly observed.
  • The problematic measures are: Challenge, Player skills, Control, Social Interaction and Human-animal Interaction. Either too many aspects are clumped together, or the aspect is not detailed enough.

Feedback on Results

  • For Cronbach’s Alpha to be applied, these data are necessary in the raw data
    • Sample size
    • Individual Sample results
  • This is because it works on the basis of a type of ITEM CORRELATION. If all the results are clumped together and summarized in percentage, α cannot be computed.
  • Raw data must be found in order to expedite reliability analysis.

Suggestions for Improvement

  • Measure must be specific and questions asked must be trying to obtain that measure i.e. Control DURING GAME PLAY instead of simply Control
  • Different aspects must not be lumped together i.e. questions on awareness of playing with hamsters SHOULD NOT be lumped together with questions about enjoyment.
  • Raw Data Results to be found (currently missing and cannot be found on the computers). Otherwise, study need to be conducted again to apply α.
Unless otherwise stated, the content of this page is licensed under Creative Commons Attribution-Share Alike 2.5 License.