Card Stories Playtest Protocol

=HOWTO=

This is meant to be used during a "live" test (all players & organiser in the same room, 2-6 play testers


 * 1) Don't explain anything about the game
 * 2) If possible, try to put one computer per player, so that everyone can try it out from their own computer. The best is to setup screen recording on each to keep a video of the whole session for each player (cf Camstudio for Windows, recordmydesktop for Linux and Jing for Mac)
 * 3) Start answering a survey at XXX and follow the instructions. Get familiar with the questions to be able to answer them progressively during the test (simply take notes there and come back at the end to describe more if needed)
 * 4) Note the time at which you begin, to measure the length of the playtest at the end
 * 5) Create a game and invite players to join (start with an easy card/sentence combination : ) )
 * 6) Encourage players to ask questions, but let them formulate them (and take note of what they ask)
 * 7) Observe attentively the players behaviour by looking at their screens - where do they hesitate, what do they try out that doesn't fit the "proper" use of the game, what do they get right?
 * 8) Note the time and stop the recording of the player screens and upload each of them to the file repository, in /cardstories/playtests// /name_of_player.avi
 * 9) Get the players to answer the player survey at XXX. While they complete it, go from person to person to see if they need help/have questions, and ask them precisions about their answers when it is useful.
 * 10) Review your notes taken in the organizer survey and complete/extend comments as necessary.

=Surveys=

Setup

 * Name of the organizer (you)?
 * Date
 * How many players ?
 * Have some of them played the game before? Or Dixit? Who?
 * Have you setup the recording of individual computers screens?

First impression

 * Time
 * What is the first reaction of players when they look at the game? What do they say about it? What do they notice the most?

Game concept

 * What seem to resonate with the players? Is there anything that seem to hook them, or that they seem to especially like?
 * Describe the players that seemed the MOST hooked by the game? (for each: age, gender, gamer/not gamer, geek/not geek...)
 * What did they not like? What seemed to prevent the game from being great for them?
 * Describe the players that seemed the LESS hooked by the game? (for each: age, gender, gamer/not gamer, geek/not geek...)
 * Do they make any remarks about the fairness of the game? Do they talk about chance, or about choices asked from them that aren't meaningful?

Accessibility

 * What are the questions that players ask about the game? What confuses them? What makes them understand what they weren't getting?
 * Looking over the shoulders of the players, does it seems that the interface does what they want? What are they trying to do with it that the interface doesn't allow, or allows but differently?

Addictiveness

 * Are there any moments where players suggest to play more? When? Ask them why!
 * Are there any moments where players do not seem interested in playing more? When? Ask them why!
 * When do players seem the most proud of themselves? Did they see it in the game, or did it had to be explained to them?
 * What are the players saying between them? What questions and comments do they exchange?
 * What interactions between players come back the most often? What interaction has the most effect on the ambiance?

Other

 * Free field

Wrapping up

 * How many rounds played?
 * How many rounds where players were
 * How long did it last?

Playtest

 * When?
 * Who organized?

Game concept

 * Did you enjoy playing the game? (be honest! :) ) (1-4)
 * Why?
 * What do you like about the game? Why?
 * What do you not like about the game? Why? (really, don't hesitate to be cruel - honesty helps the most here : ) )
 * What is missing in the game?

Fairness

 * Do you think the game is fair? Was there any moment where you thought to yourself - "this isn't fair!"?
 * Do you feel this game is based more on luck or on skill? (1-4)
 * Do you like it?
 * Was any of the choices you were asked to make meaningless? Which one(s)?
 * Was there moment where you didn't like something that happened in the game? Can you describe them?
 * Was there moments where you felt proud of something you achieved in the game? When was it?

Accessibility

 * What was your first reaction when you looked at the game the first time?
 * What were you already understanding of the game, before you started asking questions about it?
 * What questions did you ask about the game, to be able understand it?
 * What would have helped you to understand it on your own, if you just had the game and no one to ask questions to?
 * Were you always able to do what you wanted to do, or were you frustrated by the interface sometimes?
 * Do you think the interface was providing you with enough information about what was going on in the game? (1-3)
 * Why?
 * Did you feel you were progressing as you played the game?
 * What was missing to help you follow your progression?

Social interactions

 * If you had to describe the game to a friend, how would you describe it? What is it about? What are the goals?
 * If the other players weren't in the room with you, but each of them at home on their own computer, what interactions would you miss? What did you liked to say to others, or hear from them?
 * If tomorrow you receive an invitation by email to play again, will you play? (1-4)
 * Will you create a game by yourself in the coming days? (1-4) Why?

About you

 * Age
 * Sex
 * Work
 * Industry
 * Location
 * Email
 * Can we contact you to ask precisions about this test?
 * Can we invite you to online playtest sessions?
 * Relationship to the playtest organizer (friend/spouse, colleague, only for the playtest, other)
 * Had you played Card Stories (or similar game) before this playtest ?