Temple of The Roguelike Forums

Websites => Off-topic (Locked) => Topic started by: ChQoKG on September 10, 2014, 07:05:27 PM

Title: Individual research on crowdfunded games [SURVEY]
Post by: ChQoKG on September 10, 2014, 07:05:27 PM
Hello, fellow gamers,
I am doing research on quality of crowdfunded games and I ask you to fill in the questionnaire about your opinion of certain games. Each survey consist of 13 questions. The survey is not linked in anyway with any of game companies and is individual work as a school project. The links to the questionnaires of games, that are considered rogue-likes in some ways:

Quality of FTL: Faster than light (https://docs.google.com/forms/d/1UT2wCMBtLb05ITyWZ6DooWQO_73jlY6pvtSlhtLh_hQ/viewform?usp=send_form)
Quality of Risk of Rain (https://docs.google.com/forms/d/13aTQDfkU7fndVcEDM8J30TlAqUzCJ6QCp3sG-BDYia4/viewform?usp=send_form)

And also if, by the chance, some of you had played other games, I am leaving other questionnaires:

Quality of Shadowrun Returns (https://docs.google.com/forms/d/19dREGZpqiQ_GrG3C32teCOyAVkDugBDCp32hJgKQoAk/viewform?usp=send_form)
Quality of Takedown: Red Sabre (https://docs.google.com/forms/d/1P81yynyeyPnTEUvrmuWXxsdhWrIRd0I9f26IrZ3pckg/viewform?usp=send_form)
Quality of Among the Sleep (https://docs.google.com/forms/d/1o9739aEfWg0uoqT-iVxpKQTWdNhY4KfQSJ3hELVvnj4/viewform?usp=send_form)
Quality of Akaneiro: Demon Hunters (https://docs.google.com/forms/d/1Vz4JO89A03oJLI_oeaxYcO0yUuzbepdbRI44xm3_nUA/viewform?usp=send_form)
Quality of Divinity: Original Sin (https://docs.google.com/forms/d/1IzmFimenzAIp8gXvtgO2ynSIC4oQ111DCsnoSP0bv-U/viewform?usp=send_form)
Quality of Expeditions: Conquistador (https://docs.google.com/forms/d/1_OR3j3hnD6BIqTWVUJy1lJ3XphENsOINtA1L2uR8IVA/viewform?usp=send_form)
Quality of Secrets of Rætikon (https://docs.google.com/forms/d/1iEPiIYPm09U6Sz2oFXtg817hVEjfD_xmhcatIYqxu1I/viewform?usp=send_form)
Quality of Contagion (https://docs.google.com/forms/d/1QQz2FpTKeTC-dgYbu0GMZ6VWPaNm17giJY41hNy3NW0/viewform?usp=send_form)
Quality of Shovel Knight (https://docs.google.com/forms/d/1G4oLbVBqy4J3BluF3YExYMjYUziKiEcO_LK2agohYz8/viewform?usp=send_form)
Quality of Chivalry: Medieval Warfare (https://docs.google.com/forms/d/168ztIDc4CB1kE4W7v-L0mZ-op18ZArvRsy9DiSw-pYE/viewform?usp=send_form)
Quality of Xenonauts (https://docs.google.com/forms/d/1ps0mWqybHGXtI0cecPP24ukqvVAQFA2zNGCtwadkIrU/viewform?usp=send_form)
Quality of Fist of Awesome (https://docs.google.com/forms/d/1cgWzByapKQjBaJBQmbOjrTUpWvdVwNlOYo7FhjP4iSs/viewform?usp=send_form)

Thank You for your time and help. If you have any questions I'll try to answer them. I hope it isn't against rules as I am not receiving any profit from this research.
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: Z on September 11, 2014, 07:54:25 AM
Is it required to play both games in a pair, and know the details of crowdfounding campaign, to contribute meaningfully? I don't want to ruin your data by choosing a pair where I have played just one game, or neither.

Anyway, it looks on-topic, so it is not against the rules. Will you share the results with us?
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: mushroom patch on September 11, 2014, 02:25:07 PM
Uh, random head-to-head comparisons are unlikely to produce useful data or significant participation. You should rethink the design of your study.
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: Samildanach on September 11, 2014, 03:13:12 PM
Uh, random head-to-head comparisons are unlikely to produce useful data or significant participation. You should rethink the design of your study.
They're not really random. Judging by the ones I know from that list, the pairs are at least similar genres/game styles - e.g. Shadowrun Returns/Fallout 2, Xenonauts/XCOM, Akaneiro/Torchlight 2.

There are other variables which might limit the usefulness of the results, though (things like age - e.g. Fallout 2 is significantly older than Shadowrun Returns). It's ChQoKG's project though, so he/she can set the parameters however he/she wishes.
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: ChQoKG on September 11, 2014, 04:13:23 PM
response to Z: Well, it isn't required to play both games, I can't check that, but it won't be as good as if you've played both, due to the fact that watching some let's plays won't be as good as playing certain game on your own. About sharing the results, we will see.

response to mushroom patch: I've tried to pick the most similar games which I could think of, probably the worst pair in this study is Shadowrun vs Fallout 2 comparison, due to the fact that there's difference of 15 years between both releases. If there was any better candidate it's too late to change it.

Also I'll probably do more questionnaires, this time without comparison (only kickstarted games) for people who couldn't play both (they're majority after all), but it doesn't mean that these are worthless, they will be just as addition to the whole study. In case someone wonder, why I was doing comparison and now I want to change it. The teacher who helps me doing the study isn't interested in gaming, and he proposed to do comparison, I've contacted him lately and now he accepted the change to the research. Now all I have to do is to make new questionnaires that can provide data required to create good conclusions. I'll update the original post soon.
PS if I made any mistakes, I apologize, english isn't my native language.
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: Eben on September 12, 2014, 08:09:15 AM
response to Z: Well, it isn't required to play both games, I can't check that, but it won't be as good as if you've played both, due to the fact that watching some let's plays won't be as good as playing certain game on your own. About sharing the results, we will see.

response to mushroom patch: I've tried to pick the most similar games which I could think of, probably the worst pair in this study is Shadowrun vs Fallout 2 comparison, due to the fact that there's difference of 15 years between both releases. If there was any better candidate it's too late to change it.

Also I'll probably do more questionnaires, this time without comparison (only kickstarted games) for people who couldn't play both (they're majority after all), but it doesn't mean that these are worthless, they will be just as addition to the whole study. In case someone wonder, why I was doing comparison and now I want to change it. The teacher who helps me doing the study isn't interested in gaming, and he proposed to do comparison, I've contacted him lately and now he accepted the change to the research. Now all I have to do is to make new questionnaires that can provide data required to create good conclusions. I'll update the original post soon.
PS if I made any mistakes, I apologize, english isn't my native language.

It would be interesting to see what you thought was similar about the games. I'm guessing it's core mechanics, but even then most of the game pairs don't really match up, except in really broad ways.
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: ChQoKG on September 13, 2014, 03:26:17 PM
It would be interesting to see what you thought was similar about the games. I'm guessing it's core mechanics, but even then most of the game pairs don't really match up, except in really broad ways.

Mostly features that both games have, like exploration, crew management and ship management in case of FTL and Pixel Piracy, or "random" locations in case of two rogue-lite's (rogue-like-like?) which are Risk of Rain and Rogue Legacy, also both are platformers. Takedown and SWAT we're paired together because creators of Takedown promised "the spiritual successor to the original Rainbow Six and SWAT4". Among the Sleep and Outlast are both horror's from what I know. Do I need to say why every pair was picked in that way? I'll admit some aren't probably the best possible picks, but they're not random. Also I've updated original post with new questionnaires (single game instead of comparison of two games), old ones I'll post here, so everyone will know why the discussion looks like now:

FTL: Faster than light vs Pixel Piracy (https://docs.google.com/forms/d/1uYyJ28mtnjBF6_tz88T_l_lksR-tmG3IzQ8iojqQFkA/viewform?usp=send_form)
Risk of Rain vs Rogue Legacy (https://docs.google.com/forms/d/1XxGtxzmdWSK7X5BMX2dOOIe7akVvs2a8iLkhA16vMrg/viewform?usp=send_form)
Shadowrun Returns vs Fallout 2 (https://docs.google.com/forms/d/1zQKyPtVVWGscwOz999LT67OMZ1wCCB87fUr1ku1cdhk/viewform?usp=send_form)
Takedown: Red Sabre vs SWAT 4 (https://docs.google.com/forms/d/1TbRDnWKq71napu7J9J_-EujWU5HKK2Df8PnBkTnvpQ4/viewform?usp=send_form)
Among the Sleep vs Outlast (https://docs.google.com/forms/d/1YU1J_1s6YPf8IiURrrAdEyfPTonvUvdn5fKW_Qhz1qs/viewform?usp=send_form)
Akaneiro: Demon Hunters vs Torchlight 2 (https://docs.google.com/forms/d/1aRF35rXZw0SStKwiLDmgLiGLa7jFPWHjChKscCepoVI/viewform?usp=send_form)
Divinity: Original Sin vs Neverwinter Nights 2 (https://docs.google.com/forms/d/1mZWszR0w2IPMtTg-o73werizhQoYyH21piqlRM__4xM/viewform?usp=send_form)
Expeditions: Conquistador vs King's Bounty: Legend (https://docs.google.com/forms/d/1AXqin8RSkc5JxqKtcgCAEqOOckx77rccKaFpqfANn-g/viewform?usp=send_form)
Secrets of Rætikon vs La-Mulana (https://docs.google.com/forms/d/19zFgGO_jCPbM2Kcte7EBHjRPF3bekqMxcp0IuXd0AO4/viewform?usp=send_form)
Contagion vs Left 4 Dead 2 (https://docs.google.com/forms/d/10SExaySiMZG-H5-sorMWDS6bvZDdqIuSB5P5RKoWDz8/viewform?usp=send_form)
Shovel Knight vs DuckTales Remastered (https://docs.google.com/forms/d/1jHD9weFgfQ2FGTG-TWlOTwkpofKYODudvRilDGGa3PQ/viewform?usp=send_form)
Chivalry: Medieval Warfare vs War of the Vikings (https://docs.google.com/forms/d/1A4L3Td7LVf81_MdgJF3yP1EaiTAdtHYy6RsBjB7SMLg/viewform?usp=send_form)
Xenonauts vs XCOM: Enemy Unknown (https://docs.google.com/forms/d/1ziEGe8C737ztHELk8Vi1emK8DnOTLS0mSHFs8FVktl4/viewform?usp=send_form)
Fist of Awesome vs Castle Crashers (https://docs.google.com/forms/d/1uFlITZVJWjkw80nz50ecTBq7CMjqEM2184WGpIEDImY/viewform?usp=send_form)
Title: Re: Individual research on crowdfunded games [SURVEY]
Post by: Eben on September 13, 2014, 08:24:41 PM
The single game questionnaires are probably better than the comparison.

It seems like some of your choices are things like comparing limes and kiwi fruit because they're both green. It's more of a coincidence or partial factor in them rather than something that makes them comparable. Which is fine if the only question is which is more green. But if the question is which one tastes better the answer gets all muddied up in situational dependencies.