Improving Citizen Science Games through Open Analytics Data
Keywords:cyberlab, video games, analytics, metrics, citizen science, synthetic biology, open data, open source
AbstractGame developers make heavy use of "metrics" (or "analytics") in order to understand how their games are being played by the public. Through recording players' actions within a game, designers can identify weaknesses in the game design, such as sections of the game that are too difficult, or never explored. Meanwhile, a genre of “scientific games” has emerged, in which players contribute to the advancement of science through their actions in a game, learn scientific concepts, or both. Although most scientific games incorporate metrics, the data is meant only for the developers and is rarely shared with the public. This represents a missed opportunity for the public to learn from the data that they and their fellow players are generating.Inspired by the belief that anyone can contribute to science, we have created an open source game analytics service called "RedMetrics" in which all data gathered is freely and immediately available online. RedMetrics can gather data from any platform (web, PC, console, etc.) and stores it on an open repository. The data is available via a web API as well as a web application. To ease integration, we provide interfaces for the popular game engine Unity as well as for the web browser.In this paper, we demonstrate RedMetrics through a case study of Hero.Coli, a game to learn synthetic biology. We study the progression of players through the game and use RedMetrics to identify bottlenecks in the game design that hinder learning.
Bennett, J., & Lanning, S. (2007). The Netflix Prize. KDD Cup and Workshop, 3–6. http://doi.org/10.1145/1562764.1562769
Booth, D., Haas, H., McCabe, F., Newcomer, E., Champion, M., Ferris, C., & Orchard, D. (2004). Web Services Architecture. Group, 22(February), 19–26. http://doi.org/10.1023/B:BTTJ.0000015492.03732.a6
Christian, B. (2015). The A/B Test: Inside the Technology That’s Changing the Rules of Business. Wired Magazine.
Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., … Players, F. (2010). Predicting protein structures with a multiplayer online game. Nature, 466(7307), 756–60. http://doi.org/10.1038/nature09304
Culbertson, G., Andersen, E., White, W., Zhang, D., & Jung, M. (2016). Crystallize: An Immersive, Collaborative Game for Second Language Learning. In CSCW.
Denzin, N. K., Simon, H. A., & Ericsson, K. A. (1985). Protocol Analysis: Verbal Reports as Data. Contemporary Sociology (Vol. 14).
El-Nasr, M. S., Drachen, A., & Canossa, A. (2013). Game Analytics: Maximizing the Value of Player Data. Retrieved from https://books.google.com/books?hl=fr&lr=&id=-guHadEPrFcC&pgis=1
Fielding, R. T. (2000). Architectural Styles and the Design of Network-based Software Architectures. Building, 54, 162. http://doi.org/10.1.1.91.2433
Himmelstein, J., Couzic, M., Jennett, C. I., Cox, A. L., Goujet, R., Lindner, A., & Taddei, F. (2014). RedWire: A Novel Way to Create and Re-Mix Games. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play - CHI PLAY ’14. http://doi.org/10.1145/2658537.2661315
Hunt, J. W., & Mcilroy, M. D. (1976). An Algorithm for Differential File Comparison. Bell Laboratories Computing Science Technical Report (Vol. 41). Retrieved from http://www1.cs.dartmouth.edu/~doug/diff.ps
Janssen, M., Charalabidis, Y., & Zuiderwijk, A. (2012). Benefits, Adoption Barriers and Myths of Open Data and Open Government. Information Systems Management, 29(4), 258–268. http://doi.org/10.1080/10580530.2012.716740
Kawrykow, A., Roumanis, G., Kam, A., Kwak, D., Leung, C., Wu, C., … Waldispühl, J. (2012). Phylo: a citizen science approach for improving multiple sequence alignment. PloS One, 7(3), e31362. http://doi.org/10.1371/journal.pone.0031362
Kim, J. S., Greene, M. J., Zlateski, A., Lee, K., Richardson, M., Turaga, S. C., … Seung, H. S. (2014). Space-time wiring specificity supports direction selectivity in the retina. Nature, 509(7500), 331–6. http://doi.org/10.1038/nature13240
Kohavi, R., Henne, R. M. R., & Sommerfield, D. (2007). Practical guide to controlled experiments on the web. Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD ’07, 2007, 959–967. http://doi.org/10.1145/1281192.1281295
Lee, J., Kladwang, W., Lee, M., Cantu, D., Azizyan, M., Kim, H., … Das, R. (2014). RNA design rules from a massive open laboratory. Proceedings of the National Academy of Sciences of the United States of America, 111(6), 2122–7. http://doi.org/10.1073/pnas.1313039111
Miller, S. A. (2012). Piwik Web Analytics Essentials. Retrieved from https://books.google.com/books?hl=fr&lr=&id=xAI3NnTFDzUC&pgis=1
Raddick, M. J., Bracey, G., Gay, P. L., Lintott, C. J., Murray, P., Schawinski, K., … Vandenberg, J. (2010). Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers. Astronomy Education Review, 9(1), 010103. Retrieved from http://scitation.aip.org/content/aas/journal/aer/9/1/10.3847/AER2009036
Schell, J. (2008). The Art of Game Design: A Book of Lenses. Annals of Physics (Vol. 54). http://doi.org/9780123694966
Sharp, L. (2012). Stealth Learning: Unexpected Learning Opportunities Through Games. Journal of Instructional Research, 1.
Steele, C. (2013). Open Access (The MIT Press Essential Knowledge Series). Australian Library Journal, 62(3), 248–249. http://doi.org/http://dx.doi.org/10.1080/00049670.2013.811775
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., … Frame, M. (2011). Data sharing by scientists: practices and perceptions. PloS One, 6(6), e21101. Retrieved from http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0021101
How to Cite
LicenseAuthors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).