CS 4154: Analytics-driven Game Design

Assignment 12
Newgrounds Postmortem Report

Due: Monday, November 20th at 11:59 pm

In a report, answer the following questions:

1. What was your A/B test? What did you change? Which condition performed the best? Why?

1b. Show and discuss burndown charts for progress (e.g. levels completed) and time played for both the A and B conditions of the Newgrounds Release.

1c. Show data that illustrates the impact of the A/B test on player engagement. You need to make a convincing case. A heatmap comparison is a great way to do this. If you don't show a heatmap, you need other data to make the case clearly.

1d. (Optional - no longer required) Test for statistical significance in levels completed using a Wilcoxon-Kruskal-Wallis Two-tailed test and report the results.

1e. (Optional - no longer required) Test for statistical significance in time played using a Wilcoxon-Kruskal-Wallis Two-tailed test and report the results.

2. Did player engagement improve from Friends to Newgrounds? Why or why not?

2b. Show and discuss burndown charts for progress (e.g. levels completed) and time played for the Friends Release and whichever Newgrounds Release condition did the best. (You can show all three if it's difficult to decide.)

2c. Show data that illustrates the impact of the most important change made from Friends to Newgrounds on player engagement. You need to make a convincing case. A heatmap comparison is a great way to do this. If you don't show a heatmap, you need other data to make the case clearly.

3. What will you change for Kongregate? Why does the data support this conclusion?


Grading

Your team's report will be evaluated on the following criteria:

  • Completeness - Does it provide all the requested information and visualizations?
  • Clarity - Is it clear? is the font big enough to read, both in the text and graphs? Are axes labeled?
  • Logical argumentation - Does it use data to justify its analysis and conclusions convincingly?


Submission

Create a document answering these questions and submit it as a PDF through CMS by the deadline.