Editing and Testing Process

About your Editor

Puzzled Pint has produced a puzzle set every month for many years. With dozens of locations and thousands of solvers each month, we’ve figured out an editing and playtesting system for our puzzle sets that works well for our particular target audience.

You will work with a puzzle editor with experience shepherding hundreds of puzzles from draft to final form for that audience. Your editor is more than just a project manager, they are responsible for making sure all the puzzles fit our guidelines. As such, they will be giving you a great deal of feedback on your puzzles, both from their own experience and from the results of testing by others.

As with any criticism of creative work, it can be difficult to hear, but please know they are not judging your puzzles. Their feedback is solely to ensure the puzzles work for our target beginner solver. Thus, while your puzzles may be absolutely perfect for other puzzle hunts, if your editor asks for changes, it’s because the puzzles need to be changed to suit Puzzled Pint.  

Draft Approvals

In this first step of the editing process, you submit your puzzles, answers, and any hints (in whatever form you have, even just outlines!) to your editor. They may suggest changes to make the puzzles suitable for Puzzled Pint. It’s common for there to be several rewrites and revisions of puzzles in this stage. Puzzled Pint’s playtesting resources are only available after the Draft Approval stage.

Please note that all submissions will immediately fall under the CC BY-NC-SA 4.0 Intl. license, so please do not submit anything you don’t want to release under that license.

From Playtesting to Release

Once all puzzles in the set have been approved, we will schedule your set, assign an editor, and begin official playtesting. Puzzle sets are scheduled at least 3 months in the future to allow for our playtesting and quality control process.  

Please note, at this point, once the set has been scheduled, please make time to reply to your editor’s feedback. Staying on schedule makes a big difference for everyone.  

Your editor will shepherd your puzzles through various stages of playtesting and editing as described below. They must be satisfied with changes made at each stage before the next stage can begin.

Approval by Headquarters (12+ weeks out)

The first playtest done will be by the Puzzled Pint Headquarters team (in Portland). HQ usually meets every week, so this process shouldn’t take long. They will solve the set and catch any issues your editor missed. As the HQ team has more experience with testing than general playtesters, your editor will likely ask you to address most of the problems they report.

International Testing (10+ weeks out)

The next playtest done will be checking for issues our international solvers might have. Your editor will send the puzzle set to one of our international playtesters. This takes 1-2 weeks. Unfortunately, our international playtesters are very limited, so your editor will likely ask for changes for any problems they report, even if it’s only from one or two playtests. They know much better than we do if any puzzling elements will be too difficult across cultures. They are checking for things like reliance on pronunciation, idioms, regional spelling, rhymes, and regional knowledge.

While we like to resolve these issues by changing the puzzle(s), we’ve been known to resolve these by creating a different version of the puzzle for international audiences or by providing them additional reference sheets to work around the problem.

General Playtesting (10+ weeks out)

General playtesting takes two weeks to one month each round, as our testers need to schedule time to solve with their teams. There are generally two rounds of playtests. Team tests are much more valuable than individual tests, as we’re a team-based event. You or your editor may already have done individual tests during the Draft Approval stage to test for specific solvability issues, but these group tests are looking for three things:

  1. How long do the puzzles in the set take to solve?
  2. How fun are the puzzles to solve?
  3. How difficult are the puzzles to solve?

We collect feedback with forms and use a spreadsheet to process the results. We often have 10-15 playtests this way, thus get a really accurate sense of the puzzle set. Difficulty and Fun are rated on a 5-point scale with 3 being “Typical for Puzzled Pint”.

Targets for Length: The set should take no more than 90 minutes for intermediate solvers, and 60 minutes for experts. If the puzzles are too long, we’ll ask you to reduce the scope of the puzzle set.

Targets for Difficulty: We’re looking for scores in the range of 1.5-2.5 for easy puzzles, 2.5-3.5 for medium puzzles, and 3.5 to 4 for hard puzzles. Any puzzle less than 1.5 or more than 4 will be asked to be modified. Remember, the main set should have at least one easy, and no more than one hard puzzle. The Meta should also be an easy puzzle.

Targets for Fun Level: We’re looking for fun scores higher than 2.5 on all puzzles. Additionally, if a puzzle is within these ranges, but ranked above average on difficulty, and below average fun, we will likely suggest changes to make it easier.

International Playtesting: Our international playtesters are very limited, so your editor will likely ask for changes for any problems they report, even if it’s only from one or two playtests. They know much better than we do if any puzzling elements will be too difficult across cultures. They are checking for things like reliance on pronunciation, idioms, regional spelling, rhymes, and regional knowledge.

While we like to resolve these issues by changing the puzzle(s), we’ve been known to resolve these by creating a different version of the puzzle for international audiences or by providing them additional reference sheets to work around the problem.

There will be a lot of feedback at this stage. We provide it so you can make your puzzles as good as they can be. Outside of length and difficulty, making changes based on feedback in this stage is generally up to you to make or not, though some issues may arise in playtesting that we feel must be addressed. If so, we will try to make it clear which ones those are.

Revisions, Graphics and Layout (5 weeks out)

Here is where you prepare the final graphics and layouts for the puzzle. This includes the Answer sheet, a template for which can be provided by your editor. At this point, your puzzles should have the Bug and attributions on each puzzle, and you should begin work on the Polaroid, final full solution files, etc. If you aren’t able (or don’t want to) create graphics, let your editor know and we will ask some community members who occasionally help us with this process

Second Round Playtesting (5 weeks out)

This is normally part quality control, part testing any changes from round one. This can again take a couple of weeks to complete.

HQ Quality Control (3 weeks out)

At 3 weeks out, everything should be complete for a Quality Control review by HQ. Please see the QC Checklist for the list of items we review.

GC Quality Control (2 weeks out)

At 2 weeks out, we will send the puzzles out to the GC list for a final check.

Puzzles Released to Cities’ Game Control (1 week out)

The puzzle set is released to the cities for printing.

Archives on the Web Site

The final step in the process has your puzzles put up on our web site. Anyone can enjoy them with canned hint and answers for the rest of time. You are free to link to your puzzles on other pages, and you can be proud to have made a significant contribution to the puzzling community. Thank you again!


Questions?  

E-mail gamecontrol@puzzledpint.com for any questions or clarifications. Thanks for your interest in writing for Puzzled Pint!