As many will have noticed, the past few days have had the planes server live with the new module up for testing.
There may have been some miscommunication in how this is/ was done, and I'd like to clarify the goals, means, and outcome so that there's no confusion.
The major goal of testing a major server alteration is to find bugs. The secondary goal is to test balancing issues. Now bear in mind we've had hundreds of area changes or additions, hundreds of item/ creature changes or additions, and generally just a lot of changes. This breeds bugs. Additionally, there is a server merge that has happened. This breeds bugs as well.
So, after the 4 days of testing, which has now been closed, the testers have found about 40 legitimate bugs and offered dozens of suggestions on balance. Prior to that, there were individual balance tests with a different test group that merely spawned new creature groups in front of them to thoroughly examine balance issues. This aspect has been going on for about 3 months in a very gradual process.
Why is it important to have a small test group before opening it up to an entire server? Well, let me give you a good example. There was a bug with the server merge that was basically limbo'ing characters to a nonexistant server in a way that the only solution was to either have Dorg fix it it, or to have a GM catch them on login, and try to kill them quickly so they could respawn. I can't really think of a better example as to why testing needs to be done in a closed environment.
In the final testing most of the tests dealt with fairly epic areas. I selected a group based on class roles, appropriate levels for these tests, and timezone matches. No additional players or GM's were allowed in since the major idea behind an update is reinvigorating the new and exciting.
Individual XP was logged at the beginning of testing, and XP returns are currently being dealt with now that testing is over. Groups weren't allowed to loot, but you'd better believe the nosey ones peeked at drops...and hey, there's a lot of exciting new stuff in there so you can't blame them. DT's, of which there were many, are being returned. This is only fair since, for one, there is little reward in testing, and two, half the deaths were bug related and the other half are due to them being forced into CR 34 areas with just 4 people level 30 and under. Which was at least humorous to watch. O.o
Being part of a test group has advantages and disadvantages. A typical advantage folks will point out is that they get to see everything first. I'd like to offer the major counter to that, which is that while they see everything first, it's not as natural as seeing it in the actual game, it is typically riddled with disruptive bugs, and they basically aren't doing it on their character's own terms. Which is a major downer in my opinion and something I have always disliked since it can steal a good bit of the magic out of it.
Anyhow, many thanks to the testers.