Originally posted by RunningMn9
Originally posted by sjmay
Bort taking 40 different teams and running them through a test server when he makes changes,
The difference is that Bort taking 40 different teams and running them through a test server hasn't done jack shit to shake out bugs in the sim, has it? It's acceptable for a programmer to unit test his code - you NEVER, EVER have a programmer function/system test his own code unless it's an absolute necessity.
You need other fingers and eyes in there looking for things that you wouldn't think of. The difference between letting testers do it, and letting the general population do it is that testers can test at a higher frequency. Run two games a day instead of a game every two days. Run a season a day. Have testers that look through and watch the PBP of every game that is simmed on the test server. People that know how to find and characterize bugs in more detailed ways than "I DIDN'T WIN, THE SIM MUST BE BUGGED!!".
I don't know whether or not you do this for a living, but I do. The current methodology doesn't work in theory - and it certainly isn't working in practice as HUGE and obvious bugs routinely escape whatever initial testing Bort is doing.
As a SQL developer myself, I agree with this statement. Its almost impossible to test your own code and find every bug in it. HOWEVER, the GLB community is ripe with conspiracy theorists. Already, mods and alpha testers are looked at as having inside information. Adding true beta testers would only add to that problem.
Season 5 is the make or break season of this game. Why? Someone else said it...NFL and NCAA football.
If the game can survive the opening weekend of both levels of real football, I think it'll be around for the long haul. The whole issue of beta vs non-beta will play only a small role in it.
Originally posted by sjmay
Bort taking 40 different teams and running them through a test server when he makes changes,
The difference is that Bort taking 40 different teams and running them through a test server hasn't done jack shit to shake out bugs in the sim, has it? It's acceptable for a programmer to unit test his code - you NEVER, EVER have a programmer function/system test his own code unless it's an absolute necessity.
You need other fingers and eyes in there looking for things that you wouldn't think of. The difference between letting testers do it, and letting the general population do it is that testers can test at a higher frequency. Run two games a day instead of a game every two days. Run a season a day. Have testers that look through and watch the PBP of every game that is simmed on the test server. People that know how to find and characterize bugs in more detailed ways than "I DIDN'T WIN, THE SIM MUST BE BUGGED!!".
I don't know whether or not you do this for a living, but I do. The current methodology doesn't work in theory - and it certainly isn't working in practice as HUGE and obvious bugs routinely escape whatever initial testing Bort is doing.
As a SQL developer myself, I agree with this statement. Its almost impossible to test your own code and find every bug in it. HOWEVER, the GLB community is ripe with conspiracy theorists. Already, mods and alpha testers are looked at as having inside information. Adding true beta testers would only add to that problem.
Season 5 is the make or break season of this game. Why? Someone else said it...NFL and NCAA football.
If the game can survive the opening weekend of both levels of real football, I think it'll be around for the long haul. The whole issue of beta vs non-beta will play only a small role in it.






























