Last summer, as we were getting into the beta phases of our 5.5 release, Matt rounded up a group of users and developers to participate in a “Test Fest”. The goal of Test Fest was to rally around field-testing of the product, seeing what you can find that we missed in our QA cycles. A group effort to really pound on the beta release, shake out those corner cases that we simply don’t know you need us to test beforehand.
We’ve had some success with field-testing during the beta phases in the past, but when I look at the results compared to what the field is reporting to us after GA, it looks something like the chart to the right.
It looks nicer in a Sugar Pro reports chart, trust me… but I like scribbling :-)
The number of bugs found by the field, and submitted to http://bugs.sugarcrm.com, during the beta phases of a release pales is much lower than what’s found after we’ve already gone GA. This isn’t terribly surprising, but still not where any of us want it to be. I think it’s safe to speak for our user community when I say we want to shake out more and more bugs before GA than after GA. Agreed?
So. I throw down the gauntlet to you — we think we’ve raised our game with the quality of our releases, I challenge you to prove us wrong.
What is Test Fest?
A collection of end-users, developers, and SugarCRM employees who work closely together to validate new features and bug fixes in Sugar components that are important to their business.
When is Test Fest?
Now! Sugar 6 was announced as beta a week ago. Beta cycles will continue as necessary to ensure that Sugar 6 is the best release we’ve ever had.
How does Test Fest work?
You (the tester) will try out various features in a particular component of Sugar 6. You should test what’s important to YOUR business. Bugs should be submitted through http://bugs.sugarcrm.com. With our new public SVN repository, you can check out the daily updates to Sugar 6 to verify your bugs when they’ve been fixed.
Sign me up!
Please let me know if you are willing to participate in Test Fest by adding your name to this forum thread. The most prolific testers will receive fame and glory and my undying admiration… or maybe something shiny :-)