Given the number of beta testers, and the fact most of them just provided telemetry data and were only really interested in getting a shiny new toy to play with (like most beta testers these days, sadly), I think it's fair enough that beta testers are not being given a free copy of Windows 7.
What I think *isn't* right, though, is that the reward for testing Windows 7 beta and RC1 is to continue using RC1 until October, even though the RTM code will be complete in the next couple of weeks.
Why thank people by forcing them to keep using old/broken code when new/fixed code is available? IMO it'd be better if Microsoft gave all beta testers access to the RTM with their licence keys expiring at the time of the retail release. What is there to lose from doing that?
It's not only annoying for those testers: It's bloody annoying for software developers as well.
We have people reporting issues in our software when run on Windows 7 beta, RC1 and various leaked builds. Others then report the issues aren't there in later (leaked) builds... It'd be nice if we didn't have to worry about which of the many Win 7 builds people are using (and the back & forth of finding out) when they report issues and we try to reproduce them.
For both users and developers, it'd be nice not to have to investigate and resolve bugs which it turns out have already been fixed.
After two-plus years of development, Windows 7 is almost done. Microsoft officials have been thanking (though not to some testers’ liking — more on that later) the millions who downloaded the various test builds and provided feedback for their help in building the product.
However, Microsoft’s brass isn’t thanking publicly an inner circle of about 40 or so individuals who actually were the “real” Windows 7 testers. This group of hand-picked individuals are the ones on whom the Windows team seemed to count for a lot of the feedback about the various test builds of Windows 7 as it made its way through the development pipeline.
These so-called Test Pilots saw more Windows 7 builds than the rest of the testing community, and they usually saw them earlier. Microsoft officials were especially attuned to their feedback when tweaking the product. In spite of the Windows client team’s repeated insistence that “telemetry, telemetry, telemetry!” means Windows 7 is a customer-driven release, some believe that the Test Pilots and Microsoft’s corporate Technology Adoption Program (TAP) testers were the only external entities that had much of any real impact on the final Windows 7 product.
(Update: For the record, the Windows client team insists that this perception is untrue and that testers’ feedback made a difference in Windows 7. See the Engineering 7 blog posts here, here and here for more on Microsoft’s defense of its testing policies.)
None of the Test Pilots I contacted was willing to be identified by name. Some refused to acknowledge that they were Pilots or knew about the Pilot program, fearing the wrath of the Windows client management. (You can’t blame them; they want to be part of the Windows 8 inner circle, too.)
Microsoft’s decision to create this “elite” group has created considerable animosity among other Windows testers. While the majority of the unwashed masses of public testers don’t assume their suggestions and bug finds will matter much in terms of Windows’ final design, Microsoft’s “technical beta testers” do.
Many of technical beta testers put a lot of time and energy into unearthing and documenting bugs and passing them on to Microsoft. And a number of them were angry that they were provided with only two official Windows 7 test builds from Microsoft over the past three years — and that all they are getting for their work on Windows 7 is a belated “we gave you a chance to get Win 7 at 50 percent off” head-pat and no free copy of the final product.
Up until the start of the Windows 7 development cycle, the technical beta testers were treated as more integral to the creation of Windows. Testers felt like their feedback and guidance mattered and that they were kept in the loop more about what was coming when. Betas of Windows felt more like malleable builds that were subject to user-contributed changes — unlike the case with Windows 7, which a number of testers felt was nearly done by the time it hit its pre-beta milestone builds, let alone the first beta.
In short, the Windows 7 beta testing process was now a lot like Microsoft Office’s, with the first test build seeming more like a final version of the product than something that Microsoft actually expected to be open to tester feedback. (Given the number of former Office managers and execs who now are leading the Windows team, that change isn’t too surprising.)
Was the Windows 7 testing experience any different/better for the Test Pilots?
One Test Pilot with whom I spoke said that while the pilots received new builds of Windows 7 every month or so, they weren’t privy to much information, either.
