http://bugs.winehq.org/show_bug.cgi?id=21773
--- Comment #12 from Alexandre Julliard julliard@winehq.org 2010-02-27 07:22:45 --- (In reply to comment #11)
(In reply to comment #10) Just read your last sentence again: "Of course in all cases you have to start with clean wineprefix and make sure wine_gecko is available."
If you simply tell people to take any of the above 3 you do not assure that the proviso in that sentence will be met. That means that you cannot trust any of the regression-testing results you get back from the community.
Simply using the wine from the current source tree isn't enough. Good testing practice just isn't that simple.
The goal of the tests is not to run against an ideal perfect setup that is always identical. Getting a variety of tests run against a variety of setups, some less correct than others, is much more useful for spotting problems.
So if you want your own systematic always-reproducible test environment, feel free to write your own script to ensure that. But distributing the script for everybody to use would actually make the test results less useful.