http://bugs.winehq.org/show_bug.cgi?id=19377
--- Comment #3 from Rosanne DiMesio dimesio@earthlink.net 2009-07-21 11:38:24 --- I understand the need to adjust for false garbage reports, but the problem is with using any sort of average at all. One gold and one bronze does not equal a silver because of the way in which these levels are defined, regardless of the accuracy of the individual test reports.
If there were hundreds of test reports being submitted for each app for each version of Wine, an average rating might approach some degree of accuracy, but that's not likely to happen.
My suggestion would be to abandon the idea of an overall rating altogether and simply display the most recent test report for the latest Wine version, with perhaps preference given to reports submitted by maintainers. But I imagine I'm alone in that opinion.