James Hawkins wrote:
On Wed, Feb 11, 2009 at 3:27 PM, Alexandre Julliard julliard@winehq.org wrote:
James Hawkins truiken@gmail.com writes:
We should leave the failing files percentage up (note the name change) and add a failing tests percentage next to it. The failing tests percentage should be total_test_failures / total_tests_run.
That's not a useful number, many files run a lot of tests, of which a huge majority always succeeds. Having a single failure among 10,000 tests means that the test failed, and it's something bad that should be taken care of. Showing that as a 99.99% success would be very misleading.
Ok you're right. I wasn't thinking on that scale. I assumed we had more than 0.01% failures.
Why not just print absolute numbers for tests failed and passed? Does a percentage even serve any benefit here?
With absolute numbers we could see progress in both tests being fixed and in tests being written.
Thanks, Scott Ritchie