[RFC] Improving the summary results on test.winehq.org

[Reece Dunn]

Hi,

Looking at the results from a test run (e.g.
http://test.winehq.org/data/200803181000/), it would be nice to have:

    1.  A summary of a dlls overall results (i.e. the summation of all
its unit test results), preferably before the individual tests, but
could live with them at the bottom.

    2.  A summary of the entire test results (i.e. the summation of
all unit test results for all dlls). This would be best at the top
where it is easily visible.

    3.  Possibly display the number of tests run in a given pass (e.g.
0/12 or 1+3/27). This is to give an idea of how many tests have been
run easily (especially for the dll and overall summaries).

The idea is to get a quick idea of the health of the test results for
each operating system and dll.

- Reece

[John Klehm]

On Wed, Mar 19, 2008 at 3:47 AM, Reece Dunn <msclrhd(a)googlemail.com> wrote:
> 3.  Possibly display the number of tests run in a given pass (e.g.
>  0/12 or 1+3/27). This is to give an idea of how many tests have been
>  run easily (especially for the dll and overall summaries).
>
> The idea is to get a quick idea of the health of the test results for
>  each operating system and dll.

You mouse over any of the results and it will give you the number of tests.

--John

[Paul Vriens]

Reece Dunn wrote:
> Hi,
>
> Looking at the results from a test run (e.g.
> http://test.winehq.org/data/200803181000/), it would be nice to have:
>
> 1.  A summary of a dlls overall results (i.e. the summation of all
> its unit test results), preferably before the individual tests, but
> could live with them at the bottom.
>
> 2.  A summary of the entire test results (i.e. the summation of
> all unit test results for all dlls). This would be best at the top
> where it is easily visible.
>
> 3.  Possibly display the number of tests run in a given pass (e.g.
> 0/12 or 1+3/27). This is to give an idea of how many tests have been
> run easily (especially for the dll and overall summaries).
>
> The idea is to get a quick idea of the health of the test results for
> each operating system and dll.
>
> - Reece

I think Francois already put a lot of these on his todo list:

http://www.winehq.org/pipermail/wine-devel/2008-March/063641.html

Cheers,

Paul.

[Francois Gouget]

On Wed, 19 Mar 2008, Reece Dunn wrote:
> Hi,
>
> Looking at the results from a test run (e.g.
> http://test.winehq.org/data/200803181000/), it would be nice to have:
>
> 1.  A summary of a dlls overall results (i.e. the summation of all
> its unit test results), preferably before the individual tests, but
> could live with them at the bottom.

I'm not sure this one is worth it. It would add quite a lot of lines 
too.
> 2.  A summary of the entire test results (i.e. the summation of
> all unit test results for all dlls). This would be best at the top
> where it is easily visible.

I've sent a patch doing just that, with the percentage of unit tests 
that have errors too.
> 3.  Possibly display the number of tests run in a given pass (e.g.
> 0/12 or 1+3/27). This is to give an idea of how many tests have been
> run easily (especially for the dll and overall summaries).

As mentioned before you get the number of individual checks that where 
run in the per-test tooltip. The 'statistics' patch also provides the 
total number of unit tests in a tooltip.

-- 
Francois Gouget <fgouget(a)free.fr>              http://fgouget.free.fr/
                            1 + e ^ ( i * pi ) = 0