[Bug 16018] New: No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

Summary: No report presented
           Product: Wine
           Version: 1.1.8
          Platform: Other
        OS/Version: other
            Status: UNCONFIRMED
          Severity: minor
          Priority: P2
         Component: testcases
        AssignedTo: [e-mail]
        ReportedBy: [e-mail]

I've been running the conformance tests on my Linux desktop pretty frequently
for quite some time. I hope it will help the developers in any way.

For long everything was fine. I ran the tests and submitted them, and soon the
results appeared nicely among other test results in
http://test.winehq.org/data/. But then, a month ago or so I noticed my report
didn't appear in the table anymore, although I ran the tests and submitted them
several times. Well, at first I thought, that maybe you've cut down multiple
reports by the same Wine version and reporter, because I was running the tests
with the development version and not the git. The new Wine version came, and
yes, my report was found again. I thought it was just because of "cutting the
crap" and I felt it's quite ok.

But now, with Wine 1.1.8 I've got no report whatsoever! I've run the tests
three times quite normally, without any crashes (one timeout, though), and
submitted the results as always. But no report has appeared in the tables at
all...

I know nothing has changed in this end, except the Wine version. Has there been
some cut on reports presented or is this really a bug?

[Bug 16018] No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

--- Comment #1 from Jeff Zaroyko   2008-11-12 05:16:32 ---
(In reply to comment #0)
> I've been running the conformance tests on my Linux desktop pretty frequently
> for quite some time. I hope it will help the developers in any way.

Have you been running the latest conformance test[1] with the latest git?

Someone was running the conformance tests using old versions of Wine rather
than recompiling with every commit round, so this was fixed at the server
end[2].

1. http://www.astro.gla.ac.uk/users/paulm/WRT/CrossBuilt/winetest-latest.exe
2.
http://source.winehq.org/git/tools.git/?a=commit;h=debcd82f5f6947d518ef26b40...

[Bug 16018] No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

--- Comment #2 from Timo-Heikki Mäkelä   2008-11-12 05:49:35 ---
Dang... That "someone" may well have been me. I thought the latest version of
Wine should do for running the tests, although the fixes would then only appear
once the new version is available. (Resulting in false errors on fixed errors
until the new Wine version.)

Now, that fix obviously requires now:

#1. using the newest git OR 
#2. running the tests immediately after a new Wine version is available AND
before first git update AND that there's a new version of tests available after
the new Wine version.

Case #2 doesn't necessarily happen for every Wine version, so I guess I need to
start compiling the git from now on...

[Bug 16018] No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

Timo-Heikki Mäkelä  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
         OS/Version|other                       |Linux
           Platform|Other                       |PC

[Bug 16018] No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

Alexandre Julliard  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|                            |WONTFIX

--- Comment #3 from Alexandre Julliard   2008-11-12 06:09:21 ---
The Wine version needs to be as new as the tests, otherwise you get a lot of
spurious errors for things that have been fixed already. The tests are here to
catch regressions, so if you run against an older Wine it will look like a
regression. You don't have to build from git as long as you use a winetest that
matches the Wine release you are running on.

Also please make sure you start with a fresh .wine directory, your results have
a lot of errors caused by an old .wine.

[Bug 16018] No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

--- Comment #4 from Timo-Heikki Mäkelä   2008-11-12 06:31:40 ---
Ok. I recognize that.

Thank you for the kind answer. And keep up the great work you are doing! :)

[Bug 16018] No report presented

http://bugs.winehq.org/show_bug.cgi?id=16018

Dmitry Timoshkov  changed:

What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |CLOSED

--- Comment #5 from Dmitry Timoshkov   2008-11-12 07:14:11 ---
Closing.