Conformance tests

[Michal Okresa]

Hello,

wine developers guide says that conformance tests must pass successfully on 
all Windows platforms.

I tried couple of tests in past weeks to catch wine's style of unit testing, 
but now I am confused. For example I run crosscompiled olefont test 
(oleaut32) on the windows machines (XP,  98). The test ended with 15 
failures. The same test executed on my linux machine ended with 13 failures 
(reasons for failures are almost identical with previous runs on windows).

Is this expected behaviour of conformance tests on windows platforms?

thanks

[Paul Vriens]

On Tue, 2006-12-19 at 13:09 +0100, Michal Okresa wrote:
> Hello,
>
> wine developers guide says that conformance tests must pass successfully on 
> all Windows platforms.
>
> I tried couple of tests in past weeks to catch wine's style of unit testing, 
> but now I am confused. For example I run crosscompiled olefont test 
> (oleaut32) on the windows machines (XP,  98). The test ended with 15 
> failures. The same test executed on my linux machine ended with 13 failures 
> (reasons for failures are almost identical with previous runs on windows).
>
> Is this expected behaviour of conformance tests on windows platforms?
>
> thanks

As you can see on tests.winehq.org, there are several tests that fail on
several flavors of Windows. The goal is of course to have all these
tests succeed.

So bottom-line, the expected/wanted behavior is to have all tests
succeed on all versions of Windows and Wine. If a test is known to have
different output on different versions, the tests have to cope with
that.

Cheers,

Paul.