Re: Janitorial Projects -- conformance tests --recruiting volunteers
I could probably run some tests under WinXP. I just need to compile the tests on windows, execute them, and post output to wine-devel? Is this correct?
On Mon, 9 Dec 2002, David Miller wrote:
I could probably run some tests under WinXP. I just need to compile the tests on windows, execute them, and post output to wine-devel? Is this correct?
Almost. Currently building the tests on Windows requires using Linux at some point :-/ So what I did is compile them here, whip up a quick batch file to invoke them all, and zip them up. You can download them from: http://fgouget.free.fr/wine/winetests.zip Just unzip them in some random directory and run them as follows: runtests.bat The above script skips the generated tests (for no particular reason) and skips the sysparams user32 test because it messes the environment badly (e.g. the width of window borders). Given the number of tests that fail you may want to run them one by one to better capture their output. To do so just have a quick look at the batch file, running the tests is very easy, e.g.: kernel32_test.exe path The zip file I made is very rough on the edges. What we need is: * automatic generation of that batch file (by msvcmaker?) * automatic zipping of the tests * better handling of Wine_Header vs. MSVC_Header tests * or maybe just base this on the MinGW cross-compiler rather than the Visual C++ 'port' Volunters welcome. -- Francois Gouget fgouget(a)free.fr http://fgouget.free.fr/ f u kn rd ts, ur wy 2 gky 4 ur wn gd.
Volunters welcome.
I thought I could try running them on my Windows XP Home machine.... C:\Downloads\Linux>advapi32_test.exe registry h:\wine\wine\dlls\advapi32\tests\registry.c:96: Test failed: value set to 'xxxxxxxxxx' instead of 'Te' h:\wine\wine\dlls\advapi32\tests\registry.c:97: Test failed: data set to 'xxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:111: Test failed: data set to 'xxxxxxx' instead of 'foobar' registry: 56 tests executed, 0 marked as todo, 3 failures. C:\Downloads\Linux>kernel32_test.exe alloc alloc: 58 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe atom atom: 229398 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe codepage codepage: 2 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe directory directory: 48 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe drive drive: 160 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe environ environ: 39 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe file h:\wine\wine\dlls\kernel\tests\file.c:578: Test failed: DeleteFile should fail with an empty path, and last error value should be ERROR_FILE_NOT_FOUND h:\wine\wine\dlls\kernel\tests\file.c:610:Current offset = 0015 h:\wine\wine\dlls\kernel\tests\file.c:635:Current offset = 0015 file: 487238 tests executed, 0 marked as todo, 1 failure. C:\Downloads\Linux>kernel32_test.exe format_msg format_msg: 58 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe locale locale: 54 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>kernel32_test.exe path h:\wine\wine\dlls\kernel\tests\path.c:517: Test failed: GetLongPathNameA: wrong return code, 102 instead of 42 h:\wine\wine\dlls\kernel\tests\path.c:927:TMP=C:\DOCUME~1\alby\IMPOST~1\Temp h:\wine\wine\dlls\kernel\tests\path.c:935:TMP=C:\WINDOWS h:\wine\wine\dlls\kernel\tests\path.c:944:TMP=C:\ h:\wine\wine\dlls\kernel\tests\path.c:954:TMP=C: h:\wine\wine\dlls\kernel\tests\path.c:879: Test failed: win2000 BUG: expected 12, got 13 h:\wine\wine\dlls\kernel\tests\path.c:892: Test failed: win2000 BUG: expected 12, got 13 h:\wine\wine\dlls\kernel\tests\path.c:898: Test failed: win2000 BUG: should return path without terminating back slash path: 2083 tests executed, 0 marked as todo, 4 failures. C:\Downloads\Linux>kernel32_test.exe process tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. h:\wine\wine\dlls\kernel\tests\process.c:374: Test failed: StartupInfoA:lpDesktop expected (null), got WinSta0\Default h:\wine\wine\dlls\kernel\tests\process.c:375: Test failed: StartupInfoA:lpTitle expected (null), got C:\Downloads\Linux\kernel32_test.exe tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. h:\wine\wine\dlls\kernel\tests\process.c:450: Test failed: StartupInfoA:lpDesktop expected (null), got WinSta0\Default tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. h:\wine\wine\dlls\kernel\tests\process.c:527: Test failed: StartupInfoA:lpTitle expected (null), got C:\Downloads\Linux\kernel32_test.exe tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. tests/process.c: 1 tests executed, 0 marked as todo, 0 failures. process: 116 tests executed, 0 marked as todo, 4 failures. C:\Downloads\Linux>kernel32_test.exe thread thread: 112 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>msvcrt_test.exe msvcrt C:\Downloads\Linux>netapi32_test.exe access h:\wine\wine\dlls\netapi32\tests\access.c:95: Test failed: Bad Network Path access: 23 tests executed, 0 marked as todo, 1 failure. C:\Downloads\Linux>netapi32_test.exe apibuf apibuf: 15 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>netapi32_test.exe wksta wksta: 14 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>Rem These don't compile with the MSVC headers C:\Downloads\Linux>rpcrt4_test.exe rpc h:\wine\wine\dlls\rpcrt4\tests\rpc.c:124: ** Uuid Conversion and Comparison Tests ** rpc: 901 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>shell32_test.exe shlfileop h:\wine\wine\dlls\shell32\tests\shlfileop.c:286: Test failed: Files are copied to other directory h:\wine\wine\dlls\shell32\tests\shlfileop.c:287: Test failed: The file is copied shlfileop: 121 tests executed, 0 marked as todo, 2 failures. C:\Downloads\Linux>shlwapi_test.exe clist h:\wine\wine\dlls\shlwapi\tests\clist.c:367: Test failed: allowed bad element size h:\wine\wine\dlls\shlwapi\tests\clist.c:372: Test failed: allowed adding a container clist: 236 tests executed, 0 marked as todo, 2 failures. C:\Downloads\Linux>shlwapi_test.exe shreg h:\wine\wine\dlls\shlwapi\tests\shreg.c:172: Test failed: (44,43) h:\wine\wine\dlls\shlwapi\tests\shreg.c:196: Test failed: (44,43) h:\wine\wine\dlls\shlwapi\tests\shreg.c:206: Test failed: () h:\wine\wine\dlls\shlwapi\tests\shreg.c:207: Test failed: () h:\wine\wine\dlls\shlwapi\tests\shreg.c:208: Test failed: (44,43) h:\wine\wine\dlls\shlwapi\tests\shreg.c:219: Test failed: (44,43) h:\wine\wine\dlls\shlwapi\tests\shreg.c:241: Test failed: didn't open dest shreg: 39 tests executed, 0 marked as todo, 7 failures. C:\Downloads\Linux>user32_test.exe class class: 80 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>user32_test.exe win h:\wine\wine\dlls\user\tests\win.c:91:main window 001E05DA main2 002E05CE desktop 00010014 child 000E05EC h:\wine\wine\dlls\user\tests\win.c:107:created child 00110698 h:\wine\wine\dlls\user\tests\win.c:120:created child of desktop 00120698 h:\wine\wine\dlls\user\tests\win.c:130:created child of child 00130698 h:\wine\wine\dlls\user\tests\win.c:140:created top-level 00140698 h:\wine\wine\dlls\user\tests\win.c:150:created owned top-level 00150698 h:\wine\wine\dlls\user\tests\win.c:160:created popup 00160698 h:\wine\wine\dlls\user\tests\win.c:170:created owned popup 00170698 h:\wine\wine\dlls\user\tests\win.c:180:created top-level owned by child 00180698 h:\wine\wine\dlls\user\tests\win.c:186:created popup owned by desktop 00190698 h:\wine\wine\dlls\user\tests\win.c:192:created popup owned by child 001A0698 h:\wine\wine\dlls\user\tests\win.c:198:created WS_CHILD popup 001B0698 h:\wine\wine\dlls\user\tests\win.c:204:created owned WS_CHILD popup 001C0698 h:\wine\wine\dlls\user\tests\win.c:209:testing parent changes h:\wine\wine\dlls\user\tests\win.c:221:created child 001D0698 h:\wine\wine\dlls\user\tests\win.c:247:created top-level 001E0698 h:\wine\wine\dlls\user\tests\win.c:264:created popup 001F0698 h:\wine\wine\dlls\user\tests\win.c:281:created child 00200698 h:\wine\wine\dlls\user\tests\win.c:298:created top-level 00210698 h:\wine\wine\dlls\user\tests\win.c:307:created owned popup 00220698 h:\wine\wine\dlls\user\tests\win.c:323:created owner 00230698 and popup 00120696 h:\wine\wine\dlls\user\tests\win.c:337:created owner 00130696 and popup 00240698 h:\wine\wine\dlls\user\tests\win.c:345:created owner 00140696 and popup 00250698 win: 373 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>user32_test.exe wsprintf wsprintf: 4 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>wininet_test.exe http h:\wine\wine\dlls\wininet\tests\http.c:90:Starting with flags 0x10000000 h:\wine\wine\dlls\wininet\tests\http.c:92:InternetOpenA <-- h:\wine\wine\dlls\wininet\tests\http.c:95:InternetOpenA --> h:\wine\wine\dlls\wininet\tests\http.c:101:InternetConnectA <-- h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC0004 0xdeadbeef INTERNET_STATUS_HANDLE_CREATED(60) 0012E990 4 h:\wine\wine\dlls\wininet\tests\http.c:104:InternetConnectA --> h:\wine\wine\dlls\wininet\tests\http.c:108:HttpOpenRequestA <-- h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC0008 0xdeadbead INTERNET_STATUS_HANDLE_CREATED(60) 0012EC04 4 h:\wine\wine\dlls\wininet\tests\http.c:122:HttpOpenRequestA --> h:\wine\wine\dlls\wininet\tests\http.c:126:HttpSendRequestA --> h:\wine\wine\dlls\wininet\tests\http.c:133:HttpSendRequestA <-- h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead ¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦H²L?I{?v?(80) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_RESOLVING_NAME(10) 014CFB04 15 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_NAME_RESOLVED(11) 014CFAF4 12 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_CONNECTING_TO_SERVER(20) 014CFB9C 12 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_CONNECTED_TO_SERVER(21) 014CFD40 12 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_SENDING_REQUEST(30) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_REQUEST_SENT(31) 014CFCE0 4 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_RECEIVING_RESPONSE(40) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_RESPONSE_RECEIVED(41) 014CFD60 4 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_REQUEST_COMPLETE(100) 014CFDA8 8 h:\wine\wine\dlls\wininet\tests\http.c:140:Option 0x17 -> 1 8 h:\wine\wine\dlls\wininet\tests\http.c:144:Option 0x22 -> 1 http://www.winehq.com/about/ h:\wine\wine\dlls\wininet\tests\http.c:149:Option 0x16 -> 1 HTTP/1.1 200 OK Date: Mon, 09 Dec 2002 22:20:28 GMT Server: Apache/1.3.22 (Unix) (Red-Hat/Linux) mod_ssl/2.8.5 OpenSSL/0.9.6 PHP/4.1.2 X-Powered-By: PHP/4.1.2 Keep-Alive: timeout=15, max=100 Connection: Keep-Alive Transfer-Encoding: chunked Content-Type: text/html h:\wine\wine\dlls\wininet\tests\http.c:154:Option 0x22 -> 1 http://www.winehq.com/about/ h:\wine\wine\dlls\wininet\tests\http.c:158:Option 0x5 -> 0 http://www.winehq.com/about/ (12150) h:\wine\wine\dlls\wininet\tests\http.c:163:Option 0x1 -> 1 text/html h:\wine\wine\dlls\wininet\tests\http.c:166:Entery Query loop h:\wine\wine\dlls\wininet\tests\http.c:183:ReadFile -> 1 743 h:\wine\wine\dlls\wininet\tests\http.c:183:ReadFile -> 1 3204 h:\wine\wine\dlls\wininet\tests\http.c:172: Test failed: InternetQueryDataAvailable failed h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_REQUEST_COMPLETE(100) 014CFDA8 8 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_CLOSING_CONNECTION(50) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_CONNECTION_CLOSED(51) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_HANDLE_CLOSING(70) 014CFD68 4 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC0008 0xdeadbeef INTERNET_STATUS_HANDLE_CLOSING(70) 014CFD24 4 h:\wine\wine\dlls\wininet\tests\http.c:90:Starting with flags 0x0 h:\wine\wine\dlls\wininet\tests\http.c:92:InternetOpenA <-- h:\wine\wine\dlls\wininet\tests\http.c:95:InternetOpenA --> h:\wine\wine\dlls\wininet\tests\http.c:101:InternetConnectA <-- h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC0004 0xdeadbeef INTERNET_STATUS_HANDLE_CREATED(60) 0012E990 4 h:\wine\wine\dlls\wininet\tests\http.c:104:InternetConnectA --> h:\wine\wine\dlls\wininet\tests\http.c:108:HttpOpenRequestA <-- h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC0008 0xdeadbead INTERNET_STATUS_HANDLE_CREATED(60) 0012EC04 4 h:\wine\wine\dlls\wininet\tests\http.c:122:HttpOpenRequestA --> h:\wine\wine\dlls\wininet\tests\http.c:126:HttpSendRequestA --> h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead ¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦ÞÙ?(80) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_CONNECTING_TO_SERVER(20) 0012EA3C 12 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_CONNECTED_TO_SERVER(21) 0012EA18 12 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_SENDING_REQUEST(30) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_REQUEST_SENT(31) 0012EB28 4 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_RECEIVING_RESPONSE(40) 00000000 0 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_RESPONSE_RECEIVED(41) 0012EB10 4 h:\wine\wine\dlls\wininet\tests\http.c:133:HttpSendRequestA <-- h:\wine\wine\dlls\wininet\tests\http.c:140:Option 0x17 -> 1 8 h:\wine\wine\dlls\wininet\tests\http.c:144:Option 0x22 -> 1 http://www.winehq.com/about/ h:\wine\wine\dlls\wininet\tests\http.c:149:Option 0x16 -> 1 HTTP/1.1 200 OK Date: Mon, 09 Dec 2002 22:20:29 GMT Server: Apache/1.3.22 (Unix) (Red-Hat/Linux) mod_ssl/2.8.5 OpenSSL/0.9.6 PHP/4.1.2 X-Powered-By: PHP/4.1.2 Keep-Alive: timeout=15, max=100 Connection: Keep-Alive Transfer-Encoding: chunked Content-Type: text/html h:\wine\wine\dlls\wininet\tests\http.c:154:Option 0x22 -> 1 http://www.winehq.com/about/ h:\wine\wine\dlls\wininet\tests\http.c:158:Option 0x5 -> 0 http://www.winehq.com/about/ (12150) h:\wine\wine\dlls\wininet\tests\http.c:163:Option 0x1 -> 1 text/html h:\wine\wine\dlls\wininet\tests\http.c:166:Entery Query loop h:\wine\wine\dlls\wininet\tests\http.c:183:ReadFile -> 1 743 h:\wine\wine\dlls\wininet\tests\http.c:183:ReadFile -> 1 3204 h:\wine\wine\dlls\wininet\tests\http.c:183:ReadFile -> 1 4236 h:\wine\wine\dlls\wininet\tests\http.c:183:ReadFile -> 1 3722 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC000C 0xdeadbead INTERNET_STATUS_HANDLE_CLOSING(70) 0012EC30 4 h:\wine\wine\dlls\wininet\tests\http.c:78:Callback 00CC0008 0xdeadbeef INTERNET_STATUS_HANDLE_CLOSING(70) 0012EC30 4 http: 22 tests executed, 0 marked as todo, 1 failure. C:\Downloads\Linux>winmm_test.exe wave h:\wine\wine\dlls\winmm\tests\wave.c:56:found 2 WaveOut devices h:\wine\wine\dlls\winmm\tests\wave.c:82: 0: "SoundMAX Digital Audio" 5.10 (1:100): channels=65535 formats=bffff support=002c h:\wine\wine\dlls\winmm\tests\wave.c:133:Testing invalid 2MHz format h:\wine\wine\dlls\winmm\tests\wave.c:82: 1: "Riproduzione linea #0 modem" 5.0 (1:81): channels=1 formats=0000 support=0000 h:\wine\wine\dlls\winmm\tests\wave.c:133:Testing invalid 2MHz format wave: 56 tests executed, 0 marked as todo, 0 failures. C:\Downloads\Linux>ws2_32_test.exe sock h:\wine\wine\dlls\winsock\tests\sock.c:694: **** STARTING TEST 0 **** h:\wine\wine\dlls\winsock\tests\sock.c:332:simple_server (1740) starting h:\wine\wine\dlls\winsock\tests\sock.c:391:simple_client (ef4): starting h:\wine\wine\dlls\winsock\tests\sock.c:341:simple_server (1740) ready h:\wine\wine\dlls\winsock\tests\sock.c:394:simple_client (ef4): server ready h:\wine\wine\dlls\winsock\tests\sock.c:346:simple_server (1740): waiting for client h:\wine\wine\dlls\winsock\tests\sock.c:391:simple_client (17fc): starting h:\wine\wine\dlls\winsock\tests\sock.c:394:simple_client (17fc): server ready h:\wine\wine\dlls\winsock\tests\sock.c:406:simple_client (17fc) connected h:\wine\wine\dlls\winsock\tests\sock.c:406:simple_client (ef4) connected h:\wine\wine\dlls\winsock\tests\sock.c:427:simple_client (17fc) exiting h:\wine\wine\dlls\winsock\tests\sock.c:346:simple_server (1740): waiting for client h:\wine\wine\dlls\winsock\tests\sock.c:427:simple_client (ef4) exiting h:\wine\wine\dlls\winsock\tests\sock.c:374:simple_server (1740) exiting h:\wine\wine\dlls\winsock\tests\sock.c:696: **** TEST 0 COMPLETE **** h:\wine\wine\dlls\winsock\tests\sock.c:694: **** STARTING TEST 1 **** h:\wine\wine\dlls\winsock\tests\sock.c:332:simple_server (1438) starting h:\wine\wine\dlls\winsock\tests\sock.c:341:simple_server (1438) ready h:\wine\wine\dlls\winsock\tests\sock.c:346:simple_server (1438): waiting for client h:\wine\wine\dlls\winsock\tests\sock.c:445:event_client (80): starting h:\wine\wine\dlls\winsock\tests\sock.c:445:event_client (8b0): starting h:\wine\wine\dlls\winsock\tests\sock.c:447:event_client (80): server ready h:\wine\wine\dlls\winsock\tests\sock.c:467:event_client (80) connected h:\wine\wine\dlls\winsock\tests\sock.c:447:event_client (8b0): server ready h:\wine\wine\dlls\winsock\tests\sock.c:467:event_client (8b0) connected h:\wine\wine\dlls\winsock\tests\sock.c:505:event_client (80): all data sent - shutdown h:\wine\wine\dlls\winsock\tests\sock.c:346:simple_server (1438): waiting for client h:\wine\wine\dlls\winsock\tests\sock.c:505:event_client (8b0): all data sent - shutdown h:\wine\wine\dlls\winsock\tests\sock.c:374:simple_server (1438) exiting h:\wine\wine\dlls\winsock\tests\sock.c:526:event_client (8b0): all data received h:\wine\wine\dlls\winsock\tests\sock.c:538:event_client (8b0): close event h:\wine\wine\dlls\winsock\tests\sock.c:556:event_client (8b0) exiting h:\wine\wine\dlls\winsock\tests\sock.c:526:event_client (80): all data received h:\wine\wine\dlls\winsock\tests\sock.c:538:event_client (80): close event h:\wine\wine\dlls\winsock\tests\sock.c:556:event_client (80) exiting h:\wine\wine\dlls\winsock\tests\sock.c:696: **** TEST 1 COMPLETE **** sock: 164 tests executed, 0 marked as todo, 0 failures. Alberto
C:\Downloads\Linux>advapi32_test.exe registry h:\wine\wine\dlls\advapi32\tests\registry.c:96: Test failed: value set to 'xxxxxxxxxx' instead of 'Te' h:\wine\wine\dlls\advapi32\tests\registry.c:97: Test failed: data set to 'xxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:111: Test failed: data set to 'xxxxxxx' instead of 'foobar' registry: 56 tests executed, 0 marked as todo, 3 failures.
It is here that I notice a large discrepancy between this test and my test on the same Operating System: h:\wine\wine\dlls\advapi32\tests\registry.c:80: Test failed: data_count set to 24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:81: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:94: Test failed: data_count set to 24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:95: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:96: Test failed: value set to 'xxxxxxxxxx' instead of 'Te' h:\wine\wine\dlls\advapi32\tests\registry.c:97: Test failed: data set to 'xxxxxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:108: Test failed: data_count set to24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:109: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:111: Test failed: data set to 'xxxxxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:122: Test failed: data_count set to24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:123: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:134: Test failed: expected ERROR_SUCCESS, got 234 h:\wine\wine\dlls\advapi32\tests\registry.c:135: Test failed: val_count set to 20 instead of 4 h:\wine\wine\dlls\advapi32\tests\registry.c:136: Test failed: data_count set to 24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:137: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:138: Test failed: value is 'xxxxxxxxxx' instead of Test h:\wine\wine\dlls\advapi32\tests\registry.c:139: Test failed: data is 'xxxxxxxxxx' instead of foobar h:\wine\wine\dlls\advapi32\tests\registry.c:155: Test failed: data_count set to 48 instead of 7*sizeof(WCHAR) h:\wine\wine\dlls\advapi32\tests\registry.c:156: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:169: Test failed: data_count set to 48 instead of 7*sizeof(WCHAR) h:\wine\wine\dlls\advapi32\tests\registry.c:170: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:182: Test failed: val_count set to 5 instead of 4 h:\wine\wine\dlls\advapi32\tests\registry.c:183: Test failed: data_count set to 48 instead of 7*sizeof(WCHAR) h:\wine\wine\dlls\advapi32\tests\registry.c:184: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:185: Test failed: value is not 'Test' h:\wine\wine\dlls\advapi32\tests\registry.c:195: Test failed: expected ERROR_SUCCESS, got 234 h:\wine\wine\dlls\advapi32\tests\registry.c:196: Test failed: val_count set to 5 instead of 4 h:\wine\wine\dlls\advapi32\tests\registry.c:197: Test failed: data_count set to 48 instead of 7*sizeof(WCHAR) h:\wine\wine\dlls\advapi32\tests\registry.c:198: Test failed: type 2 is not REG_SZ h:\wine\wine\dlls\advapi32\tests\registry.c:199: Test failed: value is not 'Test' h:\wine\wine\dlls\advapi32\tests\registry.c:200: Test failed: data is not 'foobar' registry: 56 tests executed, 0 marked as todo, 31 failures. Thanks, Kye Lewis kyethespy(a)liquid2k.com
On Tue, 10 Dec 2002, Kye Lewis wrote:
C:\Downloads\Linux>advapi32_test.exe registry h:\wine\wine\dlls\advapi32\tests\registry.c:96: Test failed: value set to 'xxxxxxxxxx' instead of 'Te' h:\wine\wine\dlls\advapi32\tests\registry.c:97: Test failed: data set to 'xxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:111: Test failed: data set to 'xxxxxxx' instead of 'foobar' registry: 56 tests executed, 0 marked as todo, 3 failures.
It is here that I notice a large discrepancy between this test and my test on the same Operating System:
h:\wine\wine\dlls\advapi32\tests\registry.c:80: Test failed: data_count set to 24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:81: Test failed: type 2 is not REG_SZ [...]
I guess that means the test makes assumptions that are not valid. It would be interesting to find out what the differences are between your bo and Alberto's: Home Edition vs. Profesional, internationaliztion issues, etc. Could it be that the test did not cleanup after itself and failed on the subsequent runs? Do we have a volunteer for untangling this? -- Francois Gouget fgouget(a)free.fr http://fgouget.free.fr/ tcA thgirypoC muinelliM latigiD eht detaloiv tsuj evah uoY
Well I've got XP Home SP1 here, I'm not going to go through a complete lot of specifications without having some idea of what to look for though :) Thanks, Kye Lewis kyethespy(a)liquid2k.com -----Original Message----- From: Francois Gouget [mailto:fgouget(a)free.fr] Sent: Tuesday, December 10, 2002 12:01 PM To: Kye Lewis Cc: wine-devel(a)winehq.org Subject: RE: Janitorial Projects -- conformance tests --recruiting volunteers On Tue, 10 Dec 2002, Kye Lewis wrote:
C:\Downloads\Linux>advapi32_test.exe registry h:\wine\wine\dlls\advapi32\tests\registry.c:96: Test failed: value set to 'xxxxxxxxxx' instead of 'Te' h:\wine\wine\dlls\advapi32\tests\registry.c:97: Test failed: data set to 'xxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:111: Test failed: data set to 'xxxxxxx' instead of 'foobar' registry: 56 tests executed, 0 marked as todo, 3 failures.
It is here that I notice a large discrepancy between this test and my test on the same Operating System:
h:\wine\wine\dlls\advapi32\tests\registry.c:80: Test failed: data_count set to 24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:81: Test failed: type 2 is not REG_SZ [...]
I guess that means the test makes assumptions that are not valid. It would be interesting to find out what the differences are between your bo and Alberto's: Home Edition vs. Profesional, internationaliztion issues, etc. Could it be that the test did not cleanup after itself and failed on the subsequent runs? Do we have a volunteer for untangling this? -- Francois Gouget fgouget(a)free.fr http://fgouget.free.fr/ tcA thgirypoC muinelliM latigiD eht detaloiv tsuj evah uoY
At 17.01 09/12/2002 -0800, Francois Gouget wrote:
On Tue, 10 Dec 2002, Kye Lewis wrote:
C:\Downloads\Linux>advapi32_test.exe registry h:\wine\wine\dlls\advapi32\tests\registry.c:96: Test failed: value set to 'xxxxxxxxxx' instead of 'Te' h:\wine\wine\dlls\advapi32\tests\registry.c:97: Test failed: data set to 'xxxxxxx' instead of 'foobar' h:\wine\wine\dlls\advapi32\tests\registry.c:111: Test failed: data set to 'xxxxxxx' instead of 'foobar' registry: 56 tests executed, 0 marked as todo, 3 failures.
It is here that I notice a large discrepancy between this test and my test on the same Operating System:
h:\wine\wine\dlls\advapi32\tests\registry.c:80: Test failed: data_count set to 24 instead of 7 h:\wine\wine\dlls\advapi32\tests\registry.c:81: Test failed: type 2 is not REG_SZ [...]
I guess that means the test makes assumptions that are not valid. It would be interesting to find out what the differences are between your bo and Alberto's: Home Edition vs. Profesional, internationaliztion issues, etc.
My machine is an Italian version of XP Home SP1, maybe this could play a role...advapi32.dll is version 5.1.2600.1106 Anyhow, it seems to me that the results are in line with what the test is expecting, apart from the fact that the test expects that RegEnumValue will fill the return buffer with the amount of characters it can hold, even if the value is longer. But MSDN states that "if the buffer specified by lpData is not large enough to hold the data, the function returns ERROR_MORE_DATA and stores the required buffer size in the variable pointed to by lpcbData. In this case, the contents of lpData are undefined." Alberto
My system is W2K Visual C++ 6.0 Built test on RedHat 7.3 and moved over to Win box These are build Errors on W2K Tom ---- advapi32_test.exe - 0 error(s), 0 warning(s) dsound_test.exe - 0 error(s), 0 warning(s) gdi32_test.exe - 17 error(s), 1 warning(s) kernel32_test.exe - 0 error(s), 0 warning(s) msvcrt_test.exe - 0 error(s), 0 warning(s) netapi32_test.exe - 0 error(s), 0 warning(s) ntdll_test.exe - 0 error(s), 0 warning(s) oleaut32_test.exe - 1 error(s), 0 warning(s) rpcrt4_test.exe - 0 error(s), 0 warning(s) shell32_test.exe - 0 error(s), 0 warning(s) shlwapi_test.exe - 0 error(s), 0 warning(s) urlmon_test.exe - 0 error(s), 0 warning(s) user32_test.exe - 0 error(s), 0 warning(s) wineruntests.exe - 17 error(s), 1 warning(s) winetest.lib - 0 error(s), 0 warning(s) wininet_test.exe - 0 error(s), 0 warning(s) winmm_test.exe - 0 error(s), 0 warning(s) ws2_32_test.exe - 0 error(s), 0 warning(s) Build Log --------------------Configuration: gdi32_test - Win32 Wine Headers-------------------- Command Lines Creating temporary file "C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP47.tmp" with contents [ /nologo /MTd /W3 /Gm /GX /ZI /Od /I "..\..\..\Output\\Win32_Wine_Headers" /I "..\..\..\include" /D "_DEBUG" /D "WIN32" /D "_WINDOWS" /D "_MBCS" /D "_USRDLL" /D "_GDI32_TEST_" /D "__WINE_USE_MSVCRT" /D __WINETEST_OUTPUT_DIR=\"Output\\Win32_Wine_Headers\" /D "__i386__" /D "_X86_" /D inline=__inline /FR"Output\Win32_Wine_Headers/" /Fo"Output\Win32_Wine_Headers/" /Fd"Output\Win32_Wine_Headers/" /FD /GZ /c "C:\include\wine\dlls\gdi\tests\generated.c" ] Creating command line "cl.exe @C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP47.tmp" Creating temporary file "C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP48.tmp" with contents [ gdi32.lib /nologo /subsystem:console /incremental:yes /pdb:"Output\Win32_Wine_Headers/gdi32_test.pdb" /debug /machine:I386 /out:"Output\Win32_Wine_Headers/gdi32_test.exe" /pdbtype:sept .\Output\Win32_Wine_Headers\generated.obj .\Output\Win32_Wine_Headers\testlist.obj ] Creating command line "link.exe @C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP48.tmp" Output Window Compiling... generated.c c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2061: syntax error : identifier 'OLDFONTENUMPROCA' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : 'constant' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : 'constant' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : ')' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2143: syntax error : missing ')' before 'string' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2143: syntax error : missing ')' before 'string' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2143: syntax error : missing '{' before 'string' c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2059: syntax error : '' c:\include\wine\dlls\gdi\tests\generated.c(2256) : error C2059: syntax error : '}' c:\include\wine\dlls\gdi\tests\generated.c(3787) : warning C4013: 'test_pack_OLDFONTENUMPROCW' undefined; assuming extern returning int Error executing cl.exe. Results gdi32_test.exe - 17 error(s), 1 warning(s) Build Log --------------------Configuration: oleaut32_test - Win32 Wine Headers-------------------- Command Lines Creating temporary file "C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP49.tmp" with contents [ /nologo /MTd /W3 /Gm /GX /ZI /Od /I "..\..\..\Output\\Win32_Wine_Headers" /I "..\..\..\include" /D "_DEBUG" /D "WIN32" /D "_WINDOWS" /D "_MBCS" /D "_USRDLL" /D "_OLEAUT32_TEST_" /D "__WINE_USE_MSVCRT" /D __WINETEST_OUTPUT_DIR=\"Output\\Win32_Wine_Headers\" /D "__i386__" /D "_X86_" /D inline=__inline /FR"Output\Win32_Wine_Headers/" /Fo"Output\Win32_Wine_Headers/" /Fd"Output\Win32_Wine_Headers/" /FD /GZ /c "C:\include\wine\dlls\oleaut32\tests\vartest.c" ] Creating command line "cl.exe @C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP49.tmp" Creating temporary file "C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP4A.tmp" with contents [ oleaut32.lib /nologo /subsystem:console /incremental:yes /pdb:"Output\Win32_Wine_Headers/oleaut32_test.pdb" /debug /machine:I386 /out:"Output\Win32_Wine_Headers/oleaut32_test.exe" /pdbtype:sept .\Output\Win32_Wine_Headers\vartest.obj .\Output\Win32_Wine_Headers\testlist.obj ] Creating command line "link.exe @C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\RSP4A.tmp" Output Window Compiling... vartest.c c:\include\wine\dlls\oleaut32\tests\vartest.c(656) : fatal error C1064: compiler limit : token overflowed internal buffer Error executing cl.exe. Results oleaut32_test.exe - 1 error(s), 0 warning(s)
Le lun 09/12/2002 à 19:55, Tom a écrit :
My system is W2K Visual C++ 6.0 Built test on RedHat 7.3 and moved over to Win box
These are build Errors on W2K
Tom
----
advapi32_test.exe - 0 error(s), 0 warning(s) dsound_test.exe - 0 error(s), 0 warning(s) gdi32_test.exe - 17 error(s), 1 warning(s) kernel32_test.exe - 0 error(s), 0 warning(s) msvcrt_test.exe - 0 error(s), 0 warning(s) netapi32_test.exe - 0 error(s), 0 warning(s) ntdll_test.exe - 0 error(s), 0 warning(s) oleaut32_test.exe - 1 error(s), 0 warning(s) rpcrt4_test.exe - 0 error(s), 0 warning(s) shell32_test.exe - 0 error(s), 0 warning(s) shlwapi_test.exe - 0 error(s), 0 warning(s) urlmon_test.exe - 0 error(s), 0 warning(s) user32_test.exe - 0 error(s), 0 warning(s) wineruntests.exe - 17 error(s), 1 warning(s) I don't see the output of this one...
winetest.lib - 0 error(s), 0 warning(s) wininet_test.exe - 0 error(s), 0 warning(s) winmm_test.exe - 0 error(s), 0 warning(s) ws2_32_test.exe - 0 error(s), 0 warning(s)
Build Log
--------------------Configuration: gdi32_test - Win32 Wine Headers-------------------- ... generated.c c:\include\wine\dlls\gdi\tests\generated.c(2255) : error C2061: syntax error : identifier 'OLDFONTENUMPROCA' This error (the others follow directly) is because STRICT is undefined. I'll send a cleaned-up version of my first version.
Build Log
--------------------Configuration: oleaut32_test - Win32 Wine Headers-------------------- ... vartest.c c:\include\wine\dlls\oleaut32\tests\vartest.c(656) : fatal error C1064: compiler limit : token overflowed internal buffer
I'll take a look at this one also. Vincent
On Mon, 9 Dec 2002, Alberto Massari wrote:
Volunters welcome.
I thought I could try running them on my Windows XP Home machine....
Thanks, I integrated your results and Kye's on the status page: http://fgouget.free.fr/wine/tests-en.shtml The good news is that your results match those of Kye... except for advapi32. Help with untangling this one would be appreciated. The other bit of bad news is that Kye reported that the user32/sysparms test messes up the system settings somewhat on Windows XP. I noticed the same thing on Win 95. So I recommend caution before running that specific test (it is not invoked from the batch file for that reason). -- Francois Gouget fgouget(a)free.fr http://fgouget.free.fr/ The nice thing about meditation is that it makes doing nothing quite respectable -- Paul Dean
Francois Gouget wrote:
So what I did is compile them here, whip up a quick batch file to invoke them all, and zip them up. You can download them from:
http://fgouget.free.fr/wine/winetests.zip
Just unzip them in some random directory and run them as follows:
runtests.bat
The above script skips the generated tests (for no particular reason) and skips the sysparams user32 test because it messes the environment badly (e.g. the width of window borders).
Given the number of tests that fail you may want to run them one by one to better capture their output. To do so just have a quick look at the batch file, running the tests is very easy, e.g.:
kernel32_test.exe path
[snip} I started a bug report http://bugs.winehq.com/show_bug.cgi?id=1185 for the conformance test not running on windows 98 Runing the tests on Microsoft Windows 98 (4.10.1998) a lot of tests fail. tests downloaded from http://fgouget.free.fr/wine/winetests.zip I was unable to redirect the output of the tests to a file. For example "ws2_32_test.exe sock > temp.txt" would give me a 0 lenght file is it supposed to work that way? Some tests output more than 50 lines so that even with the terminal set to 50 lines I would not be able to copy all of them. Also a lot (most) of the tests had the prefix of where the file resided on when it was compiled for each line, which made for very long lines. I cleaned up the lines wrap, but is it really nessesary to print the whole path. The output from the tests is at http://bugs.winehq.com/showattachment.cgi?attach_id=350 -- Tony Lambregts
On Mon, 9 Dec 2002, Tony Lambregts wrote: [...]
I was unable to redirect the output of the tests to a file. For example "ws2_32_test.exe sock > temp.txt" would give me a 0 lenght file is it supposed to work that way?
Redirections are handled by the shell. This is true on Unix, on Windows NT, on Windows 9x and on DOS. Of course on Windows 9x and DOS the shell is so bad that it doesn't even support redirections.
Some tests output more than 50 lines so that even with the terminal set to 50 lines I would not be able to copy all of them.
Yes, with vanilla Win9x there is not solution. The only solutions I see are: * run the test in a debugger and to suspend it at the appropriate time. This is what I usually do. Of course it sort of implies you are also committed to fixing the bug while you're at it. * write your own tool to start the tests and redirect their output to a file. * use a better shell out of cygwin or mks toolkit.
Also a lot (most) of the tests had the prefix of where the file resided on when it was compiled for each line, which made for very long lines. I cleaned up the lines wrap, but is it really nessesary to print the whole path.
Probably not.
The output from the tests is at http://bugs.winehq.com/showattachment.cgi?attach_id=350
Thanks. -- Francois Gouget fgouget(a)free.fr http://fgouget.free.fr/ I haven't lost my mind, it's backed up on tape around here somewhere...
David Miller wrote:
I could probably run some tests under WinXP. I just need to compile the tests on windows, execute them, and post output to wine-devel? Is this correct?
Pretty much. -- Tony Lambregts
participants (7)
-
Alberto Massari -
David Miller -
Francois Gouget -
Kye Lewis -
Tom -
Tony Lambregts -
Vincent Béron