http://bugs.winehq.org/show_bug.cgi?id=15716
Summary: Wine testcases should not use the public internet, as it causes flakiness Product: Wine Version: 1.1.6 Platform: Other OS/Version: other Status: NEW Severity: normal Priority: P2 Component: testcases AssignedTo: wine-bugs@winehq.org ReportedBy: dank@kegel.com
Just about every day, patchwatcher rejects a patch incorrectly because some conformance test is relying on the Internet to be there. Sadly, the Internet is not 100% reliable, and therefore must not be used by any test suite that needs to be 100% reliable.
We must expunge all use of the internet from our test suite, in favor of mock servers running locally.
One way to start would be to add a configure-time option to cause all hostname resolution to return 127.0.0.1. Then people who needed ultrarepeatable conformance test results (like patchwatcher) could use that option and never have flaky results due to the public internet.