On 12/17/20 5:28 PM, Francois Gouget wrote:
In these freezing times I'm looking for volunteers to help with three TestBot related tasks:
Modify WineTest to detect which tests can be run by running 'xxx_test --list' and automatically detecting and dismissing the "Missing dll" / "Missing entrypoint" dialogs.
This would fix a lot of issues with tests not being run when they should:
- Detect and report WineTest's "load errors" https://bugs.winehq.org/show_bug.cgi?id=48062
- Detect missing entry point errors https://bugs.winehq.org/show_bug.cgi?id=48208
Alternatively the same type of change is needed for the TestBot's TestLauncher where it would replace AllImportedDllsPresent(): https://source.winehq.org/git/tools.git/blob/HEAD:/testbot/src/TestLauncher/...
There too it will help with a lot of issues:
- TestLauncher says a required DLL is missing, but the test runs fine without TestLauncher https://bugs.winehq.org/show_bug.cgi?id=31609
But I expect that once this is done on one side it will be easy to port to the other. So the choice of codebase is yours.
Write or find a Windows tool to automatically take a screenshot every few seconds and deduplicate identical screenshots. The requirements are:
I can help out with this one. I had been debugging some screenshot problems on Wine and already have a few code snippets to do screenshots and save them.
For this tool, I'm thinking doing it generally the following way: 1. Capture the whole virtual screen and save it in a png in memory. 2. Compare the png in 1, if it's not equal to the previous screenshot, save it to disk in a folder.
And this tool can run on Windows and Wine with your requirements met.
I wonder if it would be better if we do video capture instead? If we don't plan on keeping the video forever, I think a 2 mins video shouldn't be too large. A few megabytes I think, depending on the video format.
Zhiyi
- Open-source of course.
- No dependency (so if using an off-the-shelf tool it should not require installing some language runtime, etc).
- Must support multi-screen configurations, even with slightly different resolutions.
- Will eventually need to be used by the TestBot through TestAgentd, either by running this external tool, or be integrated in TestAgentd itself.
The same functionality will be needed on Unix. If that's not possible with a Windows tool this may turn into a separate project to do the same on the Unix side. There I expect some scriptable open-source tools to already exist but if one tool can do it all that would be simpler.
- Take live/regular screenshots https://bugs.winehq.org/show_bug.cgi?id=44709
In the meantime I'll continue refreshing the test VMs, and working on the website and Engine perl side of things (but if there are volunteers for that you're welcome too).