On Mon, 3 Feb 2020, Francois Gouget wrote: [...]
The rationale here is that after the first few repetitions additional lines don't really bring any new information: sure GetFontFaceReference() is unimplemented, there's no point saying so 772 times!
In contrast other todo lines still bring new information. This is why this patch mutes individual lines rather than limiting the total number of non-essential lines in a test unit.
The drawback is that some tests like ieframe:webbrowser have 10 lines that each generate between 15 and 26 lines of output. So they all fly under the 50 repeats threshold but still generate 14 KB all together.
Note that even so this patch is sufficient to get the new debiant VM under 1.5 MB (from 1.7 MB to 1.3 MB). Same thing for the cw-gtx560 machine.
https://test.winehq.org/data/errors.html
So maybe we can use this approach for now and worry about more drastic options once it's no longer sufficient.
(as we keep adding tests all options will be insufficient eventually)