Yeah I was indeed running this without UsePPosition by accident. Setting it makes this test here work a lot better, although there is still the case of randomly minimizing the window right after the initial create_device.
I'll close the MR for now but might come back to the idea later if I still see this fail despite UsePPosition.