One thing I have noticed is that if there's shader code that doesn't compile at all, there's not really a helpful message. It says `Test failed: Got unexpected hr 0x80004005.` on a line *after* the code block.
I don't think it's the world's biggest priority because compile errors aren't really what we're testing for here, though.