Patchwatcher is suppose to sort of do this. It only works for linux, not other systems, but it will not only check your patch against compiling but also against the test suit and mark and regressions.