Am Donnerstag, 20. Dezember 2007 16:45:11 schrieb Christoph Frick:
Changing the graphics card skews the results a bit :-/ Unfortunately it's pretty hard to say how much of an impact that has per test.
and changing drivers (assumption) and the patches won't help either.
Yeah, the different hardware setup limits the usefulness of the results. It would be really interesting to see this comparison with the same hardware and driver :-)
On a related note, it would be really cool if people could help with writing cxtest(www.cxtest.org) scripts for the various apps. This will allow automated performance testing and automated one-click regression testing if problems occur. I have once written such benchmarks for ut2004, half life 2 and 3dmark2000, but more are definitly welcome. My time is too limited to take care of all this, so our D3D QA still relies on user testing for the most part.