Today I saw two similar projects related to OpenGL:
[1]:
glean is a suite of tools for evaluating the quality of an OpenGL implementation and diagnosing any problems that are discovered. glean also has the ability to compare two OpenGL implementations and highlight the differences between them.
It seems be having win32 port also.
[2]:
Piglit is a collection of automated tests for OpenGL implementations.
The goal of Piglit is to help improve the quality of open source OpenGL drivers by providing developers with a simple means to perform regression tests.
Current status is that the framework is working (though rough at the edges). It contains the Glean tests, some tests adapted from Mesa as well as some specific regression tests for certain bugs. HTML summaries can be generated (see below), including the ability to compare different test runs.
Could these be of any use for our graphic guys -- Stefan and co.?
Then there is PerceptualDiff utility I found some time ago [3]. Guessed, could it also usefull for finding visual regressions of Wine? Probably not, as it seems to be used for testing video codecs (but I may be wrong):
PerceptualDiff is an image comparison utility that makes use of a computational model of the human visual system to compare two images.
So why would I use a program to tell me if two images are similar if I can tell the difference myself by eyeballing it?
Well the utility of this program really shines in the context of QA of rendering algorithms.
During regression testing of a renderer, hundreds of images are generated from an older version of the renderer and are compared with a newer version of the renderer. This program drastically reduces the number of false positives (failures that are not actually failures) caused by differences in random number generation, OS or machine architecture differences. Also, you do not want a human looking at hundreds of images when you can get the computer to do it for you nightly on a cron job.
[1] http://glean.sourceforge.net/whatis.html [2] http://people.freedesktop.org/~nh/piglit/ [3] http://pdiff.sourceforge.net/