Re: appdb rating inflation

[Ben Hodgetts (Enverex)]

Chris Morgan wrote:
> On 03 Jan 2007 22:46:31 +0200, Kari Hurtta  
> wrote:
> > "Chris Morgan"  writes in 
> > gmane.comp.emulators.wine.devel:
> > > On 03 Jan 2007 16:34:21 +0200, Kari Hurtta
> >
> >  wrote:
> > > > "Dan Kegel"  writes in
> >
> > gmane.comp.emulators.wine.devel:
> > > > > The appdb says
> > > > > "Only applications which install and run flawlessly on an
> >
> > out-of-the-box
> > > > > Wine installation make it to the Platinum list"
> > > >
> > > > Yes.  Also on front page http://appdb.winehq.org/ on first item:
> > > >
> > > > The Top-10 Platinum List
> > > >
> > > > Ragnarok Online All Versions
> > > >
> > > > http://appdb.winehq.org/appview.php?iVersionId=928
> > > >
> > > > Maintainer's Rating:    Platinum
> > > >
> > > > Description:            What was not tested
> > > >                      * Installation. That was not necessary 
> >
> > because I
> > > >                        already installed it in Windows - I'm 
> >
> > just running
> > > >                        RO from the Windows partition.
> > > >
> > > >
> > > >
> > > > So that appdb classification is complete garbage.
> > > >
> > > > If Platinum requires that installation works out of box, and
> > > > tester did even tested installation and still gives platinium.
> > > >
> > > > So first item on http://appdb.winehq.org/ says "don't trust me".
> > > >
> > > > / Kari Hurtta
> > > >
> > > > ( Some other maintenaivers have give rating 'Garbage' for this
> >
> > application :-) )
> > > I agree, the rating isn't correct. We aren't going to be able to avoid
> > > issues with mis-rated applications though, so discussing language
> > > changes is only going to clarify the issue not entirely prevent them.
> > >
> > > In this case the maintainer of the application should be made aware of
> > > this issue and should take care of correcting the rating.
> > >
> > > Chris
> >
> > Yes. However there may be another test for this application, which may
> > be correctly rated platinium:
> >
> > http://appdb.winehq.org/appview.php?iVersionId=928&iTestingId=8032
> >
> > On that test, installation is tested:
> >
> > |         What works
> > |         Installing the game, patching, launching the game from the 
> > directory.
> > |         Sound worked flawlessly. Runs as fast as on win32 at 
> > 1024x768 (full detail).
> >
> > http://appdb.winehq.org/   platinium list's first item should point
> > to that test instead.
> >
> > Perhaps    appdb should check that   "Installs?" and "Runs?"   column on
> > particular test have "Yes", before it accept "Platinum" to "Rating"
> > column ?
> >
> > / Kari Hurtta
>
> Exactly, we need some logic to ensure ratings are correct. I think the
> fundamental change is that we should remove maintainer ratings
> entirely and be driven by the test results. This way the rating of the
> application depends on how well users can get it to run on their
> platform under wine instead of an experts opinion.
>
> Chris

I'd have to agree. Just having the normal app-reports seems to make more 
sense. I'm also not sure how the maintainer rating was supposed to work. 
I was going by current Wine but another maintainer changed it back and 
the Wine version to and old one saying you have to set it to the one 
that worked best.

Ex.