Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: CEGT: testing and presentation of results

Author: gerold daniels

Date: 21:26:27 10/19/05

Go up one level in this thread


On October 20, 2005 at 00:04:43, Heinz van Kempen wrote:

>Hi all :-),
>
>currently a few CEGT testers are disappointed about what was written here in
>some threads.
>
>Feeling not responsible for statistically absurd fluctuations we really think
>that it is better to give rating lists from Thursday evening onwards only for
>engine versions, settings, etc. with more than 300 games. It simply leads to
>disappointment and frustration, when there is a fantastic start and afterwards a
>cruel drop, like it happens so many times over and over again. Maybe better to
>inform the authors about progress of a big test via email or in our private
>forum.
>
>Joachim Rang wrote an email to CEGT testers that the chance to improve something
>by a setting might be only 1%. I think this is especially the case when few
>positions were tested only. Most of the good Blitz results were with additional
>king safety to 104, what we did not test.
>
>Moreover it can“t be that a whole team of experienced testers gets scrutinized,
>almost insinuating that there are essential things not done correctly. Of course
>with so many games it will not be possible to check the many bugs (every engine
>and GUI has) at once and theoretically there might be also a hardware or OS
>malfunction.
>
>We saw of course that all those discussions cast a negative light on our work.
>Feeling that we have a great team with enthusiastic testers currently even this
>will not demoralize us and we will try to offer valuable information to authors
>and interested readers in CCC also in the future.
>
>I regret that the discussion will surely have been annoying to the readers and
>will try to avoid unkind answers of any kind from my side, seeing that there are
>great efforts to make this forum friendlier overall.
>
>Best Regards
>Heinz
>
>http://www.husvankempen.de/nunn/

Hello Heinz. I think you and the rest of the testers are doing a great job.
Enjoy looking at the results each day. Hope you will deside to post as you
have been. Most here look forward to your testing. A lot can be learned from
the games. Thanks for all your hard work.

Good luck,

Gerold.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.